The benchmark trap: Does comparing survey results kill action?

A common question organisations ask is:

“How do we benchmark ourselves?”

Benchmarking feels reassuring.

It offers context, comparison, and an apparent sense of objectivity.

But research across implementation science, employee voice, and survey methodology consistently shows that benchmarking might be useful for measurement; but it's weak for improvement.

Teamgage was intentionally designed to prioritise relevance and actionability over generic comparison, because that is what sustains learning and performance in real work settings.

Benchmarking measures position. Improvement requires direction.

Benchmarks answer the question:

“How do we compare to others?”

Improvement systems must answer a different question:

“What should we change next, here, now?”

Normalisation Process Theory (NPT) helps explain this distinction. NPT shows that practices embed when people can make sense of them locally, when the activity is clearly about our work rather than abstract comparison.

This mechanism, called coherence, is the foundation of sustained participation.

Generic benchmark questions weaken coherence because they:

• are designed for cross organisation comparison, not local meaning
• often fail to reflect the actual constraints, goals, or trade offs teams face
• obscure responsibility for action e.g. “we’re below average” is not a change strategy

When people cannot see how data relates directly to their work, participation and follow through decline; even if response rates are high.

Employee voice research: People speak up when relevance is clear

Decades of employee voice research converge on a simple finding:

People speak up when issues feel relevant and when action feels plausible.

Studies consistently show that:

• relevance of the topic predicts whether employees contribute voice
• broad, abstract items reduce perceived usefulness
• context specific mechanisms increase psychological safety and trust

Unfortunately, generic benchmark surveys often ask people to rate experiences that are:

• far removed from their day to day reality
• ambiguously actionable
• clearly outside the influence of their team or leader

This is why Teamgage takes the opposite approach with questions that are:

• grounded in real team dynamics (clarity, workload, fairness, safety)
• framed so teams can see how input will be used
• tightly coupled to a visible improvement loop

This is what converts latent voice into usable signal!

Survey science: Data quality depends on question fit, not scale size

Large benchmark surveys are statistically powerful, but power does not compensate for weak construct relevance.

Survey methodology research shows that:

• relevance increases response accuracy and honesty
• poor question fit amplifies bias—even in large datasets
• “big data” does not correct measurement error; it often magnifies it

Foundational work in questionnaire design (Krosnick, Schwarz, Presser, Artino, Gehlbach) demonstrates that:

• generic questions increase cognitive burden
• reduce interpretive consistency
• weaken the link between data and decision making

Teamgage applies this evidence by prioritising:

• specific, behaviourally anchored questions
• item specific verbal response options
• short, frequent pulses tied to action

The result is less data; but better signal.

Continuous improvement research: Specificity enables action

Research on continuous improvement and reflexive teams consistently shows that:

• short, targeted feedback cycles lead to faster learning
• locally meaningful measures strengthen ownership
• generic metrics slow down adaptation.

Benchmarking supports comparison. Specificity supports change.

Teamgage does not prevent benchmarking altogether. Instead, it reframes its role:

• benchmarks may inform strategy and external positioning
• but local, theory driven questions drive improvement

Organisations can still aggregate patterns across teams, functions, or regions without sacrificing relevance or actionability at the front line.

How Teamgage approaches comparison without undermining relevance

Rather than asking:

“How do we score compared to others?”

Teamgage enables leaders to ask:

• Where are conditions for performance improving or deteriorating?
• Which teams are learning fastest and why?
• What practices are working in one part of the system that could be adapted elsewhere?

This aligns with systems thinking and implementation science, which emphasise pattern recognition over rank ordering.

In mature organisations, the most valuable comparison is not external, it is internal learning at speed.

The practical conclusion

Benchmarking offers reassurance.

Relevance offers momentum.

Research across Normalisation Process Theory, employee voice, survey science, and continuous improvement converges on the same conclusion:

You can compare scores or you can improve work.
You rarely get both from the same question set.

Teamgage intentionally chooses the path that leads to learning, action, and sustained performance.