Your Organization Is Information Rich and Decision Poor. Here’s Why.
“Information rich. Decision poor.”
That phrase describes a condition that is startlingly common in organizations today — and one of the most expensive problems leaders rarely recognize until it’s too late.
Data is everywhere. Dashboards, survey scores, metrics, quarterly reports — neatly assembled, regularly updated, and largely unused when the decisions that matter most need to be made. When it’s time to cut a budget, pivot a program, or make a strategic call, the conversation devolves into opinion, instinct, and anecdote. The data doesn’t save it. Often, no one can even agree on what it means.
This is what happens when organizations confuse the activity of evaluation with the practice of it.
Scaling Evaluation Is Not the Same as Doing More of It
When organizations say they want to “scale evaluation,” they typically mean they want more of what they are already doing — more surveys, more reports, more dashboards, more metrics cascading across more teams. The intention is sound. The execution produces what evaluation expert Ted Kniker calls “multiplication of noise” — not multiplication of insight. Ted spent 24 years in federal service, most recently as Chief of Evaluation for the U.S. Department of State, and has advised organizations from small nonprofits to Fortune 500 companies on building evaluation systems that actually work.
Real scaling is about alignment, not volume. It requires a shared understanding of what success looks like, how it is defined across the organization, and — critically — how information will be used to drive decisions and improve performance. Without that foundation, more data collection only deepens the problem. It creates more things to argue about, more reports that contradict each other, and more leaders who learn to distrust the data they are receiving.
One of the most overlooked barriers to effective evaluation at scale is the absence of shared language. In virtually every large organization, different teams define the same outcomes differently. “Performance improvement” means one thing in operations and something else entirely in learning and development. “Engagement” carries a dozen definitions across a dozen departments. When the definitions do not match, the data cannot connect — and enterprise learning becomes impossible.
Program Evaluation vs. Enterprise Evaluation: A Fundamental Difference
There is a meaningful — and frequently underestimated — gap between strong evaluation at the program level and evaluation that actually functions at the enterprise level.
Program evaluation can succeed on talent. A skilled evaluator, a supportive program leader, a team that genuinely uses data — these things can produce excellent, rigorous work within the boundaries of a single program or unit. But that excellence rarely travels. It does not spread by osmosis. What works in one unit can be admired by others, but it almost never gets adopted without structural support from the top.
This distinction — talent at the program level, systems at the enterprise level — shows up in how Kirkpatrick Partners thinks about organizational development more broadly. Just as certification builds individual capability while accreditation builds organizational systems, program evaluation builds local knowledge while enterprise evaluation builds institutional learning. Read more about that distinction here.
Enterprise evaluation has to succeed through systems. That means common definitions. Governance — clear ownership of data, clear processes for how findings are interpreted and acted upon, clear accountability for what happens after an evaluation is complete. Decision routines that embed evidence into how leaders think and prioritize, not just what they report. And standards that provide coherence across units while still allowing each program to measure what is most relevant to its own context.
This is the distinction between pockets of excellence and enterprise capability. Any organization can develop pockets of excellence — isolated teams doing genuinely good evaluation work. But as Ted puts it, one lighthouse doesn’t light the whole coast. The goal is an organization where evaluative thinking is embedded in how every leader operates, not siloed in one high-performing unit.
What the Warning Signs Actually Look Like
Organizations struggling to scale evaluation tend to show recognizable patterns. Leaders receive a high volume of reports but cannot get clarity on what is actually happening across the enterprise. Teams are collecting similar data in incompatible ways — different definitions, different collection methods, different analysis approaches — making cross-unit comparison impossible. People spend more time defending their numbers than using them. And measures multiply while decisions do not improve.
The biggest red flag: when an organization describes itself as having data everywhere but still not knowing what’s really happening. That is not an evaluation problem. It is a systems problem — and adding more evaluation activity will not fix it. When leaders stop trusting the data, one of two things tends to happen: decision-making reverts to instinct, politics, and anecdote, or leaders begin demanding more analysis without ever acting on it. Either way, evaluation stops functioning as a strategic asset and starts functioning as overhead.
The Role Leadership Plays
Leaders are the single greatest determinant of whether evaluation scales successfully in an organization — not the evaluation team, not the methodology, not the tools. The leader.
What leaders do with evaluation results signals to everyone what evaluation is actually for. If leaders ask for data and then punish the people who deliver inconvenient truths, evaluation becomes a political exercise. If findings are used to assign blame rather than improve programs, teams learn quickly to surface only good news. And if evaluation only produces reports that get filed — with no visible connection to how decisions are made — the organization learns that evaluation does not actually matter.
The organizations where evaluation scales well are those where leaders model something different. They ask consistent questions rooted in outcomes. They reward learning, not just good news. They use evaluation to improve — not to perform, not to comply, and not to assign accountability after the fact. And when peers and senior leaders begin talking openly about the value evaluation brought to their own work, it creates the kind of social proof that no internal champion can manufacture alone. That is how evaluation culture spreads: not through mandates, but through leaders who demonstrate what it looks like to use evidence well.
How the Kirkpatrick Model Supports Enterprise Scale
The Kirkpatrick Model is often understood as a program-level tool — a framework for evaluating whether a training initiative achieved its intended outcomes. At the enterprise level, it functions as something more fundamental: a shared logic for connecting program activities to organizational results.
The key principle for scaling the Kirkpatrick Model across an organization is this: standardize at the outcome level, not the measurement level. Different programs require different measures. A leadership development initiative, a technical skills training, and a compliance program should not — and cannot — be evaluated identically. But they can all be connected to the same Level 4 Results: the strategic outcomes the organization is working toward.
The Four Levels® provide a common framework for asking the right questions at each stage of a program’s impact while allowing each program to operationalize those questions in ways appropriate to its own context. This gives organizations what they actually need at enterprise scale: coherence without rigidity. Shared outcomes. Flexible execution. A consistent logic for connecting what happens in a training room, a coaching engagement, or a leadership retreat to what ultimately moves the needle at the organizational level.
This also addresses one of the most common misconceptions about evaluation at scale: that standardization requires uniformity. It does not. Standards tell an organization what it is ultimately trying to achieve. How individual programs get there — and how they measure their progress — can and should look different. That flexibility is not a weakness in the framework. It is the point.
A Practical First Step: Start With Questions, Not Tools
For organizations ready to move from evaluation activity to evaluation capability, the most important first step is deceptively simple: stop starting with tools and start starting with questions.
Before selecting a survey platform, building a dashboard, or designing a measurement framework, ask: What are the two or three outcomes that matter most to this organization right now? What decisions do we most need evaluation to inform? What do we not yet know that, if we knew it, would change how we act?
This is the foundation of a learning agenda — a structured set of priority questions that an organization commits to answering over time in order to improve its policies, programs, and performance. A learning agenda forces clarity on what evaluation is actually for. It aligns stakeholders before data collection begins. It gives every evaluation effort — at every level of the organization — a clear line of sight to strategic priorities.
In practice, this looks like bringing together key stakeholders — senior leaders, program owners, learning and development teams — and asking them to agree on no more than three to five organizational questions that evaluation should be designed to answer. Not “how effective was this training?” but “to what extent are leaders applying the behaviors we have identified as critical to our strategy?” Not “what was the satisfaction score?” but “what is changing in how our people perform, and how do we know?”
Organizations that start with questions rather than tools find that their data becomes usable. Leaders begin to trust it because it was designed to answer what they are actually asking. Decisions improve. And evaluation stops being something that happens in a department down the hall and starts becoming the way the organization learns.
This is not a technology problem. It is not a methodology problem. It is a clarity and commitment problem — and it can be solved, one intentional question at a time.
The Bottom Line
Evaluation is the unlock for the future of organizational health and performance. But unlocking it at scale requires more than talented evaluators and rigorous methods. It requires alignment, governance, leadership commitment, and a shared framework for connecting program-level work to enterprise-level outcomes.
The goal is not more data. The goal is better judgment — and an organization that consistently uses what it learns to improve what it does.
To learn more about how the Kirkpatrick Model supports enterprise-wide evaluation, visit kirkpatrickpartners.com, or listen to the full conversation with Ted Kniker on The Kirkpatrick Podcast.
Find Out Where Your Organization Stands
The Enterprise Performance Intelligence Maturity Assessment gives you a detailed picture of your organization’s maturity across governance, measurement and evaluation, performance thinking, leadership alignment, and more — with specific recommendations on what to prioritize next.
Every organization that completes the assessment is also welcome to a complimentary 30-minute strategy call to work through their first 90 days.
Take the assessment today.
