Wednesday, October 18, 2017
Glossary of Kirkpatrick Terms Minimize
This glossary of Kirkpatrick terms is intended to help you better understand the Kirkpatrick Model and, more generally, the field of training evaluation. These terms are covered in detail in the Kirkpatrick Four Levels® Evaluation Certification Program - Bronze Level.
 

AWACS (airborne warning and control system)
: A U.S. Air Force aircraft that monitors battlefield conditions and activity; parallels the Kirkpatrick approach to continually monitoring and reporting on Level 3 activity

Blended Evaluation Plan®: A methodology in which data are collected from multiple sources using multiple methods, in a blended fashion that considers all four Kirkpatrick levels, for the purpose of monitoring, reporting and adjusting findings to maximize program participant performance and subsequent organizational results

Borrowed metrics: Relevant Level 4 success outcomes that training professionals obtain from business or human resource departments in order to complete a
chain of evidence

BrightLight: Someone who is doing the right things -- following the New World Kirkpatrick Model, creating organizational results and helping others to accomplish similar results by sharing their stories and experiences

Business partnership: Cooperative effort between the training department and other business and support units in the company

Chain of evidence: Data, information and testimonies at each of the four levels that, when presented in sequence, demonstrate the value obtained from a business partnership initiative

Consumptive metrics: Participant attendance, Level 1 and Level 2 data that attempt to show training value, but instead highlight the costs of training to the business

Corporate jury: The individual or group of business partners who ultimately judge the degree to which training efforts add value to the business in relation to their costs. This group subsequently controls or influences training department budgets, staffing and future

Critical behaviors: The few, key behaviors that employees will have to consistently perform on the job in order to bring about targeted outcomes

Dashboard: A graphic depiction of key metrics in a business partnership initiative that monitors and communicates progress towards business outcomes; typically color-coded in green, yellow and red

Drivers / required drivers: Processes and systems that reinforce, monitor, encourage or reward performance of critical behaviors on the job

Formative evaluation: The collection of data and information during a learning event or phase

"The great divide": The significant gap that exists between
Level 2 Learning and Level 3 Behavior, both in research correlation studies and actual practice

Impact metrics:
Levels 3 and 4 metrics, which constitute the most relevant measurements of training effectiveness to key business stakeholders

"In order to what?": An important question asked during preliminary conversations defining the goals of a training initiative that helps move from training-centric to true business outcomes

Key business stakeholder: A member of the jury that has a stake in the success outcomes of a training initiative and ultimately judges the value of training relative to its costs

Kirkpatrick Model
The Kirkpatrick Model is the worldwide standard for evaluating the effectiveness of training. It considers the value of any type of training, formal or informal, across four levels. Level 1 Reaction evaluates how participants respond to the training. Level 2 Learning measures if they actually learned the material. Level 3 Behavior considers if they are using what they learned on the job, and Level 4 Results evaluates if the training positively impacted the organization. 

Created by Dr. Don Kirkpatrick in the 1950s, the model is applied before, during and after training to both maximize and demonstrate training's value to the organization. 

Leading indicators: Short-term observations and measurements suggesting that critical behaviors are on track to create a positive impact on desired results

Level 1: Reaction: The degree to which participants find the training favorable, engaging and relevant to their jobs

Level 2: Learning: The degree to which participants acquire the intended knowledge, skills, attitude, confidence and commitment based on their participation in the training

Level 3: Behavior: The degree to which participants apply what they learned during training when they are back on the job

Level 4: Results: The degree to which targeted outcomes occur as a result of the training and the support and accountability package

"The missing link": Another name for Level 3 because execution at this level is critical for maximizing Level 4: Results, yet neither training nor the business tends to take ownership of it

Necessities for success: Prerequisite items, events, conditions or communications that help leverage success or head off problems before they reduce the impact of an initiative

"Needles": The Level 4 metrics a training initiative is designed to move that will effectively demonstrate training value to key business stakeholders; this refers to a needle on a dashboard indicating the current level of a critical measurement

Return on expectations (ROE): What a successful training initiative delivers to key business stakeholders demonstrating the degree to which their expectations have been satisfied (see
ROE's Rising Star: Why Return on Expectations Is Getting So Much Attention)

Success factors: Items that each contribute to on-the-job application, performance and ultimate results, including required drivers, the training program, personal responsibility and necessities for success

Summative evaluation: The collection of data and information after a learning event or phase

Support and accountability: The two forces that must be balanced after training in order to drive critical behaviors (see
Transferring Learning to Behavior)

"What will success look like?": The cornerstone question that helps convert generic stakeholder expectations into observable, measurable success outcomes, which subsequently become the Level 4 targets of return on expectations
Join the Kirkpatrick Community

Register with us for FREE samples of our Blended Evaluation Plan® form.

(If you have already registered with us, simply log in and visit the Resources tab to access the samples - no need to re-register.)
 


You'll also receive immediate access to our Resource Library, and weekly updates from Kirkpatrick Partners.



Click here for more information about the materials available in our Resource Library and to see a sample of our weekly newsletter.
Check Out Our New Book Minimize

Discover a complete blueprint for implementing the model in a way that truly maximizes business results. And delve into Jim and Wendy's new findings that, together with
Don Kirkpatrick's work, create the New World Kirkpatrick Model, a powerful methodology that melds people with metrics
Deadlines to Note Minimize
Early Bird Savings & Registration Deadlines

Kirkpatrick program deadlines and specials

Bronze Certification

November 2, 9, 16, 30 and December 7
Online (from the U.S.)

November 7-8
Omaha, NE

Early bird registration ends Oct. 27

November 14-15
Washington, D.C.

Just 7 seats left! See silver program that follows, Nov. 16 

Silver Certification
 
November 9
Omaha, NE
Early bird registration ends Oct. 27
 
November 16
Washington, D.C.
 
 
Latest News

"ACE" Kirkpatrick Certifications
October 16, 2017

As part of the new "Accelerated Certification Event" (ACE), Kirkpatrick bronze and silver level certification programs may now be taken consecutively. Certain conditions apply. Read more here.

New Bronze & Silver Programs in the U.S. Midwest
October 9, 2017

Save $300 with Early Bird Registration for two new programs in early November in Omaha, Nebraska. Click here for information on the bronze certification program. A silver program will be held immediately following bronze. Click here to register for silver. For complete details on these programs, click here to read more.

 

Have You Read Kirkpatrick's Four Levels of Training Evaluation Yet?

October 3, 2016

What a success our book, Kirkpatrick's Four Levels of Training Evaluation, has been! It's consistently ranked in the top 25 of the Training books section on Amazon. Discover a complete blueprint for implementing the model in a way that truly maximizes business results. And delve into Jim and Wendy's new findings that, together with Don Kirkpatrick's work, create the New World Kirkpatrick Model, a powerful methodology that melds people with metrics.

Use the New World Model to better train people, improve the way you work, and, ultimately, contribute to your organization's most crucial goals without breaking the budget.  Click here to learn more.

 
Copyright 2009 - 2017 Kirkpatrick Partners, LLC. All rights reserved.