Training is an essential part of your organisation’s compliance programme. But how effective are your training courses? Have you been tracking the impact?
Given your people are your biggest risk for non-compliance, it’s important to regularly review and evaluate the effectiveness of your compliance training.
This sounds like a great idea in theory, but where do you start?
Fortunately, Donald Kirkpatrick designed a model in the 1950s, known as the Kirkpatrick model, that helps training course creators evaluate whether or not their courses are effective.
The Kirkpatrick model
Kirkpatrick’s Four-Level Training Evaluation Model consists of four levels of evaluation:
- Reaction: what did learners think and feel about the training?
- Learning: did learner knowledge increase as a result of the training?
- Behaviour: did learner behaviour and capabilities improve and have they implemented/applied what they’ve learnt?
- Results: what effect has the training had on the business or working environment?
This model has stood the test of time and can still be applied to all areas of e-learning today. It helps you to evaluate the success of compliance training - from whether learners understand the material, to what extent compliance policies are followed in the workplace, as well as the impact it has had on the success of the business.
We walk through the four steps of the Kirkpatrick model and how it can be applied to compliance e-learning.
Level 1. How did learners react to the training?
Kirkpatrick argued that learner satisfaction was a crucial element of course design. This seems obvious today but was by no means obvious at the time. People learn best when they are interested and engaged in what they are learning. The more interested they are, the more motivated they become to find out more, helping them to get the most out of training. If learners aren’t satisfied, Kirkpatrick argued, then knowledge retention would be limited and the efficacy of training would be reduced.
Just like you would with a new website or product, asking for user feedback is an essential part of the evaluation process when developing a compliance training course.
You could ask for staff to fill out a quick questionnaire ("happy sheet") to assess their overall level of satisfaction. But for more useful feedback, it helps to make your questions more direct and specific. Did they find the information presented in the course relevant? Are there any work situations where they will use the new skills they have learnt? Did they enjoy the way in which the material was presented?
These questions need to be relevant and specific to the course. For example, following a health and safety compliance course, you might want to ask a question like, “In what ways has the course helped you identify new hazards in the workplace?” It’s also worth asking participants whether there were any technical problems with the delivery of the course and whether they were able to access all the relevant online materials. Accessibility matters.
Level 2. What is the level of knowledge acquired?
The second important factor that the Kirkpatrick model considers is the level of knowledge and skill acquisition achieved on the course. In other words, what percentage of the material that your participants were supposed to learn did they actually learn?
So, how do you find this out?
If you’re using an LMS to conduct your compliance training, you could use a course with a game or quiz at the end of each section. This allows learners to directly engage with the course as well as providing statistics about how well they have retained the information. Quizzes and games also help to make the training more interactive and engaging for people.
You may decide to offer refresher training too, which can also be generated through your LMS as a recurring training course. Or it could even be issued in the form of an app. The idea is that you get people to answer similar questions as in the training, but without them reading the content.
Level 3. Are the appropriate behaviours being implemented?
Imparting knowledge is part of the picture, but what you really want to understand is how much of their knowledge staff can apply to real-world situations back at their desk. Sometimes, measuring the impact of training is relatively straightforward. For instance, you may see health and safety incidents reduced.
Often, though, it can be hard to measure effectiveness. How do you measure that people are following anti-bribery practices? Is it a case of 'no news is good news', and that if we aren’t aware that bribery is being committed then it must not be? What you can do, however, is carry out regular reviews to check that people would take the right action when presented with a given scenario.
Level 4. What effect has training had on the business?
Kirkpatrick’s final method of evaluation looks at how training has impacted the business or the work environment. To do this, we need to set clear objectives before the training takes place.
Maybe there is a recurring health and safety issue and you want to see the numbers reduced. What impact does this have on your ability to deliver for customers? What impact might it have on employee satisfaction and retention? All these things - and more - could be measured to see if the training is having the desired business outcomes.
The Kirkpatrick model wasn’t designed to just be another process in developing effective training programmes. Instead, it was meant to be to a call-to-action, highlighting things about learning courses that need to be improved.
If you want your staff to adhere to your organisation’s compliance processes and policies, you need to make sure you are delivering effective training that will positively impact your compliance goals.
This relies on actively seeking feedback from those completing the training, testing their level of knowledge to ensure the information has been accurately received, measuring actual performance to ensure the right behaviours have been acquired and then assessing the impact of these new behaviours against compliance goals.