Purpose of an Evaluation
The purpose of an SMS evaluation is to determine the effectiveness of the SMS. To do that we can focus on four evaluation strategies:
- Evaluate the design: Examination of the written plans, policies, procedures, and other documents to determine if they contain the necessary information. For instance, during the SMS evaluation, an evaluator would examine the written hazard communications program to make sure it contained the required information.
- Evaluate the processes: Another primary consideration in an evaluation is to assess the quality of SMS activities. For example, an evaluator might observe trainers using the program and write a descriptive account of how employees respond and then provide feedback to instructors.
- Evaluate the results: It's important for an evaluation to study the immediate or direct results of the SMS and its programs on employees. For example, the evaluator may conduct a walk-around inspection to determine the safety status of tools, equipment, and materials in the workplace.
- Evaluate the impact: An effective evaluation looks beyond the immediate conditions and behaviors representing the results of policies, instruction, or services. It also identifies longer-term as well as unintended program effects. It may also examine what happens when several programs operate in unison. For example, an impact evaluation might examine whether a safety program's immediate positive effects on behavior were sustained over time.
Regardless of the primary focus of the evaluation, they all use data collected in a systematic manner. These data may be:
- quantitative, such as counts of safe/unsafe behaviors, or
- qualitative, such as descriptions of the effectiveness of an incentive and recognition program.
Successful evaluations often blend quantitative and qualitative data collection. The choice of which to use should be made with an understanding that there is usually more than one way to answer any given question.
Knowledge Check Choose the best answer for the question.
4-2. Which evaluation strategy focuses on the quality of safety management system (SMS) activities?
You forgot to answer the question!