Guiding evaluation of trainings in the field of energy transition

The endeavor of transitioning to nearly-zero emission buildings presupposes upskilling the existing workforce in the construction and energy industry to meet new standards. For many professionals in this sector, this is accomplished via micro-trainings, aimed at updating their competences. However, evaluating the effectiveness and impact of training activities is often performed intuitively, by unexperienced evaluators. The purpose of this study is to design guiding tools for evaluating training programs that can be adopted and implemented in a diversity of training programs in the construction and energy industries. The development of this program yields the following research question: How to guide the evaluation of effectiveness of upskilling micro-trainings in energy efficiency with limited (human, financial, material) resources and expertise? This question will be answered by determining what type and to what extent organizations in the aforementioned fields need support in implementing evaluations, as well as the influencing constraints, hindrances, and opportunities in the process. A conceptual model proposed by the University of Twente, based on Kirkpatrick’s four levels of training evaluations, was further developed to encompass both objective and subjective measurements, implement the measurement of Learning Goals and provide guidance for designing and implementing evaluation programs. Pilot tests were conducted to inform design and test the feasibility and efficacy of the proposed model. As a result, three elements were designed to support the application of the model: an Evaluation Guide, a tool for determining clearly defined learning goals, and a standardized question pack containing validated survey instruments.