Literature review on assessment models of the quality of training devices

Abstract

Assessing the quality of training devices is an ongoing and relevant research topic. It's now more than ever an obvious necessity. However, the literature review on the issue remains disparate and fragmented according to themes and across countries. Our research had a threefold purpose: 1) to propose a review of the literature on assessment models of the quality of training devices; 2) identify assessment models that are most often used; 3) to determine their key issues, strengths and limitations. Our methodological approach was based on two types of data: (1) a set of empirical documents published over the last thirty years (guides and reports); and (2) an analysis of recent studies produced by specialized research centers. Thus, we conducted three successive steps: 1) selection of documents on the basis of criteria such as relevance and consistency; 2) extensive analysis of assessment models, using a validated analysis matrix that consists of four criteria: goals, issues, strengths and limitations; 3) categorization of these models by transversal thematic analysis. At least 21 models have been generated. All have more or less different characteristics. These models have been listed in a thematic classification into four distinct categories. Beyond this classification, we retain two main conclusions. First, no model of them is exhaustive. Each model covers one or at most three dimensions of quality of training device, and thus has limits. Secondly, the quality is complex and plural. Therefore, two approaches are recommended: conceptual (systemic) and methodological (total triangulation). The first allows a combination of several assessment models to cover up dimensions of a training device. The second allows multiple crossing between several actors (assessors), collection instruments and data analysis tools to better describe the quality of training.