Measurement and evaluation are at the core of reliably improving performance. It is through these central mechanisms that performance improvement professionals are able to demonstrate the true worth of their efforts. However, the true value of the contributions they make is inconclusive. This article presents a content analysis of 10 years' worth of Performance Improvement and Performance Improvement Quarterly articles as an initial data point to be used for professional reflection and further exploration into the intentions and practices of performance improvement practitioners.
This study examines what sources of evidence are used in intervention selection and what changes in belief occur when performance improvement professionals make these decisions. Sixty‐one certified performance technologists completed a dynamic, web‐delivered questionnaire in which they provided a general assessment of intervention success (Pr1), then responded to 12 performance improvement scenarios by selecting an intervention, providing a prior probability, receiving additional evidence, giving a posterior probability (Pr3), indicating whether the initial intervention was still preferred, and making a subsequent choice if not. Findings bolster the long‐standing concern about the technical nature of performance improvement, and practitioners are strongly encouraged to approach intervention selection as a decision, where their intervention preferences and beliefs of likely success are carefully adjudicated on the basis of the evidence they obtain. Future research with other types of performance improvement practitioners, replication studies, longitudinal, structural equation modeling, externally verifiable probabilities, and natural environments are recommended.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.