A Decade of Research on Evaluation

Abstract

Although investigations into evaluation theories, methods, and practices have been occurring since the late 1970s, research on evaluation (RoE) has seemingly increased in the past decade. In this review, 257 studies published in 14 evaluation-focused journals over a 10-year period (between 2005 and 2014) were identified as RoE and then classified according to Henry and Mark's and Mark's taxonomies of RoE. The majority of RoE published in evaluation-focused journals consists of descriptive studies and, to a lesser extent, comparative studies of evaluation practices. Few investigations, however, address questions pertaining to values or valuing in evaluation, ethics, or evaluation consequences. Gaps in and an agenda for future RoE are discussed.

Material Incentives and Other Potential Factors Associated With Response Rates to Internet Surveys of American Evaluation Association Members: Findings From a Randomized Experiment

“…In many ways, evaluation and the professional practice of evaluation is an "evidence-seeking" endeavor, and inquiry into its theories, methods, and practices should reflect this very same attribute. Much of what is known about evaluation practice has been derived from surveys of AEA members (Coryn et al, 2017;M. Galport & Galport, 2015).…”

“…Research on Evaluation (RoE) and American Evaluation Association (AEA) Members RoE has increased considerably since Henry and Mark (2003) put forth an agenda for RoE and has more than tripled in the last decade (Coryn et al, 2017). Findings reported in many of these investigations have been derived from self-report surveys of AEA members.…”

What Do U.K. Orthopedic Surgery Patients Think About PROMs? Evaluating the Evaluation and Explaining Missing Data

“…As a longer term aim is to build on this research with staff interviews and multiple-site evaluations, so as to develop a program theory of PROMs delivery that explains the barriers, moderators, and mediators, from which a theory-driven evaluation can be conducted (Coryn et al, 2011), refined themes were developed in ways that could inform theory building. This involved identifying breakdowns and side effects (i.e., poor implementation), unsuitable context, and unanticipated/unintended consequences (Coryn et al, 2017). As the refined themes represent a second tier of analysis, they are integrated and addressed in the “Discussion” section.…”

“…Therefore, the primary objective of this study was to evaluate the PROMs evaluation of hip and knee surgery patients in the NHS, by interviewing and observing those who complete PROMs preoperatively. To do this, we used participatory evaluation, and a stakeholder-oriented approach (Coryn et al, 2017). The prime purpose was to elucidate patient perspectives on individual, organizational, structural, and procedural factors that could shed light on noncompletion and missing data.…”

Evaluators’ Perspectives on Research on Evaluation

“…Given its important function and the increase in RoE activity, it is prudent to develop empirical knowledge about RoE. However, with some exceptions such as a review of the American Journal of Evaluation (AJE) to identify RoE articles (Vallin, Philippoff, Pierce, & Brandon, Chapter 1 of this issue), a similar review by Coryn et al (), a survey of the effects of published RoE on evaluators' thinking (Coryn et al, ), and a report of the results of an RoE needs assessment survey (Szanyi, Azzam, & Galen, 2013), few studies about RoE have been conducted. More could be known, for example, about evaluators’ knowledge of RoE, their attitudes toward it and beliefs about it, and how much they apply its results in their practice or teaching.…”