Metaevaluations are systematic reviews of evaluations to determine the quality of their processes and findings. The knowledge about evaluation quality that results from metaevaluation of multiple evaluations can be used to inform researchers' decisions about which studies to include in evaluation syntheses. Metaevaluations of multiple studies are also used to identify strengths and weaknesses in evaluation practice in order to develop evaluation capacity. This article discusses the multiple ways in which quality can be defined, the political and cultural contexts of metaevaluation, and issues surrounding use and misuse. A metaevaluation of evaluations of international agricultural research centers illustrates these topics.
Attention to evaluation quality is commonplace, even if sometimes implicit. Drawing on her 2010 Presidential Address to the American Evaluation Association, Leslie Cooksy suggests that evaluation quality depends, at least in part, on the intersection of three factors: (a) evaluator competency, (b) aspects of the evaluation environment or context, and (c) the level and nature of supportive resources that are available in the evaluation community. In a brief reaction to her views, Mel Mark discusses selected implications of Cooksy's approach and comments on the notion of evaluation quality itself.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.