Evaluation Literacy: Perspectives of Internal Evaluators in Non-Government Organizations

Abstract

While there is an abundance of literature on evaluation use, there has been little discussion regarding internal evaluators’ role in promoting evaluation use. Evaluation can be undervalued if context is not taken into consideration. Evalua­tion literacy is needed to make evaluation more appropriate, understandable, and accessible, particularly in non-government organizations (NGOs) where there is a growing focus on demonstrable outcomes. Evaluation literacy refers to an individ­ual’s understanding and knowledge of evaluation and is an essential component of embedding evaluation into organizational culture. In recognition of the value of the internal perspective, a small exploratory exercise was undertaken to reveal internal evaluator roles and ways of engaging with colleagues around evaluation. Th e exercise examined a key question: What is the role of evaluation literacy in internal evalua­tion in the non-government sector? Three Australian auto-narrative examples from internal evaluators highlight evaluation literacy and locate it among the multiplicity of roles required for optimal evaluation uptake. Analysis of the narratives revealed the underlying issues affecting evaluation use in NGOs and the skills needed to motivate and enable others to access, understand, and use evaluation information. Responding to the call for expanded research into internal evaluation from a practice perspective, the authors hope that the findings will stimulate a wider conversation and further advance understanding of evaluation literacy.

Conducting and utilizing evaluation for multiple accountabilities: A study of nonprofit evaluation capacities

“…While this may seem counterintuitive, the evaluation literacy literature suggests the ability to use and apply evaluation findings is separate from the ability to do an evaluation (Bourgeois et al, 2015; Rogers et al, 2019). In other words, “capacity to use does not first require capacity to do” (Bourgeois et al, 2015, p.47).…”

“…To that end, this article examines the relationship of four evaluation capacities to upward, lateral, and downward accountabilities. Per the evaluation literature, we frame evaluation capacities in terms of those needed to do an evaluation, including technical resources and staff competency, versus capacities for utilizing evaluation results as a decision‐making tool, including learning climate and strategic planning (Bourgeois, Whynot, & Thériault, 2015; Gagnon et al, 2018; Rogers, Kelly, & McCoy, 2019). We examine these relationships through a Partial Least Squares Structural Equation Model using survey responses from 243 nonprofit executive directors or evaluation staff.…”

Performance measurement, evaluation and accountability in public philanthropic foundations

“…This article focuses on evaluations that are internal to philanthropic foundations. As such, this research contributes to calls to extend understanding of internal evaluation perspectives (Rogers et al, 2019) and is presented within this unique Australian context.…”

Baselines and monitoring: More than a means to measure the end

“…There is common rhetoric surrounding the need for evaluation to be embedded (McCoy et al, 2014; Patton, 2011; Rogers et al, 2019). However, embedding interval-based evaluation in practice is extremely difficult.…”