Beyond being an evaluator: The multiplicity of roles of the internal evaluator

Volkov, Boris B.

doi:10.1002/ev.394

Cited by 27 publications

(17 citation statements)

References 63 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…The choice of conducting internal evaluation was based on the formative purpose of the evaluation by creating "organisational learning" within the ABCs partnership. According to Volkov, this requires informed evaluators with a thorough knowledge of organisational functioning and dynamics [42], which may also lead to more accurate and context sensitive interpretations [41].…”

Section: Methodsological Considerationsmentioning

confidence: 99%

Implementing Mental Health Promotion Initiatives—Process Evaluation of the ABCs of Mental Health in Denmark

Hinrichsen

Koushede

Madsen

et al. 2020

IJERPH

View full text Add to dashboard Cite

Treatment and prevention alone are unlikely to make a significant difference in reducing the burden of poor mental health and mental illness. Therefore, mental health promotion (MHP) initiatives are advocated. In 2014, the ABCs of mental health (ABCs) partnership was established in Denmark; in the partnership, partner organisations, e.g., municipalities and NGOs, use a research-based framework for MHP, the ABC-framework, to develop and implement MHP initiatives. This paper has two aims: (1) to outline the overall characteristics of these MHP initiatives; and (2) to explore local coordinator and stakeholder perceptions of the implementation processes and the impact of the MHP initiatives. Questionnaire surveys, individual interviews and group interviews were conducted during 2017–2020. The MHP initiatives were grouped according to three strategies: building MHP capacity, campaign activities to promote mental health awareness and knowledge and establishing and promoting opportunities to engage in mentally healthy activities. The ABC-framework was positively received and viewed as providing relevant knowledge for working with MHP as well as fostering intersectoral and interprofessional collaborations. However, using a bottom-up approach to develop and implement MHP initiatives can be time-consuming and resource demanding, and it requires a deliberate balancing of local adaptability and concrete guidance when engaging stakeholders and implementers. Overall, using the ABC-framework to develop and implement MHP initiatives holds great promise for advancing and promoting MHP practice.

show abstract

Section: Methodsological Considerationsmentioning

confidence: 99%

Implementing Mental Health Promotion Initiatives—Process Evaluation of the ABCs of Mental Health in Denmark

Hinrichsen

Koushede

Madsen

et al. 2020

IJERPH

View full text Add to dashboard Cite

show abstract

“…Moreover, the figure of the knowledge broker does not exist, and the notion of knowledge management and transfer has not been formally introduced [ 37 ]. In addition, in the field of public policy evaluation, researchers have questioned for decades the role of the evaluation [ 38 ], its institutional implementation, and other challenges related to evaluation typologies (internal or external) [ 39 ]. Because of its evaluative nature, HIA is confronted by the same questions: who should conduct HIAs?…”

Section: Discussionmentioning

confidence: 99%

A Comparative Analysis of Health Impact Assessment Implementation Models in the Regions of Montérégie (Québec, Canada) and Nouvelle-Aquitaine (France)

Jabot

Tremblay

Rivadeneyra

et al. 2020

IJERPH

View full text Add to dashboard Cite

Many countries have introduced health impact assessment (HIA) at the national, regional, or local levels. In France and in Québec, there is increasing interest in using HIA to inform decision-makers and influence policies, programs, and projects. This paper aims to compare HIA implementation models in two regions: Nouvelle-Aquitaine (France) and Montérégie (Québec, Canada) using a case study methodology. The objective is to gain a better understanding of the similarities and differences in the approaches used to achieve the operationalization of HIA. The methodological approach involves four steps: (1) design of an analytical framework based on the literature; (2) exchanges within the research team and review of documents concerning the two implementation strategies under study; (3) development of the case studies based on the proposed framework; and (4) cross-comparison analysis of the case studies. The findings show that the two regions share certain similarities, including the strong commitment and political will of the public health organizations involved and a well-established culture of engaging in intersectoral action with municipal partners. Differences mainly concern their different approaches to implementing HIAs in accordance with the regional policies and the organizational and administrative contexts in place. This study identifies potential avenues for supporting the practice of HIA at the municipal level.

show abstract

“…The internal evaluator is responsible for balanc ing these roles and navigating an appropriate path relevant to context: knowing when to step up, step in, and step back (Rogers, Bower, Malla, Manhire, & Rhodes, 2017). Volkov and Baron (2011 ) highlight the importance of flexibility to enable internal evaluators to adapt to the demands of a changing society by promoting self-reflection and learning at the organizational level. They suggest that the "role of the internal evaluator will progressively change and expand, and promoting evaluative thinking throughout the entire organization will constitute one of the highly challenging and gratifying roles for the internal evaluators" (p. 106).…”

Section: Evaluation Use and Internal Evaluationmentioning

confidence: 99%

Evaluation Literacy: Perspectives of Internal Evaluators in Non-Government Organizations

Rogers

Kelly

McCoy³

2019

Canadian Journal of Program Evaluation

View full text Add to dashboard Cite

While there is an abundance of literature on evaluation use, there has been little discussion regarding internal evaluators’ role in promoting evaluation use. Evaluation can be undervalued if context is not taken into consideration. Evaluation literacy is needed to make evaluation more appropriate, understandable, and accessible, particularly in non-government organizations (NGOs) where there is a growing focus on demonstrable outcomes. Evaluation literacy refers to an individual’s understanding and knowledge of evaluation and is an essential component of embedding evaluation into organizational culture. In recognition of the value of the internal perspective, a small exploratory exercise was undertaken to reveal internal evaluator roles and ways of engaging with colleagues around evaluation. Th e exercise examined a key question: What is the role of evaluation literacy in internal evaluation in the non-government sector? Three Australian auto-narrative examples from internal evaluators highlight evaluation literacy and locate it among the multiplicity of roles required for optimal evaluation uptake. Analysis of the narratives revealed the underlying issues affecting evaluation use in NGOs and the skills needed to motivate and enable others to access, understand, and use evaluation information. Responding to the call for expanded research into internal evaluation from a practice perspective, the authors hope that the findings will stimulate a wider conversation and further advance understanding of evaluation literacy.

show abstract

Beyond being an evaluator: The multiplicity of roles of the internal evaluator

Abstract: The chapter explores critical roles of internal evaluators in contemporary orga

Cited by 27 publications

References 63 publications

Implementing Mental Health Promotion Initiatives—Process Evaluation of the ABCs of Mental Health in Denmark

Implementing Mental Health Promotion Initiatives—Process Evaluation of the ABCs of Mental Health in Denmark

A Comparative Analysis of Health Impact Assessment Implementation Models in the Regions of Montérégie (Québec, Canada) and Nouvelle-Aquitaine (France)

Evaluation Literacy: Perspectives of Internal Evaluators in Non-Government Organizations

Contact Info

Product

Resources

About