A Catalyst-for-Change Approach to Evaluation Capacity Building

Iriarte, Edurne García; Suárez-Balcázar, Yolanda; Taylor-Ritzler, Tina; Luna, Maria Paz G.

doi:10.1177/1098214010387114

Cited by 36 publications

(40 citation statements)

References 27 publications

(64 reference statements)

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…RC has been studied in multiple industries and contexts, with the earliest work documented in The Southwest Airlines Way , which described how role‐based relationships drive quality and efficiency and rely on organizational structures to support them (Gittell, ). RC has also been widely studied in the healthcare context with the same results as well across organizations (Gittell & Weiss, ; García‐Iriarte et al., ). Most recently, a quasi‐experimental study in four mid‐sized Massachusetts cities showed significant improvements in RC across organizations as part of a comprehensive youth and gang violence initiative (Gebo & Bond, ).…”

Section: Evidence‐based Framework and Tools Informing This Chaptermentioning

confidence: 96%

Readiness and Relationships Are Crucial for Coalitions and Collaboratives: Concepts and Evaluation Tools

Hajjar

Cook²,

Domlyn³

et al. 2020

New Drctns Evaluation

View full text Add to dashboard Cite

Collaboration is identified as an essential component for the successful implementation of a wide range of policies and programs. A major collaboration challenge, particularly in large community initiatives, is the need for multiple organizations to develop strategic partnerships around a shared purpose. Due to the importance of collaboration in achieving desired outcomes, the readiness of organizations to collaborate, and the quality of relationships between organizations are key, particularly in the formation stage. This is especially true of community coalitions, where collaboration requires comprehensive planning, shared decision‐making among stakeholders, and a high level of productivity and quality of relationships based on trust and mutual respect. In this chapter, we present two evidence‐based frameworks and evaluation tools that can be used to assess and build readiness and high‐quality relationships in efforts to improve community outcomes. This is illustrated in a case example of a new community coalition focused on increasing youth safety and improving police‐community relationships in a high crime neighborhood. Implications and lessons learned are discussed.

show abstract

Section: Evidence‐based Framework and Tools Informing This Chaptermentioning

confidence: 96%

Readiness and Relationships Are Crucial for Coalitions and Collaboratives: Concepts and Evaluation Tools

Hajjar

Cook²,

Domlyn³

et al. 2020

New Drctns Evaluation

View full text Add to dashboard Cite

show abstract

“…The results from the Department Climate dimension on the AOS indicate success in this area with room for improvement. This bodes well for the assessment office's plan for ongoing cultivation of key faculty who rotate the lead position so that LOA is eventually diffused throughout the programs (Garcia‐Iriarte et al., ), and as lead faculty coordinators exit that role, others will be willing to take their place. A conducive assessment environment is needed for permeation to be successful.…”

Section: Discussionmentioning

confidence: 99%

Assessment Capacity Building at a Research University

Stitt-Bergh

2016

New Drctns Evaluation

View full text Add to dashboard Cite

Higher education institutions use program‐level learning outcomes assessment to improve programs, enhance student learning, and meet external requirements. An assessment office at a research university used a variety of evaluation capacity‐building (ECB) activities to increase faculty and administrators’ engagement in assessment and use of findings for program improvement. To investigate six desired ECB outcomes, the author analyzed survey responses and program assessment reports (2008–2014). The findings showed success in four ECB outcomes: positive attitudes toward assessment, motivation to engage, knowledge and skills, and department climate. However, two outcomes fell below expectations: department resources and use of findings. A correlation study revealed several significant, positive relationships between outcomes and faculty engagement with the strongest relationship being between level of faculty assessment experience and knowledge and skills. Because use of findings for program improvement and better student learning are primary assessment purposes, these results are valuable for campus planning of future capacity‐building activities. New ECB efforts that focus on faculty capacity to discuss assessment with colleagues, department resources, and most important, ways to use assessment findings are planned.

show abstract

“…During the last decade, evaluators have increasingly used ECB practices to assist nonprofit organizations in developing evaluation capacity (Baizerman, Carman & Fredericks, 2008;Compton, GloverKudon, Smith, & Avery, 2002;Garcia-Iriarte, Suarez-Balcazar & Taylor-Ritzler, 2011;Huffman et al, 2008;King, 2002;Labin et al, 2012;Milstein et al, 2002;Stevenson et al, 2002;Stockdill et al, 2002). ECB practices generally involve an evaluator providing training, technical assistance, consultation, and other activities to one or more staff within an organization or system (Duffy et al, 2007;Garcia-Iriarte et al, 2011).…”

Section: Understanding Evaluation Capacity Buildingmentioning

confidence: 99%

Understanding and Measuring Evaluation Capacity

Taylor-Ritzler

Suárez-Balcázar

Iriarte

et al. 2013

American Journal of Evaluation

Self Cite

View full text Add to dashboard Cite

This study describes the development and validation of the Evaluation Capacity Assessment Instrument (ECAI), a measure designed to assess evaluation capacity among staff of nonprofit organizations that is based on a synthesis model of evaluation capacity. One hundred and sixty-nine staff of nonprofit organizations completed the ECAI. The 68-item measure assessed participants’ perceptions of individual and organizational predictors of two evaluation capacity outcomes: mainstreaming and use of evaluation findings. Confirmatory Factor Analysis and internal consistency results support the inclusion of the items and factors measured by the ECAI. Moreover, structural equation modeling results support the synthesis model and its depiction of relationships among evaluation capacity predictors and outcomes. We discuss the implications of using a validated model and instrument in evaluation capacity building research and practice.

show abstract

A Catalyst-for-Change Approach to Evaluation Capacity Building

Cited by 36 publications

References 27 publications

Readiness and Relationships Are Crucial for Coalitions and Collaboratives: Concepts and Evaluation Tools

Readiness and Relationships Are Crucial for Coalitions and Collaboratives: Concepts and Evaluation Tools

Assessment Capacity Building at a Research University

Understanding and Measuring Evaluation Capacity

Contact Info

Product

Resources

About