The Missing Linkage In Evaluating Networks: A Model for Matching Evaluation Approaches to System Dynamics and Complexity

Ofek, Yuval

doi:10.1080/15309576.2015.1031005

Cited by 4 publications

(3 citation statements)

References 43 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Focus groups and interviews conducted with the survey respondents in the present study revealed that while some were familiar with program-oriented ToCs, none was ever subject to an evaluation conducted using an actor-oriented ToC. To give this finding broader context, during the course of a different study conducted in 2012–14 (on the application of joint evaluations; see Ofek, 2015), I interviewed 53 evaluation managers and evaluators from leading European evaluation firms 6 and from the evaluation units of the development aid agencies for several European nations. All interviewees were professional evaluators supposedly highly versed in ToC approaches; yet only two of the 53 interviewees were familiar with actor-oriented ToCs.…”

Section: Discussionmentioning

confidence: 80%

“…In the spirit of the classic ‘interdependency school’ of network theory (see Sørensen and Torfing, 2007), the new ToCs turned the spotlight on the human element in complex systems, and on the notion that actors are individuals with different and often competing agendas and interests, different perspectives on the same issues, and different sets of interactions and associations (Hedström et al, 2010; Klijn and Skelcher, 2007; Koppenjan and Klijn, 2004). Because of the centrality of actors in these ToCs, Ofek (2015) named them actor-oriented theories of change .…”

Section: Review Of Relevant Literaturementioning

confidence: 99%

See 1 more Smart Citation

An examination of evaluation users’ preferences for program- and actor-oriented theories of change

Ofek

2017

Evaluation

Self Cite

View full text Add to dashboard Cite

As programs and policies have grown in complexity, theory of change evaluation approaches and methods have become increasingly popular. While the academic literature often adheres to program-oriented theories of change, it is gradually being exposed to actor-oriented theories of change, which aim to enhance the flexibility of evaluations in order to adapt to growing complexity. Aside from the methodological considerations of when to use which approach, it is generally accepted that to increase their influence, evaluation approaches and methods should be suited both to the evaluated program and the preferences of intended users. But do we really know what approaches intended users prefer? Using a simulation-based survey and interviews with 148 public-sector employees in Israel, this article aims to provide an initial answer to this question. The results suggest that there is room to reconsider current perceptions of what intended users think. The findings have implications for the types of theories of change evaluators can suggest to intended users, with the ultimate goal of increasing the influence of evaluations.

show abstract

Section: Discussionmentioning

confidence: 80%

Section: Review Of Relevant Literaturementioning

confidence: 99%

An examination of evaluation users’ preferences for program- and actor-oriented theories of change

Ofek

2017

Evaluation

Self Cite

View full text Add to dashboard Cite

show abstract

“…Availability and access to data is a major problem when it comes to the measurement of effectiveness in PPP projects (Chen, Daito, & Gifford, 2016). Different methods used to measure effectiveness are tabulated as under: Based on the variety of factors/ measurement methods as in Table: 9 these diverse measures/factors are categorized in the following 6 different categories: (Hayllar, 2010;Ofek, 2015;Higgins & Huque, 2015;Buse & Harmer, 2007;Hodge & Coghill, 2007;Panayides et al, 2015;Becker, 2012;Willem & Lucidarme, 2014;MacDonald, 2012;Wong et al, 2015;Buse & Harmer, 2007;Alasad & Motawa, 2016;Abramov, 2009a;Aaronson, 2011;Loosemore & Cheung, 2015) Sr No. (Nisar, 2013;Mishra et al, 2013;Andon, 2012;Hadzic et al, 2015;Zhang, 2014;Xu et al, 2012;Samii, Van Wassenhove, & Bhattacharya, 2002).…”

Section: Methods Used To Measure the Effectivenessmentioning

confidence: 99%

Effectiveness of Public Private Partnerships: A Systematic Literature Review

Ali

Irfan

Salman

2020

JMR

View full text Add to dashboard Cite

Questions about the ‘effectiveness’ of Public-Private Partnerships (PPPs) have been raised for quite some time now. Although implementation and performance problems are given some attention while carrying out systematic literature review regarding PPPs, there is no systematic literature review available to the best of our knowledge that analyses/reviews the ways in which the effectiveness of PPPs is measured. This review of 107 articles intends to fill this gap by reviewing the peer-reviewed articles/papers published during the years 2000-2016. It particularly investigated three areas including (a) the ways in which the effectiveness of PPPs is defined, (b) methods used by the researchers to measure the effectiveness of PPPs, and (c) theories/perspectives explaining the effectiveness of PPPs. The results indicated that the effectiveness of PPPs is not clearly defined in the existing literature. Moreover, there is no consensus on what counts as an effective PPP. Regarding the methods of measurement, the overwhelming majority of researchers focused only on the identification of factors as opposed to the actual measurement of effectiveness. With respect to theoretical perspectives, governance theories were used in most cases. Based on the findings of this systematic literature review, it is recommended in the current research to use six broad categories of methods/factors identified as a starting point to measure the effectiveness of PPPs.

show abstract

Building a framework for the evaluation of knowledge translation for the Canadian Network for Observational Drug Effect Studies

Sketris

Carter

Traynor

et al. 2019

Pharmacoepidemiology and Drug

View full text Add to dashboard Cite

PurposeThe Canadian Network for Observational Drug Effect Studies (CNODES), a network of pharmacoepidemiologists and other researchers from seven provincial sites, provides evidence on the benefits and risks of drugs used by Canadians. The Knowledge Translation Team, one of CNODES' four main teams, evaluates the impact of its efforts using an iterative and emergent approach. This article shares key lessons from early evaluation phases, including identifying stakeholders and their evaluation needs, choosing evaluation theories and approaches, and developing evaluation questions, designs, and methods appropriate for the CNODES context.MethodsStakeholder analysis was conducted using documentary analysis to determine key contextual factors and research evidence needs of decision maker partners and other stakeholders. Selected theories and frameworks from the evaluation and knowledge translation literature informed decisions about evaluation design and implementation. A developmental approach to evaluation was deemed appropriate due to the innovative, complex, and ever‐changing context.ResultsA theory of change, logic model, and potential evaluation questions were developed, informed by the stakeholder analysis. Early indicators of program impact (citation metrics, alternative metrics) have been documented; efforts to collect data on additional indicators are ongoing.ConclusionA flexible, iterative, and emergent evaluation approach allows the Knowledge Translation Team to apply lessons learned from completed projects to ongoing research projects, adapt its approaches based on stakeholder needs, document successes, and be accountable to funders/stakeholders. This evaluation approach may be useful for other international pharmacoepidemiology research networks planning and implementing evaluations of similarly complex, multistakeholder initiatives that are subject to constant change.

show abstract

The Missing Linkage In Evaluating Networks: A Model for Matching Evaluation Approaches to System Dynamics and Complexity

Cited by 4 publications

References 43 publications

An examination of evaluation users’ preferences for program- and actor-oriented theories of change

An examination of evaluation users’ preferences for program- and actor-oriented theories of change

Effectiveness of Public Private Partnerships: A Systematic Literature Review

Building a framework for the evaluation of knowledge translation for the Canadian Network for Observational Drug Effect Studies

Contact Info

Product

Resources

About