Broadening the range of designs and methods for impact evaluations

Stern, Elliot; Stame, Nicoletta; Mayne, John; Forss, Kim; Davies, Rick; Befani, Barbara

doi:10.22163/fteval.2012.100

Cited by 272 publications

(263 citation statements)

References 49 publications

Supporting

Mentioning

256

Contrasting

Unclassified

Order By: Relevance

“…They have less of a problem to move beyond countries to regions and the global level, not because the evidence is stronger after 5-8 years, but because they are more flexible in approach and are more pragmatic and adaptable in using data sources and linking data where possible. This sounds opportunistic, but there are many scientifically sound methods and tools that can be combined and triangulated, as amply demonstrated by Stern et al (2012) and Garcia and Zazueta (2015).…”

Section: Using Time and Space To Identify Approachesmentioning

confidence: 99%

Mainstreaming Impact Evidence in Climate Change and Sustainable Development

Berg

2017

Evaluating Climate Change Action for Sustainable Development

View full text Add to dashboard Cite

This chapter examines the demand for impact evidence and concludes that this demand goes beyond the experimental evidence that is produced during the lifetime of an intervention through "impact evaluations" as currently the term is used by many in the evidence movement. The demand for evidence of longer term impact at higher levels requires inspiration from an older tradition of impact evaluation and rethinking how the full range of impact evidence can be uncovered in evaluations. This is especially relevant for sustainable development which calls for a balanced approach on societal, economic and environmental issues. Climate change is a good example of this and a theory of change approach serves to identify key questions over time, space and scale to ensure that impact evidence can be found and reported throughout the lifetime of projects, programmes and policies and beyond in ex post impact assessments. Such an approach leads to mainstreaming of impact questions and related evaluation approaches throughout project and policy cycles. This chapter will demonstrate that evidence can be gathered throughout the lifetime of a project and beyond, in different geographic locations from very local to global, at different levels from relatively simple one dimensional interventions to multi-actor complex systems, up to global scales. It will thus argue for mainstreaming impact considerations throughout interventions, programmes and policies and for evaluations to gather evidence where it is available, rather than to focus the search for impact and its measurement on one or two causal mechanisms that are chosen for verification through experimentation.

show abstract

Section: Using Time and Space To Identify Approachesmentioning

confidence: 99%

Mainstreaming Impact Evidence in Climate Change and Sustainable Development

Berg

2017

Evaluating Climate Change Action for Sustainable Development

View full text Add to dashboard Cite

show abstract

“…On the other, there is growing interest in impact assessments in countries throughout the world, although only in a very few countries does this type of evaluation represent a significant proportion of all evaluations conducted (one exception is the United States, particularly in the education sector). There are also controversies about how to conduct this type of evaluation, that is, whether only randomized controlled trials should be used or a variety of methods should be considered (see Stern et al, 2012). The trend clearly shows the increased importance of impact assessments.…”

Section: Emergence Of Impact Assessmentsmentioning

confidence: 99%

Construyendo gobiernos efectivos: Logros y retos de la gestión pública para resultados en América Latina y el Caribe

Armijo¹,

Cuesta²,

Feinstein³

et al. 2015

View full text Add to dashboard Cite

ative Commons IGO 3.0 Attribution-NonCommercial-NoDerivatives (CC-IGO BY-NC-ND 3.0 IGO) license (http://creativecommons.org/licenses/by-nc-nd/3.0/igo/legalcode) and may be reproduced with attribution to the IDB and for any non-commercial purpose. No derivative work is allowed.Any dispute related to the use of the works of the IDB that cannot be settled amicably shall be submitted to arbitration pursuant to the UNCITRAL rules. The use of the IDB's name for any purpose other than for attribution, and the use of the IDB's logo shall be subject to a separate written license agreement between the IDB and the user and is not authorized as part of this CC-IGO license.Note that the link provided above includes additional terms and conditions of the license The opinions expressed in this publication are those of the authors and do not necessarily reflect the views of the Inter-American Development Bank, its Board of Directors, or the countries they represent. List of Tables Table 1: LAC Countries with the Best Performance in the PET Pillars, 2007 Foreword T here is consensus among government officials and the public at large regarding the urgency of improving the efficiency (doing more with less), effectiveness (doing what is promised), and openness (being transparent and accountable) of public management.As the authors of this book maintain, the capacity of public institutions to implement results-based public management has grown stronger in recent years. The study finds a widespread trend toward improvement, but with significant differences among countries and among public management systems. The index that measures the public sector's capacity for resultsoriented management rose by 20 percent between 2007 and 2013. Of the 24 countries studied, 9 substantially increased their institutional management capabilities, while the rest implemented measures in some of the areas addressed by this study but showed only moderate progress.The actions undertaken have included broad-based reforms, such as the strengthening of national planning systems in the Dominican Republic and the implementation of results-based budgeting in Mexico and Peru. Other more narrowly focused, but equally important, interventions have been carried out, such as optimization of public procurement systems by introducing lowest-price or reverse auctions in Paraguay, and reinforcing integrated financial management systems in Honduras. In addition, it is clear that the reforms have been undertaken not only by the countries that have traditionally led initiatives to improve public management, but also by others, regardless of the size of their economies and degree of development.These topics are not only of interest to public managers or administrators. They will also resonate with legislative branches, academic institutions, the media, and civil society organizations because they are geared to increasing government capacity to create public value and satisfy citizen demands. Building Effective GovernmentsThis book is another contribution of the I...

show abstract

“…L'évaluation d'impact fondée sur la théorie étudie si les impacts obtenus sont imputables à l'action considérée (à savoir si les pratiques nécessaires adoptées par Stern et al 2012) et inversement si les objectifs fixés n'ont pu être atteints malgré la mise en oeuvre appropriée de l'action. Autrement dit, l'évaluation d'impact fondée sur la théorie montrera si la bonne conformité aux normes de certification permet effectivement d'aboutir aux résultats escomptés.…”

Section: éValuations D'impact Et De Processusunclassified

Analyse des connaissances actuelles sur les impacts de la certification forestière: proposition d'un cadre d'évaluation

Romero¹,

Putz²,

Guariguata³

et al. 2013

View full text Add to dashboard Cite

Broadening the range of designs and methods for impact evaluations

Cited by 272 publications

References 49 publications

Mainstreaming Impact Evidence in Climate Change and Sustainable Development

Mainstreaming Impact Evidence in Climate Change and Sustainable Development

Construyendo gobiernos efectivos: Logros y retos de la gestión pública para resultados en América Latina y el Caribe

Analyse des connaissances actuelles sur les impacts de la certification forestière: proposition d'un cadre d'évaluation

Contact Info

Product

Resources

About

Broadening the range of designs and methods for impact evaluations

Cited by 272 publications

References 49 publications

Mainstreaming Impact Evidence in Climate Change and Sustainable Development

Mainstreaming Impact Evidence in Climate Change and Sustainable Development

Construyendo gobiernos efectivos: Logros y retos de la gestión pública para resultados en América Latina y el Caribe

Analyse des connaissances actuelles sur les impacts de la certification foresti&egrave;re: proposition d'un cadre d'évaluation

Contact Info

Product

Resources

About

Analyse des connaissances actuelles sur les impacts de la certification forestière: proposition d'un cadre d'évaluation