Impact Evaluation in Practice

Gertler, Paul; Martínez, Sebastián; Premand, Patrick; Rawlings, Laura B.; Vermeersch, Christel M. J.

doi:10.1596/978-0-8213-8541-8

Cited by 593 publications

(776 citation statements)

References 37 publications

Supporting

Mentioning

621

Contrasting

Unclassified

Order By: Relevance

“…1). Given the post facto nature of this research, the design of the study is limited by the inability to use rigorous impact evaluation methods, such as comparing before-after change with counterfactual cases that did not undergo ES projects (36)(37)(38).…”

Section: Methodsmentioning

confidence: 99%

Policy impacts of ecosystem services knowledge

Posner

McKenzie

Ricketts

2016

Proc. Natl. Acad. Sci. U.S.A.

212

144

View full text Add to dashboard Cite

Research about ecosystem services (ES) often aims to generate knowledge that influences policies and institutions for conservation and human development. However, we have limited understanding of how decision-makers use ES knowledge or what factors facilitate use. Here we address this gap and report on, to our knowledge, the first quantitative analysis of the factors and conditions that explain the policy impact of ES knowledge. We analyze a global sample of cases where similar ES knowledge was generated and applied to decision-making. We first test whether attributes of ES knowledge themselves predict different measures of impact on decisions. We find that legitimacy of knowledge is more often associated with impact than either the credibility or salience of the knowledge. We also examine whether predictor variables related to the science-to-policy process and the contextual conditions of a case are significant in predicting impact. Our findings indicate that, although many factors are important, attributes of the knowledge and aspects of the science-to-policy process that enhance legitimacy best explain the impact of ES science on decision-making. Our results are consistent with both theory and previous qualitative assessments in suggesting that the attributes and perceptions of scientific knowledge and process within which knowledge is coproduced are important determinants of whether that knowledge leads to action. ecosystem services | science policy interface | conservation | knowledge systems | boundary organizations T he ongoing loss of biological diversity and persistence of poverty have sparked interest in policies that protect, restore, and enhance ecosystem services (ES). In response, there has been a growth in ES research that aims to inform policies, incentives, and institutions on a large scale (1-3). Despite this goal, scientific knowledge about ES continues to have limited impact on policy and decisions (1, 4-7).The fact that most land-and resource-use policy decisions still do not take ES into account stems in part from an ineffective interface between ES science and policy, a need for scientists to better understand decision-making processes, and challenges in clarifying conflicting stakeholder values (8-11). In some cases, the science-policy interface is an important aspect of decisionmaking, but often the ES research and policy communities are disconnected from one another, with limited interactions, infrequent exchanges of information, and different objectives that hinder coordinated science and policy processes (12). Many scientists conduct ES research without fully considering how the knowledge they are producing might be used (5). If we want ES information to be incorporated into decisions, then we need to understand how and why decision-makers use certain kinds of information. We define "information" as a tangible, factual output of scientific research produced through specific ES analyses; "knowledge" as a body of information learned and conveyed through scientific and policy processes; ...

show abstract

Section: Methodsmentioning

confidence: 99%

Policy impacts of ecosystem services knowledge

Posner

McKenzie

Ricketts

2016

Proc. Natl. Acad. Sci. U.S.A.

212

144

View full text Add to dashboard Cite

show abstract

“…Os usos diretos e indiretos reportados na literatura são: reorganização de ações, mudanças individuais cognitivas e comportamentais, desenvolvimento organizacional, compartilhamento de conhecimentos, aumento do comprometimento, mudança de perspectiva sobre a avaliação, ajuda na definição dos gastos, demonstração de legitimidade aos potenciais financiadores e atração de recursos financeiros 3,4,8 . Outro estudo brasileiro sobre utilização de avaliação identificou o uso instrumental como o mais relatado 10 ; neste estudo de caso o uso mais claro é o político, e o uso instrumental para planejamento de ações ocorreu no município de menor porte populacional (porte I), provavelmente por conta do acesso às lideranças 8 , já que o gestor está mais próximo da equipe de saúde -até geograficamente.…”

Section: Discussionunclassified

“…As avaliações, com algumas exceções, ainda têm modesta influência nas políticas públicas, os seus resultados não são imediatamente traduzidos em ações, e o seu uso a médio e longo prazos não tem sido explorado pelos avaliadores 3,4,5 . Verificar o uso de avaliação conduzida e financiada por instituições públicas promove uma prestação de contas à sociedade, e demonstra a responsabilidade com os gastos públicos na área da saúde na qual os recursos são sempre escassos e muito disputados 4 .…”

Section: Introductionunclassified

O uso de uma avaliação por gestores da atenção primária em saúde: um estudo de caso no Sul do Brasil

et al. 2014

View full text Add to dashboard Cite

show abstract

“…We evaluate the ITQ program after it is in place (ex-post or retrospective) using own-fishery data (Khandker, Koolwal and Samad (2010) and Gertler, Martinez et al (2011)). Our challenge is to identify the change in indicators attributable to the ITQ program, versus changes which would have occurred anyway (see discussion in Gertler, Martinez et al (2011) on counterfeit counterfactuals).…”

Section: Counterfactualsmentioning

confidence: 99%

Evaluation of the Chilean Jack Mackerel ITQ System

Kroetz¹,

Sanchirico²,

Peña-Torres³

et al. 2016

View full text Add to dashboard Cite

work is licensed under a Creative Commons IGO 3.0 AttributionNonCommercial-NoDerivatives (CC-IGO BY-NC-ND 3.0 IGO) license (http://creativecommons.org/licenses/by-nc-nd/3.0/igo/ legalcode) and may be reproduced with attribution to the IDB and for any non-commercial purpose, as provided below. No derivative work is allowed.Any dispute related to the use of the works of the IDB that cannot be settled amicably shall be submitted to arbitration pursuant to the UNCITRAL rules. The use of the IDB's name for any purpose other than for attribution, and the use of IDB's logo shall be subject to a separate written license agreement between the IDB and the user and is not authorized as part of this CC-IGO license.Following a peer review process, and with previous written consent by the Inter-American Development Bank (IDB), a revised version of this work may also be reproduced in any academic journal, including those indexed by the American Economic Association's EconLit, provided that the IDB is credited and that the author(s) receive no income from the publication. Therefore, the restriction to receive income from such publication shall only extend to the publication's author(s). With regard to such restriction, in case of any inconsistency between the Creative Commons IGO 3.0 Attribution-NonCommercial-NoDerivatives license and these statements, the latter shall prevail.Note that link provided above includes additional terms and conditions of the license. Tables Table 1: Timeline The debate in commercial fishery management has evolved from whether well-defined rights are necessary for sustainability to measuring the impacts of different rights-based system designs. Most assessments are on developed world fisheries. Using a unique collection of datasets, we develop counterfactuals to evaluate the impacts of the Chilean Jack Mackerel catch share program. We investigate vessel and trip characteristics, as well as trip costs and revenues, before and after the implementation of the program. We find an increase in higher value products and associated revenue, as well as consolidation of catch on larger vessels, vessels taking longer trips, and catching more per trip. Overall, we estimate that the program led to a measureable increase in fishing profits, mainly due to movement toward higher value products. A back-of-the-envelope calculation results in an implied annual quota rental rate on the order of ~15-19% of ex-vessel prices. JEL Codes. Q22

show abstract

Impact Evaluation in Practice

Cited by 593 publications

References 37 publications

Policy impacts of ecosystem services knowledge

Policy impacts of ecosystem services knowledge

O uso de uma avaliação por gestores da atenção primária em saúde: um estudo de caso no Sul do Brasil

Evaluation of the Chilean Jack Mackerel ITQ System

Contact Info

Product

Resources

About