Barriers to the evaluation of systematic conservation plans: Insights from landmark Australian plans

Abstract

The evaluation of conservation programs is often inhibited by barriers such as time 7 constraints and a lack of funding. Through an exploration of two internationally influential 8 systematic conservation planning activities conducted in Australia in the 1990s and 2000s, I 9 demonstrate this is also true for conservation planning programs. Forestry agreements in North East New South Wales and the rezoning of the Great Barrier Reef Marine Park popularised the now widely used planning software packages C-Plan and Marxan. Through 37 semi-structured interviews with senior stakeholders involved in decision-making around both plans, I examined barriers to evaluation, the factors underpinning these barriers, and, in the absence of program-wide evaluations, stakeholder perceptions of the effectiveness of the plans. My findings confirmed that the primary barriers to the evaluation of conservation planning exercises are a lack of suitable monitoring data, resource limitations and inadequate preparation. Respondents also shed light on the factors which shaped these barriers in a conservation context, such as the need for political expediency, a loss of momentum postplan, and the presence or absence of necessary leadership. Perceptions of the effectiveness of the plans reflected interpretations of a) whether the planning process followed good practice, b) the fact a planning result was agreed upon and implemented, c) the longer-term influence of the plan, and, in contrast to much of the current literature on these case studies, d) the consequences of industry restructuring. Highlights • Barriers to evaluation were due to lack of resources and preparation • Political context and organisational culture shaped barriers to evaluation • Healthcare and other disciplines face similar challenges and can offer lessons • New perspectives on project effectiveness are shared from senior decision-makers • Perceptions of effectiveness also reflected the effects of industry compensation

Challenges in the impact evaluation of behaviour change interventions: The case of sea turtle meat and eggs in São Tomé

“…While there has been considerable research into both impact evaluation best practices and barriers to conducting evaluations, there is little guidance available for practitioners in how to deal with difficulties that may arise in the field (Curzon & Kontoleon, 2016; McIntosh, 2019). Here we describe a case study of an evaluation of a behaviour change intervention project that faced multiple challenges, and reflect on what we as academics and practitioners can learn from the experience.…”