Four challenges in selecting and implementing methods to monitor and evaluate participatory processes: Example from the Rwenzori region, Uganda

Abstract

Participatory approaches are now increasingly recognized and used as an essential element of policies and programs, especially in regards to natural resource management (NRM). Most practitioners, decision-makers and researchers having adopted participatory approaches also acknowledge the need to monitor and evaluate such approaches in order to audit their effectiveness, support decision-making or improve learning. Many manuals and frameworks exist on how to carry out monitoring and evaluation (M&E) for participatory processes. However, few provide guidelines on the selection and implementation of M&E methods, an aspect which is also often obscure in published studies, at the expense of the transparency, reliability and validity of the study. In this paper, we argue that the selection and implementation of M&E methods are particularly strategic when monitoring and evaluating a participatory process. We demonstrate that evaluators of participatory processes have to tackle a quadruple challenge when selecting and implementing methods: using mixed-methods, both qualitative and quantitative; assessing the participatory process, its outcomes, and its context; taking into account both the theory and participants' views; and being both rigorous and adaptive. The M&E of a participatory planning process in the Rwenzori Region, Uganda, is used as an example to show how these challenges unfold on the ground and how they can be tackled. Based on this example, we conclude by providing tools and strategies that can be used by evaluators to ensure that they make utile, feasible, coherent, transparent and adaptive methodological choices when monitoring and evaluating participatory processes for NRM.

Giving patients a voice: a participatory evaluation of patient engagement in Newfoundland and Labrador Health Research

“…Our approach was theory and stakeholder-based which we see as a strength. We agree with others that evaluators of processes like patient engagement should use mixed methods: assessing the process, its outcomes, and its context; taking into account both the theory and participants' views; and being scientifically rigorous while also adaptive to local needs [34]. However, the lack of organizational capacity and resources needed for these types of evaluation studies should not be overlooked, as well as the time it takes before outcomes become visible.…”

“…The importance of feedback has also been described by Mathie et al [33]. However, there are several challenges that evaluators have to tackle when selecting and implementing evaluation methods [34]. Below we reflect on our evaluation study findings and the participatory process.…”

Quantifying stakeholder learning in climate change adaptation across multiple relational and participatory networks

“…Stakeholder participation facilitates knowledge innovations (Cvitanovic et al, 2019;Rathwell et al, 2015), is fundamental for social learning processes (Cundill and Rodela, 2012;Lankester, 2013), and builds social ties among diverse stakeholders (Cockburn et al, 2016;Macgillivray, 2018). Yet evaluating stakeholder participation efforts can be difficult as evaluation frameworks vary across different case studies and research contexts (see Hassenforder et al, 2016). As such, understanding the link between stakeholder participation and its targeted outcomes could be strengthened by frameworks and evaluations that cut across a wide range of cases.…”

Only Through Community: A Case Study of the St. Martin Approach - The Lens of Transforming Communities from the Inside Out

“…In the development context, participation aims to empower individuals in any given community who are disadvantaged and gives them the power to take control of their lives (Hassenforder et al, 2016). Participation is a process in which the local people in a community use their power so as to decide on issues concerning their community.…”