Evaluating malaria programmes in moderate- and low-transmission settings: practical ways to generate robust evidence

Abstract

Background: Many countries have made substantial progress in scaling-up and sustaining malaria intervention coverage, leading to more focalized and heterogeneous transmission in many settings. Evaluation provides valuable information for programmes to understand if interventions have been implemented as planned and with quality, if the programme had the intended impact on malaria burden, and to guide programmatic decision-making. Low-, moderate-, and heterogeneous-transmission settings present unique evaluation challenges because of dynamic and targeted intervention strategies. This paper provides illustration of evaluation approaches and methodologies for these transmission settings, and suggests how to answer evaluation questions specific to the local context. Methods:The Roll Back Malaria Monitoring and Evaluation Reference Group formed a task force in October 2017 to lead development of this framework. The task force includes representatives from National Malaria Programmes, funding agencies, and malaria research and implementing partners. The framework builds on existing guidance for process and outcome evaluations and impact evaluations specifically in high transmission settings. Results:The theory of change describes how evaluation questions asked by national malaria programmes in different contexts influence evaluation design. The transmission setting, existing stratification, and data quality and availability are also key considerations. The framework is intended for adaption by countries to their local context, and use for evaluation at sub-national level. Confirmed malaria incidence is recommended as the primary impact indicator due to its sensitivity to detect changes in low-transmission settings. It is expected that process evaluations provide sufficient evidence for programme monitoring and improvement, while impact evaluations are needed following adoption of new mixes of interventions, operational strategies, tools or policies, particularly in contexts of changing malaria epidemiology. Impact evaluations in low-, moderate-, or heterogeneous-transmission settings will likely use plausibility designs, and methods highlighted by the framework include interrupted time series, district-level doseresponse analyses, and constructed control methods. Triangulating multiple data sources and analyses is important to strengthen the plausibility argument. Conclusions:This framework provides a structure to assist national malaria programmes and partners to design evaluations in low-, moderate-or heterogeneous-transmission settings. Emphasizing a continuous cycle along the causal pathway linking process evaluation to impact evaluation and then programmatic decision-making, the © The Author(s) 2020. This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and in...

Dynamic changes in genetic diversity, drug resistance mutations, and treatment outcomes of falciparum malaria from the low-transmission to the pre-elimination phase on the islands of São Tomé and Príncipe

“…Although global malaria mortality fell by 60% over 2000 to 2019, the progress has leveled off in recent years, with sub-Saharan Africa bearing the highest burden of the disease [ 1 ]. High-transmission countries aim at getting back on track to reduce mortality and morbidity, while low-transmission countries aim at eliminating malaria by sustaining the control effort and preventing a rebound in transmission [ 2 , 3 ]. São Tomé and Príncipe (STP), an island nation located in Central West Africa, has made significant progress toward a low-transmission country through effective vector control interventions [ 4 , 5 ].…”

Assessing Thailand’s 1-3-7 surveillance strategy in accelerating malaria elimination

“…There is substantial guidance on conducting robust impact evaluations for full-scale malaria interventions; however, these models have been designed for contexts with substantial malaria burden (30)(31)(32). Even the guidance issued for lower transmission settings is designed for API that is higher than those in Thailand (33). The ARIMA model is based on case burden and is a useful method to assess the 1-3-7 strategy's plausible effect on incidence.…”

Near-term climate change impacts on sub-national malaria transmission

“…Depending on the levels of transmission, which are fundamentally driven by baseline environmental conditions, areas can respond differently to the introduction of intervention measures. For example, areas with high intense transmission will respond differently to the introduction of the same types and levels of interventions than those in low and moderate transmission regions 26 given that climatic influences are a consequence of both change over time and the baseline climatic conditions.…”