Highlights We describe the process of developing a logic model as part of an ongoing realist evaluation of a community health workers programme in Nigeria. We also reflect on how other scholars explored context during logic modelling in theory-driven evaluations of complex healthcare programmes. Creating a logic model is a key step in modelling relations between a programme, its outcomes and contextual conditions that can affect outcomes. Logic models can also inform identification of initial working theories and evaluation measures for verifying underlying programme theories. Lessons for researchers and programme planners who wish to develop and use logic models in future evaluations are discussed.
BackgroundAchievement of improved maternal and child health (MCH) outcomes continues to be an issue of international priority, particularly for sub-Saharan African countries such as Nigeria. Evidence suggests that the use of Community Health Workers (CHWs) can be effective in broadening access to, and coverage of, health services and improving MCH outcomes in such countries.Methods/designIn this paper, we report the methodology for a 5-year study which aims to evaluate the context, processes, outcomes and longer-term sustainability of a Nigerian CHW scheme. Evaluation of complex interventions requires a comprehensive understanding of intervention context, mechanisms and outcomes. The multidisciplinary and mixed-method realist approach will facilitate such evaluation. A favourable policy environment within which the study is conducted will ensure the successful uptake of results into policy and practice.A realist evaluation provides an overall methodological framework for this multidisciplinary and mixed methods research, which will be undertaken in Anambra state. The study will draw upon health economics, social sciences and statistics. The study comprises three steps: (1) initial theory development; (2) theory validation and (3) theory refinement and development of lessons learned. Specific methods for data collection will include in-depth interviews and focus group discussions with purposefully identified key stakeholders (managers, service providers and service users), document reviews, analyses of quantitative data from the CHW programme and health information system, and a small-scale survey. The impact of the programme on key output and outcome indicators will be assessed through an interrupted time-series analysis (ITS) of monthly quantitative data from health information system and programme reports. Ethics approvals for this study were obtained from the University of Leeds and the University of Nigeria.DiscussionThis study will provide a timely and important contribution to health systems strengthening specifically within Anambra state in southeast Nigeria but also more widely across Nigeria. This paper should be of interest to researchers who are interested in adapting and applying robust methodologies for assessing complex health system interventions. The paper will also be useful to policymakers and practitioners who are interested in commissioning and engaging in such complex evaluations to inform policies and practices.Electronic supplementary materialThe online version of this article (doi:10.1186/s13012-016-0443-1) contains supplementary material, which is available to authorized users.
BackgroundTo achieve Universal Health Coverage (UHC), more health workers are needed; also critical is supporting optimal performance of existing staff. Integrated human resource management (HRM) strategies, complemented by other health systems strategies, are needed to improve health workforce performance, which is possible at district level in decentralised contexts. To strengthen the capacity of district management teams to develop and implement workplans containing integrated strategies for workforce performance improvement, we introduced an action-research-based management strengthening intervention (MSI). This consisted of two workshops, follow-up by facilitators and meetings between participating districts. Although often used in the health sector, there is little evaluation of this approach in middle-income and low-income country contexts. The MSI was tested in three districts in Ghana, Tanzania and Uganda. This paper reports on the appropriateness of the MSI to the contexts and its effects.MethodsDocumentary evidence (workshop reports, workplans, diaries, follow-up visit reports) was collected throughout the implementation of the MSI in each district and interviews (50) and focus-group discussions (6) were conducted with managers at the end of the MSI. The findings were analysed using Kirkpatrick’s evaluation framework to identify effects at different levels.FindingsThe MSI was appropriate to the needs and work patterns of District Health Management Teams (DHMTs) in all contexts. DHMT members improved management competencies for problem analysis, prioritisation and integrated HRM and health systems strategy development. They learnt how to refine plans as more information became available and the importance of monitoring implementation. The MSI produced changes in team behaviours and confidence. There were positive results regarding workforce performance or service delivery; these would increase with repetition of the MSI.ConclusionsThe MSI is appropriate to the contexts where tested and can improve staff performance. However, for significant impact on service delivery and UHC, a method of scaling up and sustaining the MSI is required.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.
hi@scite.ai
10624 S. Eastern Ave., Ste. A-614
Henderson, NV 89052, USA
Copyright © 2024 scite LLC. All rights reserved.
Made with 💙 for researchers
Part of the Research Solutions Family.