Strengthening and measuring research impact in global health: lessons from applying the FAIT framework

Abstract

Background To date, efforts to measure impact have largely focused on health research in high-income countries, reflecting where the majority of health research funding is spent. Nevertheless, there is a growing body of health and medical research being undertaken in low- and middle-income countries (LMICs), supported by both development aid and established research funders. The Framework to Assess the Impact of Translational health research (FAIT) combines three approaches to measuring research impact (Payback, economic assessment and case study narrative). Its aim is to strengthen the focus on translation and impact measurement in health research. FAIT has been used by several Australian research initiatives; however, it has not been used in LMICs. Our aim was to apply FAIT in an LMIC context and evaluate its utility. Methods We retrospectively applied all three FAIT methods to two LMIC studies using available data, supplemented with group discussion and further economic analyses. Results were presented in a scorecard format. Results FAIT helped clarify pathways of impact for the projects and provided new knowledge on areas of impact in several domains, including capacity-building for research, policy development and economic impact. However, there were constraints, particularly associated with calculating the return on investment in the LMIC context. The case study narrative provided a layperson’s summary of the research that helped to explain outcomes and succinctly communicate lessons learnt. Conclusion Use of FAIT to assess the impact of LMIC research was both feasible and useful. We make recommendations related to prospective use, identification of metrics to support use of the Payback framework, and simplification of the economic assessment, which may facilitate further application in LMIC environments. Electronic supplementary material The online version of this article (10.1186/s12961-019-0451-0) contains supplementary material, which is available to authorized users.

Involving End Users in Adapting a Spanish Version of a Web-Based Mental Health Clinic for Young People in Colombia: Exploratory Study Using Participatory Design Methodologies

“…In addition, through working closely with end users, the adapted R&D cycle allowed constant iterations of the MHeC-C in response to technological advances and end-user needs. Effective engagement with local stakeholders, use of local capacities and systems, and measurement of relevant results for the community have been identified as strategies to promote translational research in low-and middle-income countries [100].…”

Embedding an economist in regional and rural health services to add value and reduce waste by improving local-level decision-making: protocol for the ‘embedded Economist’ program and evaluation

“…Finally, to capture the impact of the overall program we will apply the Framework to Assess the Impact from Translational health research (FAIT) [ 29 ] to each project intervention. Locally developed, the FAIT assessment tool was selected as it is based on an extensive review of existing impact frameworks; and it emphasises translational health research and is therefore well suited to this research evaluation [ 29 , 30 ].…”

DAC Target Policy Profile (TPoP)

“…New tools are being developed in the context of the ongoing need and may be helpful for preparing a TPoP. 7,8,9 One example, the Intervention Scalability Assessment Tool 8 may be immediately applicable to LMIC policy change. Another tool called CERQ-Qual helps policymakers gain a confidence level in systematic review-based evidence.…”