Building a roadmap for the evaluation of a National Health Plan: the experience of Portugal

Abstract

Issue The National Health Plan (PNS) 2012-2016 (extended until 2020) is the Portuguese strategic health document that presents the direction of intervention within the Health System. A final evaluation of PNS was foreseen, with National Institute of Health Dr Ricardo Jorge (INSA) being responsible for carrying out this task. The experience gained by INSA in defining a roadmap to be used in this process can be important in steering other actors to policy evaluation. Description of the problem In order to analyze the impact of policies, it is necessary to collect evidence that can evaluate the results achieved, and more importantly, identify gaps in implementation and evaluation issues. Herein, we aim to present the methodological approach developed to pave the way to the final assessment of PNS. Results As part of the Biennial Collaborative Agreement 2016-2017, WHO sponsored a high-level technical consultative process with relevant experts to address the condition for defining the work plan. It was devised to undertake: i) A scoping review based upon data collected from PNS implementation evidence mapping; ii) A qualitative analysis of the perception from main stakeholders on PNS impact and their expectations. Thus, a matrix of evidence was built to analyze the alignment of PNS at national and local levels, and with the main health framework targets and indicators. Also, online surveys and face-to-face interviews were done with key stakeholders in order to identify evidence gaps and critical factors for the successful PNS implementation, among others. Lessons To characterize its implementation and impact on citizens' health, a sound PNS evaluation should be guided by clear assessment questions, supported by validated tools and complemented by international guidance. In addition, a long-term consultative process with key stakeholder support is required to properly identify opportunities, priorities, and outcomes. Key messages Institutionalization of an evaluation process as part of public policies life cycle is a powerfull tool to foster learning and crucial to achievement of proposed goals. A clear structure to support the policy evaluation approach is mandatory to guarantee impartiality, independence and transparency on the overall process.