Background: The importance of evaluating policy processes to achieve health equity is well recognised but such evaluation encounters methodological, theoretical and political challenges. This paper describes how a program theorybased evaluation framework can be developed and tested, using the example of an evaluation of the South Australian Health in All Policies (HiAP) initiative. Methods: A framework of the theorised components and relationships of the HiAP initiative was produced to guide evaluation. The framework was the product of a collaborative, iterative process underpinned by a policy-research partnership and drew on social and political science theory and relevant policy literature. Results: The process engaged key stakeholders to capture both HiAP specific and broader bureaucratic knowledge and was informed by a number of social and political science theories. The framework provides a basis for exploring the interactions between framework components and how they shape policy-making and public policy. It also enables an assessment of HiAP’s success in integrating health and equity considerations in policies, thereby laying a foundation for predicting the impacts of resulting policies. Conclusion: The use of a program theory-based evaluation framework developed through a consultative process and informed by social and political science theory has accommodated the complexity of public policy-making. The framework allows for examination of HiAP processes and impacts, and for the tracking of contribution towards distal outcomes through the explicit articulation of the underpinning program theory.

BackgroundThis paper reports on a five-year study using a theory-based program logic evaluation, and supporting survey and interview data to examine the extent to which the activites of the South Australian Health in All Policies initiative can be linked to population health outcomes.MethodsMixed-methods data were collected between 2012 and 2016 in South Australia (144 semi-structured key informant interviews; two electronic surveys of public servants in 2013 (n = 435) and 2015 (n = 483); analysis of state government policy documents; and construction of a program logic model to shape assessment of the feasibility of attribution to population health outcomes).ResultsMultiple actions on social determinants of health in a range of state government sectors were reported and most could be linked through a program logic model to making some contribution to future population health outcomes. Context strongly influences implementation; not all initiatives will be successful and experimentation is vital. Successful initiatives included HiAP influencing the urban planning department to be more concerned with the health impacts of planning decisions, and encouraging the environment department to be concerned with the health impacts of its work.ConclusionsThe theory-based program logic suggests that SA HiAP facilitated improved population health through working with multiple government departments. Public servants came to appreciate how their sectors impact on health. Program logic is a mechanism to evaluate complex public health interventions in a way that takes account of political and economic contexts. SA HiAP was mainly successful in avoiding lifestyle drift in strategy. The initiative encouraged a range of state government departments to tackle conditions of daily living. The broader underpinning factors dictating the distribution of power, money and resources were not addressed by HiAP. This reflects HiAP’s use of a consensus model which was driven by (rather than drove) state priorities and sought ‘win-win’ strategies.

Mobilising cross-sectoral action is helpful in addressing the range of social determinants that contribute to health inequities. The South Australian Health in All Policies (SA HiAP) approach was implemented from 2007 to stimulate cross-sector policy activity to address the social determinants of health to improve population wellbeing and reduce health inequities. This paper presents selected findings from a five year multi-methods research study of the SA HiAP approach and draws on data collected during interviews, observation, case studies, and document analysis. The analysis shows that SA HiAP had dual goals of facilitating joined-up government for co-benefits (process focus); and addressing social determinants of health and inequities through cross-sectoral policy activity (outcomes focus). Government agencies readily understood HiAP as providing tools for improving the process of intersectoral policy development, while the more distal outcome-focused intent of improving equity was not well understood and gained less traction. While some early rhetorical support existed for progressing an equity agenda through SA HiAP, subsequent economic pressures resulted in the government narrowing its priorities to economic goals. The paper concludes that SA HiAP’s initial intentions to address equity were only partially enacted and little was done to reduce inequities. Emerging opportunities in SA, and internationally, including the UN Sustainable Development Goals, may revive interest in addressing equity.

BackgroundThis paper examines the extent to which actors from sectors other than health engaged with the South Australian Health in All Policies (HiAP) initiative, determines why they were prepared to do so and explains the mechanisms by which successful engagement happened. This examination applies theories of policy development and implementation.MethodsThe paper draws on a five year study of the implementation of HiAP comprising document analysis, a log of key events, detailed interviews with 64 policy actors and two surveys of public servants.ResultsThe findings are analysed within an institutional policy analysis framework and examine the extent to which ideas, institutional factors and actor agency influenced the willingness of actors from other sectors to work with Health sector staff under the HiAP initiative. In terms of ideas, there was wide acceptance of the role of social determinants in shaping health and the importance of action to promote health in all government agencies. The institutional environment was initially supportive, but support waned over the course of the study when the economy in South Australia became less buoyant and a health minister less supportive of health promotion took office. The existence of a HiAP Unit was very helpful for gaining support from other sectors. A new Public Health Act offered some promise of institutionalising the HiAP approach and ideas. The analysis concludes that a key factor was the operation of a supportive network of public servants who promoted HiAP, including some who were senior and influential.ConclusionsThe South Australian case study demonstrates that despite institutional constraints and shifting political support within the health sector, HiAP gained traction in other sectors. The key factors that encouraged the commitment of others sectors to HiAP were the existence of a supportive, knowledgeable policy network, political support, institutionalisation of the ideas and approach, and balancing of the economic and social goals of government.

IntroductionA well-established body of literature demonstrates that health and equity are strongly influenced by the consequences of governments’ policy and resultant actions (or inactions) outside the health sector. Consequently, the United Nations, and its agency the WHO, have called for national leadership and whole-of-government action to understand and address the health impacts of policies in all sectors. This research responds to that call by investigating how policymaking in four sectors—urban planning, justice, energy and environment—may influence the social determinants of health and health equity (SDH/HE).Methods and analysisThe research design is informed by a critical qualitative approach. Three successive stages are included in the design. The first involves analysing all strategic policy documents and selected legislative documents from the four sectors (n=583). The document analysis is based on a coding framework developed to identify alignment between the documents and the SDH/HE. Two policies that demonstrate good practice in regard to SDH/HE will be selected from each sector during the second stage for embedded case study analysis (total n=8). This is intended to illuminate which factors have supported recognition and action on SDH/HE in the selected policies. The third stage involves progressive theoretical integration and development to understand political and institutional facilitators and barriers to action on SDH/HE, both within and between sectors.Ethics and disseminationThe research will provide much needed evidence about how coherent whole-of-government action on SDH/HE can be advanced and contribute knowledge about how health-enhancing policy activity in the four sectors may be optimised. Learnings from the research will be shared via a project advisory group, policy briefings, academic papers, conference presentations and research symposia. Ethics approval has been secured for the embedded case studies, which involve research participants.