The sustainability of new programs and innovations: a review of the empirical literature and recommendations for future research

Abstract

BackgroundThe introduction of evidence-based programs and practices into healthcare settings has been the subject of an increasing amount of research in recent years. While a number of studies have examined initial implementation efforts, less research has been conducted to determine what happens beyond that point. There is increasing recognition that the extent to which new programs are sustained is influenced by many different factors and that more needs to be known about just what these factors are and how they interact. To understand the current state of the research literature on sustainability, our team took stock of what is currently known in this area and identified areas in which further research would be particularly helpful. This paper reviews the methods that have been used, the types of outcomes that have been measured and reported, findings from studies that reported long-term implementation outcomes, and factors that have been identified as potential influences on the sustained use of new practices, programs, or interventions. We conclude with recommendations and considerations for future research.MethodsTwo coders identified 125 studies on sustainability that met eligibility criteria. An initial coding scheme was developed based on constructs identified in previous literature on implementation. Additional codes were generated deductively. Related constructs among factors were identified by consensus and collapsed under the general categories. Studies that described the extent to which programs or innovations were sustained were also categorized and summarized.ResultsAlthough "sustainability" was the term most commonly used in the literature to refer to what happened after initial implementation, not all the studies that were reviewed actually presented working definitions of the term. Most study designs were retrospective and naturalistic. Approximately half of the studies relied on self-reports to assess sustainability or elements that influence sustainability. Approximately half employed quantitative methodologies, and the remainder employed qualitative or mixed methodologies. Few studies that investigated sustainability outcomes employed rigorous methods of evaluation (e.g., objective evaluation, judgement of implementation quality or fidelity). Among those that did, a small number reported full sustainment or high fidelity. Very little research has examined the extent, nature, or impact of adaptations to the interventions or programs once implemented. Influences on sustainability included organizational context, capacity, processes, and factors related to the new program or practice themselves.ConclusionsClearer definitions and research that is guided by the conceptual literature on sustainability are critical to the development of the research in the area. Further efforts to characterize the phenomenon and the factors that influence it will enhance the quality of future research. Careful consideration must also be given to interactions among influences at multiple levels, as well as issues su...

Outcomes of a Partnered Facilitation Strategy to Implement Primary Care–Mental Health

“…[12][13][14][15] Unfortunately, when funding ends, sites often have difficulty sustaining changes. 16 We developed an IF strategy in collaboration with the Department of Veterans Affairs' (VA) regional mental health and primary care leadership that addresses these challenges. We served as consultants, providing implementation science expertise, 6,17 tools 18 and resources 19 needed to support implementation.…”

Assessing the level of institutionalization of donor-funded anti-retroviral therapy (ART) programs in health facilities in Uganda: implications for program sustainability

“…ART service delivery had not yet transitioned into being an integral part of their organizations. The notion of intervention ‘permanence’ as an indicator of the program sustainability of innovations in health service organizations is consistent in the literature [14,16,34]. O’Loughlin et al [35], used perceived permanence of an intervention as an outcome measure in their investigation of the sustainability of heart health promotion interventions in Canada.…”

“…Against this background, the sustainability of the implementation of ART scale-up in SSA has come into critical focus [1,4,9–11]. The institutionalization or integration of interventions in the organizational routines of health service organizations is considered an important indicator of long-term program sustainability [12–16]. Although there have been numerous studies documenting the initial phase of ART scale-up in SSA [4,7], there is a dearth of systematic analysis of level of institutionalization of ART programs in externally supported health facilities in Uganda and the broader Sub-Saharan Africa region.…”

“…Institutionalization is theorized to occur when interventions become a habitual, routine and integral part of ‘normal’ health service delivery which is regarded as an important dimension of long-term program sustainability [13–16]. ‘In this perspective, the maintenance of program activities without special external funding is most likely to occur if the program components become embedded into organizational processes’’ [14].…”

Searching for sustainability within public health policy: insights from an injury prevention perspective

“…A common element, however, is the continuation of programme activities in order to provide ongoing benefits to the target group. [1][2][3] The behavioural outcomes of community-based public health programmes often concern changes that occur over the longer-term. 4,5 Sustaining programme operation beyond the initial period of support may, therefore, be essential if benefits are to manifest fully.…”