BackgroundThe introduction of evidence-based programs and practices into healthcare settings has been the subject of an increasing amount of research in recent years. While a number of studies have examined initial implementation efforts, less research has been conducted to determine what happens beyond that point. There is increasing recognition that the extent to which new programs are sustained is influenced by many different factors and that more needs to be known about just what these factors are and how they interact. To understand the current state of the research literature on sustainability, our team took stock of what is currently known in this area and identified areas in which further research would be particularly helpful. This paper reviews the methods that have been used, the types of outcomes that have been measured and reported, findings from studies that reported long-term implementation outcomes, and factors that have been identified as potential influences on the sustained use of new practices, programs, or interventions. We conclude with recommendations and considerations for future research.MethodsTwo coders identified 125 studies on sustainability that met eligibility criteria. An initial coding scheme was developed based on constructs identified in previous literature on implementation. Additional codes were generated deductively. Related constructs among factors were identified by consensus and collapsed under the general categories. Studies that described the extent to which programs or innovations were sustained were also categorized and summarized.ResultsAlthough "sustainability" was the term most commonly used in the literature to refer to what happened after initial implementation, not all the studies that were reviewed actually presented working definitions of the term. Most study designs were retrospective and naturalistic. Approximately half of the studies relied on self-reports to assess sustainability or elements that influence sustainability. Approximately half employed quantitative methodologies, and the remainder employed qualitative or mixed methodologies. Few studies that investigated sustainability outcomes employed rigorous methods of evaluation (e.g., objective evaluation, judgement of implementation quality or fidelity). Among those that did, a small number reported full sustainment or high fidelity. Very little research has examined the extent, nature, or impact of adaptations to the interventions or programs once implemented. Influences on sustainability included organizational context, capacity, processes, and factors related to the new program or practice themselves.ConclusionsClearer definitions and research that is guided by the conceptual literature on sustainability are critical to the development of the research in the area. Further efforts to characterize the phenomenon and the factors that influence it will enhance the quality of future research. Careful consideration must also be given to interactions among influences at multiple levels, as well as issues su...

BackgroundEvidence-based interventions are frequently modified or adapted during the implementation process. Changes may be made to protocols to meet the needs of the target population or address differences between the context in which the intervention was originally designed and the one into which it is implemented [Addict Behav 2011, 36(6):630–635]. However, whether modification compromises or enhances the desired benefits of the intervention is not well understood. A challenge to understanding the impact of specific types of modifications is a lack of attention to characterizing the different types of changes that may occur. A system for classifying the types of modifications that are made when interventions and programs are implemented can facilitate efforts to understand the nature of modifications that are made in particular contexts as well as the impact of these modifications on outcomes of interest.MethodsWe developed a system for classifying modifications made to interventions and programs across a variety of fields and settings. We then coded 258 modifications identified in 32 published articles that described interventions implemented in routine care or community settings.ResultsWe identified modifications made to the content of interventions, as well as to the context in which interventions are delivered. We identified 12 different types of content modifications, and our coding scheme also included ratings for the level at which these modifications were made (ranging from the individual patient level up to a hospital network or community). We identified five types of contextual modifications (changes to the format, setting, or patient population that do not in and of themselves alter the actual content of the intervention). We also developed codes to indicate who made the modifications and identified a smaller subset of modifications made to the ways that training or evaluations occur when evidence-based interventions are implemented. Rater agreement analyses indicated that the coding scheme can be used to reliably classify modifications described in research articles without overly burdensome training.ConclusionsThis coding system can complement research on fidelity and may advance research with the goal of understanding the impact of modifications made when evidence-based interventions are implemented. Such findings can further inform efforts to implement such interventions while preserving desired levels of program or intervention effectiveness.

Complex posttraumatic stress disorder (CPTSD) has been proposed as a diagnosis for capturing the diverse clusters of symptoms observed in survivors of prolonged trauma that are outside the current definition of PTSD. Introducing a new diagnosis requires a high standard of evidence, including a clear definition of the disorder, reliable and valid assessment measures, support for convergent and discriminant validity, and incremental validity with respect to implications for treatment planning and outcome. In this article, the extant literature on CPTSD is reviewed within the framework of construct validity to evaluate the proposed diagnosis on these criteria. Although the efforts in support of CPTSD have brought much needed attention to limitations in the trauma literature, we conclude that available evidence does not support a new diagnostic category at this time. Some directions for future research are suggested.

Objective To examine decentering as a potential mechanism of action across two treatments for generalized anxiety disorder: an acceptance based behavioral therapy (ABBT) and applied relaxation (AR). Method Sixty-four individuals who completed at least half of the 16 total sessions of either ABBT or AR (65.6% female, 79.7% identified as White, average age 34.41) completed measures of decentering (Experiences Questionnaire) and of symptoms of anxiety (Depression Anxiety Stress Scale-Stress subscale) at five time points over the course of therapy and a measure of worry (Penn State Worry Questionnaire) at pre and post-treatment. Results Initial growth curve models showed that decentering increased significantly over therapy (z = 7.09) and this increase was associated with a decrease in worry symptoms (PSWQ) at post-treatment (z = −8.51). The rate of change did not significantly vary across treatments (Δχ2/Δdf = 0.16/1, p = 0.69). Further, a series of bivariate latent difference score models indicated that the best fitting model was one in which decentering was a leading indicator of change in symptoms (DASS-Stress). Allowing this coupling to vary across treatments did not significantly improve the fit of the model (Δχ2/Δdf = 0.71/1, p = 0.40). Conclusions In this sample, results suggest that increased decentering was associated with decreases in anxiety and that changes in decentering appear to precede changes in symptoms within both ABBT and AR, indicating that decentering may be an important common mechanism of action.

Objective This study identified modifications to an evidence-based psychosocial treatment (cognitive therapy) within a community mental health system after clinicians had received intensive training and consultation. Methods A coding system, consisting of five types of contextual modifications, 12 types of content-related modifications, seven levels at which modifications can occur, and a code for changes to training or evaluation processes, was applied to data from interviews with 27 clinicians who treat adult consumers within a mental health system. Results Nine of 12 content modifications were endorsed, and four (tailoring, integration into other therapeutic approaches, loosening structure, and drift) accounted for 65% of all modifications identified. Contextual modifications were rarely endorsed by clinicians in this sample. Modifications typically occurred at the client or clinician level. Conclusions Clinicians in community mental health settings made several modifications to an evidence-based practice (EBP), often in an effort to improve the fit of the intervention to the client’s needs or to the clinician’s therapeutic style. These findings have implications for implementation and sustainability of EBPs in community settings, client-level outcomes, and training and consultation.

This review describes methods used to examine the modifications and adaptations to evidence-based psychological treatments (EBPTs), assesses what is known about the impact of modifications and adaptations to EBPTs, and makes recommendations for future research and clinical care. One hundred eight primary studies and three meta-analyses were identified. All studies examined planned adaptations, and many simultaneously investigated multiple types of adaptations. With the exception of studies on adding or removing specific EBPT elements, few studies compared adapted EBPTs to the original protocols. There was little evidence that adaptations in the studies were detrimental, but there was also limited consistent evidence that adapted protocols outperformed the original protocols, with the exception of adding components to EBPTs. Implications for EBPT delivery and future research are discussed.

No abstract

We evaluated the impact of homework completion on change in PTSD symptoms in the context of two randomized controlled trials of Cognitive Processing Therapy for PTSD (CPT). Female participants (n = 140) diagnosed with PTSD attended at least one CPT session and were assigned homework at each session. The frequency of homework completion was assessed at the beginning of each session and PTSD symptoms were assessed every other session. Piecewise growth models were used to examine the relationship between homework completion and symptom change. CPT version (with vs without the written trauma account) did not moderate associations between homework engagement and outcomes. Greater pretreatment PTSD symptoms predicted more Session 1 homework completion, but PTSD symptoms did not predict homework completion at other timepoints. More homework completion after Sessions 2 and 3 was associated with less change in PTSD from Session 2 to Session 4, but larger pre-to-post treatment changes in PTSD. Homework completion after Sessions 2 and 3 was associated with greater symptom change among patients who had fewer years of education. More homework completion after Sessions 8 and 9 was associated with larger subsequent decreases in PTSD. Average homework completion was not associated with client characteristics. In the second half of treatment, homework engagement was associated with less dropout. The results suggest that efforts to increase engagement in homework may facilitate symptom change.