Fidelity Criteria: Development, Measurement, and Validation

Mowbray, Carol T.; Holter, Mark C.; Teague, Gregory B.; Bybee, Deborah

doi:10.1177/109821400302400303

Cited by 640 publications

(505 citation statements)

References 54 publications

Supporting

Mentioning

476

Contrasting

Unclassified

Order By: Relevance

“…Despite the utility of knowing which intervention core components constitute active ingredients (Irwin & Supplee, 2012), there is surprisingly little empirical work examining fidelity to individual intervention core components and their relation to program outcomes (Collins et al, 2005;Mowbray et al, 2003). Implementation research across education, prevention, and behavioral health fields continues to focus primarily on personal and contextual factors that promote or hinder fidelity to an intervention model (Century, Cassata, Rudnick, & Freeman, 2012;Lunn et al, 2011) and relating measures of (overall) fidelity to outcomes (Pas & Bradshaw, 2012).…”

Section: Deriving and Testing Indices Of Fidelity To Intervention Cormentioning

confidence: 99%

Using Indices of Fidelity to Intervention Core Components to Identify Program Active Ingredients

Abry

Hulleman

Rimm‐Kaufman

2014

American Journal of Evaluation

View full text Add to dashboard Cite

Measures of intervention fidelity can be used to identify specific intervention components promoting desired change-the active ingredients-yet such applications are rare. In the context of a social-emotional learning intervention, we illustrate how fidelity measures can be used to identify program active ingredients. We applied one customary and two novel approaches to creating indices of fidelity. In the customary approach, we averaged fidelity ratings across all core components. In the novel approaches, we computed fidelity indices for specific components by (a) averaging responses from like-items and (b) deriving factor scores from a multitrait, multimethod factor analysis. We then tested indices in relation to achievement gains (N = 1442).Indices derived using novel approaches explained more outcome variance than indices from the customary approach. Further, novel approaches revealed one component as a potential active ingredient. Discussion highlights strengths and limitations of the indices and implications for identifying program active ingredients.

show abstract

Section: Deriving and Testing Indices Of Fidelity To Intervention Cormentioning

confidence: 99%

Using Indices of Fidelity to Intervention Core Components to Identify Program Active Ingredients

Abry

Hulleman

Rimm‐Kaufman

2014

American Journal of Evaluation

View full text Add to dashboard Cite

show abstract

“…Without a high degree of fidelity, there is no way to determine whether unsuccessful outcomes reflect a failure of the model or failure to implement the model as intended. 84 A number of strategies were in place to maximise treatment fidelity. The PEPS intervention was specified in treatment manuals, containing information about the theory underpinning the treatment, the content of sessions, and the duration and frequency of sessions.…”

Section: Treatment Fidelitymentioning

confidence: 99%

Psychoeducation with problem-solving (PEPS) therapy for adults with personality disorder: a pragmatic randomised controlled trial to determine the clinical effectiveness and cost-effectiveness of a manualised intervention to improve social functioning

McMurran

Crawford

Reilly

et al. 2016

Health Technol Assess

View full text Add to dashboard Cite

If effective, less intensive treatments for people with personality disorder have the potential to serve more people.To compare the clinical effectiveness and cost-effectiveness of psychoeducation with problem-solving (PEPS) therapy plus usual treatment against usual treatment alone in improving social problem-solving with adults with personality disorder.Multisite two-arm, parallel-group, pragmatic randomised controlled superiority trial.Community mental health services in three NHS trusts in England and Wales.Community-dwelling adults with any personality disorder recruited from community mental health services.Up to four individual sessions of psychoeducation, a collaborative dialogue about personality disorder, followed by 12 group sessions of problem-solving therapy to help participants learn a process for solving interpersonal problems.The primary outcome was measured by the Social Functioning Questionnaire (SFQ). Secondary outcomes were service use (general practitioner records), mood (measured via the Hospital Anxiety and Depression Scale) and client-specified three main problems rated by severity. We studied the mechanism of change using the Social Problem-Solving Inventory. Costs were identified using the Client Service Receipt Inventory and quality of life was identified by the European Quality of Life-5 Dimensions questionnaire. Research assistants blinded to treatment allocation collected follow-up information.There were 739 people referred for the trial and 444 were eligible. More adverse events in the PEPS arm led to a halt to recruitment after 306 people were randomised (90% of planned sample size); 154 participants received PEPS and 152 received usual treatment. The mean age was 38 years and 67% were women. Follow-up at 72 weeks after randomisation was completed for 62% of participants in the usual-treatment arm and 73% in the PEPS arm. Intention-to-treat analyses compared individuals as randomised, regardless of treatment received or availability of 72-week follow-up SFQ data. Median attendance at psychoeducation sessions was approximately 90% and for problem-solving sessions was approximately 50%. PEPS therapy plus usual treatment was no more effective than usual treatment alone for the primary outcome [adjusted difference in means for SFQ -0.73 points, 95% confidence interval (CI) -1.83 to 0.38 points; p = 0.19], any of the secondary outcomes or social problem-solving. Over the follow-up, PEPS costs were, on average, £182 less than for usual treatment. It also resulted in 0.0148 more quality-adjusted life-years. Neither difference was statistically significant. At the National Institute for Health and Care Excellence thresholds, the intervention had a 64% likelihood of being the more cost-effective option. More adverse events, mainly incidents of self-harm, occurred in the PEPS arm, but the difference was not significant (adjusted incidence rate ratio 1.24, 95% CI 0.93 to 1.64).There was possible bias in adverse event recording because of dependence on self-disclosure or reporting by the clini...

show abstract

“…Los factores inherentes a la estrategia, como la fidelidad (definida como el grado en el cual la implementación de la intervención se ajustó a lo planeado) (22),y sus dimensiones (cumplimiento, dosis, calidad de la entrega, responsabilidad de los participantes y diferenciación del programa) (21), deben evaluarse como indicadores de proceso de la estrategia de difusión. De acuerdo con este tipo de aproximaciones, se encuentra que las estrategias innovadoras o diseños originales, como el reporte situacional de dengue en este estudio, pueden contar con tres tipos de modificaciones que alteren el resultado de su aplicación: 1) se omite un componente o se modifica y no se logra llevar a cabo el programa planeado; 2) uno de los componentes es implementado con mayores o menores modificaciones mientras se continúa desarrollando el programa original, o 3) se adicionan actividades o componentes a la estrategia (23,24).…”

Section: Discussionunclassified

Difusión masiva de reportes situacionales sobre dengue: efectos de la intervención en Guadalajara de Buga, Colombia

et al. 2012

View full text Add to dashboard Cite

Contribución de los autores:Todos los autores participaron en el diseño del estudio del estudio, en el análisis de la información y en la escritura del manuscrito. ARTÍCULO ORIGINAL Biomédica 2013;33(Supl. Introducción. La retroalimentación a las comunidades de la situación de dengue en su localidad, podría ser útil para mantener la motivación para su participación en el control del dengue y disminuir los índices entomológicos de Aedes. Objetivos. Evaluar la cobertura y el alcance de una intervención basada en la difusión masiva de reportes situacionales sobre el dengue y su efecto en la presencia de criaderos intradomiciliarios de Aedes spp. en Guadalajara de Buga, Colombia. Materiales y métodos. Se llevó a cabo un estudio observacional de corte transversal en 1.426 viviendas, para establecer la presencia de criaderos intradomiciliarios y caracterizar la exposición a la intervención. El efecto de la intervención se evaluó en un estudio de casos y controles. Los casos obedecieron al total de viviendas con criaderos positivos y, entre las viviendas sin criaderos positivos ubicadas en la misma manzana del caso, se seleccionaron aleatoriamente cuatro controles por caso.Resultados. El índice de viviendas positivas fue de 2,5 %. La cobertura fue del 59,4 % y el alcance del 22,3 %. El contacto con la intervención no se asoció con la ausencia de criaderos intradomiciliarios positivos. La presencia de matas con agua o floreros se asoció con criaderos positivos (p=0,01) y el uso de anjeos se consideró como factor protector (p=0,02). Conclusiones. Aunque la cobertura de la intervención fue adecuada, no se observó que tuviera efecto sobre la ausencia de criaderos intradomiciliarios positivos. Por lo tanto, se requiere la evaluación de la intervención en términos de su fidelidad, diseño y proceso de implementación. Introduction: Maintaining communities abreast of their local dengue situation could help to keep them motivated to participate in dengue control and to decrease Aedes entomological indexes. Objectives: To evaluate the coverage and reach of an intervention based on mass-media communication of dengue surveillance reports and its effect on the presence of intra-domiciliary breeding sites for Aedes in Guadalajara de Buga, Colombia. Materials and methods: An observational cross-sectional study was conducted in 1,426 households to identify the intra-domiciliary breeding sites and to characterize the intervention exposure. To evaluate the effect of the intervention, a case-control study was performed. All households with positive breeding sites were considered as cases. Four controls per case were randomly selected among the non-positive breeding site households located on the same block of the case. Results: The positive house index was 2.5%; coverage was 59.4% and reach was 22.3%. There was no association between the intervention and the presence of intra-domiciliary breeding sites. The presence of water plants and flower pots were associated to positive breeding sites (p=0.01) and the use of screens was associated ...

show abstract

Fidelity Criteria: Development, Measurement, and Validation

Cited by 640 publications

References 54 publications

Using Indices of Fidelity to Intervention Core Components to Identify Program Active Ingredients

Using Indices of Fidelity to Intervention Core Components to Identify Program Active Ingredients

Psychoeducation with problem-solving (PEPS) therapy for adults with personality disorder: a pragmatic randomised controlled trial to determine the clinical effectiveness and cost-effectiveness of a manualised intervention to improve social functioning

Difusión masiva de reportes situacionales sobre dengue: efectos de la intervención en Guadalajara de Buga, Colombia

Contact Info

Product

Resources

About