Major ingredients of fidelity: A review and scientific guide to improving quality of intervention research implementation

Gearing, Robin E.; El‐Bassel, Nabila; Ghesquiere, Angela; Baldwin, Susanna; Gillies, John; Ngeow, Evelyn

doi:10.1016/j.cpr.2010.09.007

Cited by 453 publications

(551 citation statements)

References 25 publications

Supporting

Mentioning

522

Contrasting

Unclassified

Order By: Relevance

“…Intervention records (e.g., attendance or homework) were also used to measure engagement. Intervention records can be considered an objective measure of receipt (Gearing et al ., 2011; Rixon et al ., 2016) and participation (Saunders, Evans, & Joshi, 2005). However, these measures are limited by their inability to monitor how much participants understand and use the intervention.…”

Section: Discussionmentioning

confidence: 99%

“…This finding demonstrates that the reporting of psychometric qualities in the complex, face‐to‐face health behaviour change interventions included in this review, may not be as infrequent as previously suggested in different populations (Baer et al ., 2007; Breitenstein et al ., 2010; Maynard et al ., 2013; Rixon et al ., 2016). However, not all studies reported psychometric qualities, and fewer reported implementation qualities, despite the importance of psychometric and implementation qualities (Gearing et al ., 2011; Glasgow et al ., 2005; Holmbeck & Devine, 2009; Lohr, 2002; Stufflebeam, 2000). The reporting of psychometric and implementation qualities provides information which allows the reader to determine whether the findings are trustworthy and representative.…”

Section: Discussionmentioning

confidence: 99%

See 1 more Smart Citation

Measures of fidelity of delivery of, and engagement with, complex, face‐to‐face health behaviour change interventions: A systematic review of measure quality

Walton

Spector

Tombor

et al. 2017

British J Health Psychol

197

237

View full text Add to dashboard Cite

PurposeUnderstanding the effectiveness of complex, face‐to‐face health behaviour change interventions requires high‐quality measures to assess fidelity of delivery and engagement. This systematic review aimed to (1) identify the types of measures used to monitor fidelity of delivery of, and engagement with, complex, face‐to‐face health behaviour change interventions and (2) describe the reporting of psychometric and implementation qualities.MethodsElectronic databases were searched, systematic reviews and reference lists were hand‐searched, and 21 experts were contacted to identify articles. Studies that quantitatively measured fidelity of delivery of, and/or engagement with, a complex, face‐to‐face health behaviour change intervention for adults were included. Data on interventions, measures, and psychometric and implementation qualities were extracted and synthesized using narrative analysis.ResultsSixty‐six studies were included: 24 measured both fidelity of delivery and engagement, 20 measured fidelity of delivery, and 22 measured engagement. Measures of fidelity of delivery included observation (n = 17; 38.6%), self‐report (n = 15; 34%), quantitatively rated qualitative interviews (n = 1; 2.3%), or multiple measures (n = 11; 25%). Measures of engagement included self‐report (n = 18; 39.1%), intervention records (n = 11; 24%), or multiple measures (n = 17; 37%). Fifty‐one studies (77%) reported at least one psychometric or implementation quality; 49 studies (74.2%) reported at least one psychometric quality, and 17 studies (25.8%) reported at least one implementation quality.ConclusionFewer than half of the reviewed studies measured both fidelity of delivery of, and engagement with complex, face‐to‐face health behaviour change interventions. More studies reported psychometric qualities than implementation qualities. Interpretation of intervention outcomes from fidelity of delivery and engagement measurements may be limited due to a lack of reporting of psychometric and implementation qualities. Statement of contribution What is already known on this subject? Evidence of fidelity and engagement is needed to understand effectiveness of complex interventionsEvidence of fidelity and engagement are rarely reportedHigh‐quality measures are needed to measure fidelity and engagement What does this study add? Evidence that indicators of quality of measures are reported in some studiesEvidence that psychometric qualities are reported more frequently than implementation qualitiesA recommendation for intervention evaluations to report indicators of quality of fidelity and engagement measures

show abstract

Section: Discussionmentioning

confidence: 99%

Section: Discussionmentioning

confidence: 99%

Measures of fidelity of delivery of, and engagement with, complex, face‐to‐face health behaviour change interventions: A systematic review of measure quality

Walton

Spector

Tombor

et al. 2017

British J Health Psychol

197

237

View full text Add to dashboard Cite

show abstract

“…Treatment fidelity refers to the degree to which a particular program delivers the set of interventions and procedures as intended (Bond, Evans, Salyers & Kim, 2000;Gearing et al, 2011). Treatment fidelity, which includes program design and instructions, administering agents training, delivery, receipt and enactment (Belig et al, 2004) is not only essential for the effectiveness of the programs but also for conducting meaningful clinical trials of health, psychological and/or social interventions (Campbell et al, 2013;Gearing et al, 2011).…”

Section: Social Running Head: a Pilot Stress-management Program To mentioning

confidence: 99%

“…Treatment fidelity, which includes program design and instructions, administering agents training, delivery, receipt and enactment (Belig et al, 2004) is not only essential for the effectiveness of the programs but also for conducting meaningful clinical trials of health, psychological and/or social interventions (Campbell et al, 2013;Gearing et al, 2011). Therefore, the present paper aims to test the effectiveness of a psychological intervention designed to improve stress management in reducing sports injuries in young soccer players, paying particular attention to implementation issues such as controlling compliance and promoting staff, coaches and athletes' acceptance.…”

Section: Social Running Head: a Pilot Stress-management Program To mentioning

confidence: 99%

Effectiveness of a stress management pilot program aimed at reducing the incidence of sports injuries in young football (soccer) players

Zafra

Rubio

Ortega

et al. 2017

Physical Therapy in Sport

View full text Add to dashboard Cite

Esta es la versión de autor del artículo publicado en: This is an author produced version of a paper published in:Physical Therapy in Sport 24 (2017) Effectiveness of a stress management pilot program aimed at reducing the incidence of sports injuries in young football (soccer) players ABSTRACT Objectives: Several attempts to reduce the incidence of sport injuries using psychosocial interventions produced fruitful, although inconclusive results. This paper presents the effectiveness and implementation issues of a pilot 3-month stress-management and muscle relaxation program aimed at reducing sport injury incidence.Design: Pre-post treatment-non treatment group comparison.Program administration: The program was administered by a trained psychologist on a once-a-week, one-hour session basis.Participants: Seventy-four male soccer players from four National Youth league teams voluntarily participated. Teams were randomly assigned to either treatment/ non-treatment group.Measures: Injury protocol, Self-monitoring cards, Athletes' satisfaction and commitment survey, Coaches' interview.Results: Group main effect and Time-Group interaction effect were both statistically significant, F(1,60) = 8.30, p = .005,  2 p = .121, with the average number of injuries larger in the post-treatment phase of Non-treatment group (p = .005,  2 p = .077).There was a significant decrease in the average number of injuries for the RUNNING HEAD: A PILOT STRESS-MANAGEMENT PROGRAM TO REDUCE SPORT INJURIES 2 intervention group before and after implementing the program (p < .001,  2 p = .309).Conclusions: A controlled implementation of a psychosocial program was effective in reducing youth soccer sport injuries, with a high level of satisfaction and commitment from the athletes, as well as high acceptance from the coaches.

show abstract

“…The second objective was to assess the reliability and validity of the ACFC. While there are many facets to assessing fidelity [5,6,[19][20][21], the focus of this study was on developing an assessment instrument specifically focused on the delivery of a behavioral intervention for weight management.…”

Section: Introductionmentioning

confidence: 99%

Development and validation of the ASPIRE-VA coaching fidelity checklist (ACFC): a tool to help ensure delivery of high-quality weight management interventions

Damschroder

Goodrich

Kim

et al. 2015

Behav. Med. Pract. Policy Res.

View full text Add to dashboard Cite

Practical and valid instruments are needed to assess fidelity of coaching for weight loss. The purpose of this study was to develop and validate the ASPIRE Coaching Fidelity Checklist (ACFC). Classical test theory guided ACFC development. Principal component analyses were used to determine item groupings. Psychometric properties, internal consistency, and inter-rater reliability were evaluated for each subscale. Criterion validity was tested by predicting weight loss as a function of coaching fidelity. The final 19-item ACFC consists of two domains (session process and session structure) and five subscales (sets goals and monitor progress, assess and personalize self-regulatory content, manages the session, creates a supportive and empathetic climate, and stays on track). Four of five subscales showed high internal consistency (Cronbach alphas>0.70) for group-based coaching; only two of five subscales had high internal reliability for phone-based coaching. All five sub-scales were positively and significantly associated with weight loss for group-but not for phone-based coaching. The ACFC is a reliable and valid instrument that can be used to assess fidelity and guide skill-building for weight management interventionists.

show abstract

Major ingredients of fidelity: A review and scientific guide to improving quality of intervention research implementation

Cited by 453 publications

References 25 publications

Measures of fidelity of delivery of, and engagement with, complex, face‐to‐face health behaviour change interventions: A systematic review of measure quality

Measures of fidelity of delivery of, and engagement with, complex, face‐to‐face health behaviour change interventions: A systematic review of measure quality

Effectiveness of a stress management pilot program aimed at reducing the incidence of sports injuries in young football (soccer) players

Development and validation of the ASPIRE-VA coaching fidelity checklist (ACFC): a tool to help ensure delivery of high-quality weight management interventions

Contact Info

Product

Resources

About