Research has found disturbing long-term effects of poor parenting on children's behavioral health including addiction, delinquency, depression/anxiety, and poorer health as adults. Poor parenting practices thus contribute substantially to the health crisis in America. However, skilled, nurturing parents, or caretakers can help youth avoid these developmental problems. A number of family and parenting evidence-based interventions (EBIs) that teach parenting skills are now available for dissemination. Unfortunately, replications of EBIs do not always produce the original positive results. Organizations that seek to use family EBIs to improve parenting and family skills need to avoid practices that create replication failure. We examine several possible factors that contribute to replication failure using examples from five replications of the EBI "Iowa Strengthening Families Program for ages 10-14." We then share six strategies conducive to avoid replication failures including (1) choosing the right program and implementation strategy for the population, (2) administering the right "dosage," (3) choosing and properly training implementers, (4) maintaining program integrity and adherence, (5) ensuring cultural sensitivity, and (6) ensuring accurate and complete reporting of evaluation results. These guidelines can advance prevention science to meet the demands of a growing public health agenda.

No abstract

Background Family-based drug prevention programs that use group-based formats with trained facilitators, such as the Strengthening Families Program (SFP), are effective in preventing underage drinking and youth drug use. However, these programs are resource-intensive and have high costs and logistical demands. Tailoring them for Web-based delivery is more cost-effective and makes it easier to scale these programs for widespread dissemination. This requires the active involvement of all key stakeholders to determine content and delivery format. Objective The aim was to obtain consumer, agency stakeholder, and expert input into the design of a Web-based parenting skills training and youth drug prevention program. Methods We conducted 10 focus groups with 85 adults (range 4-10, average 8 per group), 20 stakeholder interviews with family services agency staff, and discussed critical design considerations with 10 prevention scientists and e-learning experts to determine the optimal program content and technology features for SFP Online. Focus group participants also answered survey questions on perceived barriers to use, desired navigational features, preferred course format, desired content, preferred reward structures, course length, interactive components, computer efficacy, and technology use. Descriptive statistics were used to examine consumer characteristics; linear regression was used to examine relations between SFP exposure and four continuous outcome measures, including desired program content, interactive technology, and concerns that may inhibit future use of SFP Online. Logistic regression was used as a binary measure of whether consumers desired fun games in the SFP Online program. Results Three broad thematic categories emerged from the qualitative interviews enumerating the importance of (1) lesson content, (2) logistics for program delivery, and (3) multimedia interactivity. Among the many significant relations, parents who viewed more SFP lessons reported more reasons to use an online program (beta=1.48, P=.03) and also wanted more interactivity (6 lessons: beta=3.72, P=.01; >6 lessons: beta=2.39, P=.01), parents with less interest in a mixed delivery format (class and online) reported fewer reasons to use the online program (beta=−3.93, P=.01), comfort using computers was negatively associated with concerns about the program (beta=−1.83, P=.01), having mobile phone access was related to fewer concerns about online programs (beta=−1.63, P=.02), willingness to view an online program using a mobile phone was positively associated with wanting more online components (beta=1.95, P=.02), and parents who wanted fun games wanted more interactivity (beta=2.28, P=.01). Conclusions Formative evaluation based on user-centered approaches can provide rich information that fuels development of an online program. The user-centered strategies in this study lay the foundation for improving SFP Online and provide a means to accommodate user interests and ensure the product serves as an effective prevention tool that is attractive to consumers, engaging, and can overcome some of the barriers to recruitment and retention that have previously affected program outcomes in family-based prevention.

BackgroundThe Strengthening Families Program (SFP) is an evidence-based parent training and youth life skills and drug prevention program traditionally delivered in group settings. Families attend parent and youth classes conducted by trained facilitators. Recently, a 2-disk home-use DVD series was created with the same SFP skills as the group classes for parents and the youth to watch together at home. Additional lesson material was added that included healthy brain development, school success, anger management, dangers of alcohol and drugs, and mindfulness. The SFP DVD reduces SFP delivery costs for agencies and logistic burdens to families. Creative applications of the DVD include holding SFP DVD family discussion groups of multiple families and using SFP DVD video clips as part of a shorter 10-week group class version for parents and the youth.ObjectiveThis study aimed to examine three different DVD implementation scenarios using a noninferiority trial, contrasting target outcomes with an age-matched sample culled from a national norm database of families who completed a standard SFP 14-week class.MethodsThe partial eta-square was used to compare effect sizes between the different delivery modalities for relevant programmatic outcomes. We adjusted the effect sizes by demographic measures to determine whether there were site-specific features influencing program outcomes.ResultsFor the unadjusted effect size comparisons, 13 of the 15 indicated that the home-use DVD outperformed group norms with an average 0.13 effect size estimate difference across the comparisons (28% improvement in the effect size for DVD condition). Comparisons of the home-use DVD condition with the mixed DVD use conditions showed no discernable pattern where one condition consistently outperformed another. Adjusted effect sizes still reinforced the superiority of the DVD conditions; however, there was some shrinkage in the effect sizes as expected with the inclusion of relevant covariates.ConclusionsThe home-use DVD shows that it is possible to effectively deliver an affordable family-based intervention using alternative technology outside of the traditional group-based class format. In almost all of the comparisons, the DVD conditions outperformed the group norms, underscoring that low-cost DVDs or viewing the videos on the Web may provide a useful surrogate for costly group-based formats. Future studies may want to improve on the quasi-experimental design by examining programmatic differences based on delivery format using a randomized controlled trial, thus strengthening the causal framework regarding program effects. In addition, the assessment protocol relied on retrospective reporting, which, although this can limit response shift bias, does not separate data collection in time as with a true pre- and posttest design.

BACKGROUND The Strengthening Families Program (SFP) is an evidence-based parent training and youth life skills and drug prevention program traditionally delivered in group settings. Families attend parent and youth classes conducted by trained facilitators. Recently, a 2-disk home-use DVD series was created with the same SFP skills as the group classes for parents and the youth to watch together at home. Additional lesson material was added that included healthy brain development, school success, anger management, dangers of alcohol and drugs, and mindfulness. The SFP DVD reduces SFP delivery costs for agencies and logistic burdens to families. Creative applications of the DVD include holding SFP DVD family discussion groups of multiple families and using SFP DVD video clips as part of a shorter 10-week group class version for parents and the youth. OBJECTIVE This study aimed to examine three different DVD implementation scenarios using a noninferiority trial, contrasting target outcomes with an age-matched sample culled from a national norm database of families who completed a standard SF<italic>P</italic> 14-week class. METHODS The partial eta-square was used to compare effect sizes between the different delivery modalities for relevant programmatic outcomes. We adjusted the effect sizes by demographic measures to determine whether there were site-specific features influencing program outcomes. RESULTS For the unadjusted effect size comparisons, 13 of the 15 indicated that the home-use DVD outperformed group norms with an average 0.13 effect size estimate difference across the comparisons (28% improvement in the effect size for DVD condition). Comparisons of the home-use DVD condition with the mixed DVD use conditions showed no discernable pattern where one condition consistently outperformed another. Adjusted effect sizes still reinforced the superiority of the DVD conditions; however, there was some shrinkage in the effect sizes as expected with the inclusion of relevant covariates. CONCLUSIONS The home-use DVD shows that it is possible to effectively deliver an affordable family-based intervention using alternative technology outside of the traditional group-based class format. In almost all of the comparisons, the DVD conditions outperformed the group norms, underscoring that low-cost DVDs or viewing the videos on the Web may provide a useful surrogate for costly group-based formats. Future studies may want to improve on the quasi-experimental design by examining programmatic differences based on delivery format using a randomized controlled trial, thus strengthening the causal framework regarding program effects. In addition, the assessment protocol relied on retrospective reporting, which, although this can limit response shift bias, does not separate data collection in time as with a true pre- and posttest design.