Validation of an instrument to measure community capacity building for prevention

Abstract

Aim In Germany, the CTC-EFF (Effectiveness of the Community Prevention System Communities That Care) study, a replication study of the US Community Youth Development Study (CYDS), was rolled out in 2021. This article aims to examine the validity of a translated and adapted version of an instrument that measures five constructs of community capacity for prevention. Subject and methods Twenty-two a priori-matched intervention and comparison communities participated in the study. Two to ten community key informants (n = 182) were interviewed for each community. Exploratory (EFA) and confirmatory factor analyses (CFA) were conducted to assess structural validity. Reliability was assessed at the individual level using McDonald’s omega and at the community level using a generalizability coefficient (GC). Inter-rater agreement was measured using an intraclass correlation coefficient (ICC). Concurrent construct validity was assessed using bivariate correlations and mean comparisons. Results CFA showed good model fit (CFI = 0.964) for the hypothesized five constructs model. Reliability analyses showed good internal consistency at the individual level (omega = 0.86–0.87) and insufficient to moderate reliability at the community level (CG = 0.00–0.62). Inter-rater agreement ranged from insufficient to substantial (ICC = 0.02–0.32). Consistent with theory, three constructs correlated positively at the individual and community level (r = 0.24–0.42). There are no associations between these constructs and interviewer ratings about the respondents’ cooperativeness, trustworthiness, and understanding. Conclusion Three of the five constructs were measured with good validity. Two constructs show insufficient reliability. These will be revised until the next CTC-EFF data collection wave. Further validation is indicated. Trial registration This study was registered with the German Clinical Trial Register, no. DRKS00022819, on August 18, 2021.

Contextual effects of community capacity as a predictor for adolescent alcohol, tobacco, and illicit drug use: A multi-level analysis

“…To measure community capacity, a German context-adapted version of the Community Key Informant, obtained from the Community Youth Development Study (CYDS) ( Hawkins et al, 2008 ), was utilized. The translated and abbreviated version underwent cognitive pretesting, multiple loops of revision, and initial validation analyses ( Röding, Birgel, & Walter, 2023 )…”

Relating community capacity to the adoption of an evidence-based prevention strategy: a community-level analysis

“…The data collection was based on a translated and German context-adapted version of the Community Key Informant Interview obtained from the Community Youth Development Study (CYDS) (Hawkins et al 2008) (SDRG 2009). The translated and abbreviated version underwent cognitive pretesting and multiple loops of revision and initial validation analyses (Röding et al 2023). Drawing on CYDS, a twostage process was used to generate a sample of leaders in each of these communities (e.g., mayors, school principals, police officers, youth work leaders, or health officials).…”