For many practitioners in schools and clinics, collecting data to show the effectiveness of an intervention is probably one of the most important yet challenging components of intervention implementation. This article provides practitioners with an example case study of how data can be organized and collected to determine the effectiveness of a social skills group intervention. Techniques to establish individual and group goals, determine a method to collect data, collect baseline data, and monitor progress are described. Challenges and practical strategies are discussed, and useful and specific suggestions are provided.
BackgroundResearch and clinical practice rely heavily on caregiver-report measures, such as the Child Behavior Checklist 1.5-5 (CBCL/1.5-5), to gather information about early childhood behavior problems and to screen for clinically significant behavior problems. While studies have shown that demographic variables influence ratings of behavior problems, the extent to which the CBCL/1.5-5 functions equivalently at the item level across diverse samples is unknown.MethodsItem-level data of CBCL/1.5-5 on a large sample of young children (N=7827) were drawn from 26 cohorts in the Environmental influences on Child Health Outcomes (ECHO) program. Factor analyses and the alignment method were applied to examine measurement invariance and differential item functioning (DIF) across child- (child age, sex, bilingual status, and neurodevelopmental disorders), and caregiver-level characteristics (caregiver sex, education level, household income level, and depression). Child race was examined in sensitivity analyses.ResultsItem sets with the most impactful DIF across child and caregiver groupings were identified for Internalizing, Externalizing, and Total Problems. The robust item sets, which excluded the high DIF items, showed good reliabilities and high correlations with the original scales for all three constructs. Language version of CBCL administration, caregiver education, and respondent sex showed the most significant impact on the measurement invariance, followed by child age. Sensitivity analyses revealed that child race has a unique impact on DIF over and above socioeconomic status.ConclusionsThe CBCL/1.5-5, a parent-report measure of early childhood behavior problems, showed bias across demographic groups. Robust item sets with less DIF can measure Internalizing, Externalizing, and Total Problems equally as well as the full item sets.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.