Math curriculum-based measurement (CBM) is an essential tool for multi-tiered systems of support decision making, but the reliability of math CBMs has received little research, particularly using more rigorous methods such as generalizability (G) theory. Math CBM is historically organized into two domains: mastery measures and general outcome measures. This paper details 17 concurrent G and dependability studies in a partially crossed design investigating the reliability of mastery measure CBMs for students (N = 263) in Grades K, 1, 3, 5, and 7. This study extends prior research by including novel grade levels and more rigorous math content; using generated rather than static measures; embedding a replication; examining bias by race and sex; and evaluating a simpler scoring method of answers correct as compared to digits correct. Most of the variance in scores was accounted for by student. Probe form effects accounted for less than 5% of the variance for 16 of 17 measures and results replicated across days. G coefficients exceeded .75 on the first trial for 14 of 17 measures. G studies were repeated by race, sex, and scoring metric. Overall, 1–4 min of assessment was sufficient to meet reliability thresholds, which exceeds prior findings for general outcome measures. This study supports the reliability of mastery measurement in math CBM and as a precise tool to be used in the screening process.
Comparatively little research exists on single-skill math (SSM) curriculum-based measurements (CBMs) for the purpose of monitoring growth, as may be done in practice or when monitoring intervention effectiveness within group or single-case research. Therefore, we examined a common variant of SSM-CBM: 1 digit × 1 digit multiplication. Reflecting how such measures are often used in contemporary research and practice, we examined the comparative reliability of three representative SSM-CBM set sizes of 8, 16, and 32 unique problems. In a separate study, we investigated the possible benefit of stratifying problems within operation and probe relative to random assignment. Findings suggest that SSM-CBM slope reliability benefits from explicit stratification and that set size is a relevant consideration. Implications for the selection and interpretation of SSM-CBMs when engaging in practice and research are discussed.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.
customersupport@researchsolutions.com
10624 S. Eastern Ave., Ste. A-614
Henderson, NV 89052, USA
Copyright © 2024 scite LLC. All rights reserved.
Made with 💙 for researchers
Part of the Research Solutions Family.