Asymptotic standard errors of intraclass correlation coefficients for two-way model

Almehrizi, Rashid S.; Emam, Mahmoud Mohamed

doi:10.1080/03610918.2021.1897624

Cited by 1 publication

(1 citation statement)

References 23 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Whether the numerical procedure we developed can be extended to multi-way ANOVA models, will require further investigation, as methods to construct confidence intervals are different in that case. 44 , 45 …”

Section: Discussionmentioning

confidence: 99%

Review of sample size determination methods for the intraclass correlation coefficient in the one-way analysis of variance model

Mondal,

Vanbelle,

Cassese

et al. 2024

Stat Methods Med Res

View full text Add to dashboard Cite

Reliability of measurement instruments providing quantitative outcomes is usually assessed by an intraclass correlation coefficient. When participants are repeatedly measured by a single rater or device, or, are each rated by a different group of raters, the intraclass correlation coefficient is based on a one-way analysis of variance model. When planning a reliability study, it is essential to determine the number of participants and measurements per participant (i.e. number of raters or number of repeated measurements). Three different sample size determination approaches under the one-way analysis of variance model were identified in the literature, all based on a confidence interval for the intraclass correlation coefficient. Although eight different confidence interval methods can be identified, Wald confidence interval with Fisher’s large sample variance approximation remains most commonly used despite its well-known poor statistical properties. Therefore, a first objective of this work is comparing the statistical properties of all identified confidence interval methods—including those overlooked in previous studies. A second objective is developing a general procedure to determine the sample size using all approaches since a closed-form formula is not always available. This procedure is implemented in an R Shiny app. Finally, we provide advice for choosing an appropriate sample size determination method when planning a reliability study.

show abstract

Section: Discussionmentioning

confidence: 99%