Inter-rater reliability of a newly developed gait analysis and motion score

Abstract

Background: Gait analysis constitutes an essential part of orthopedic rehabilitation assessment. Previous studies indicate that observational-based gait analysis lacks reliability and requires extensive clinical training. Therefore, gait analysis in the clinical practice heavily relies on technical aids. The aim of the present study is to develop a reliable gait analysis assessment tool that can accurately assess clinically relevant gait cycle parameters in daily clinical practice. Methods: In this pilot study, a new gait analysis and motion score (GAMS), comprising 10 observational and 5 technically measured (e.g. pressure plate) gait parameters, was developed. The parameters were dichotomously operationalized, reflecting pathological versus physiological manifestations of the parameters. The rating algorithm was administered by 12 raters using videotaped treadmill sessions of 10 orthopedic subjects ( n = 120 ratings). Inter-rater reliability was calculated using the intraclass correlation coefficient (ICC) and the percentage of rating agreement. Results: The mean (standard deviation (SD)) GAMS ratings ranged from 10.0 (1.1) to 21.5 (1.3) points. The overall GAMS ICC was 0.98 (95% confidence interval (CI) 0.96–1.00), whereas the ICC of observational parameters alone was 0.97 (95% CI 0.93–0.99). The mean (SD) percentage of rating agreement was 86.1% (3.3%). For the observational parameters, the mean (SD) rating agreement was 82.5% (4.5%). Conclusion: This new GAMS shows excellent overall inter-rater reliability for a continuum of functional gait statuses. The new score may be an appropriate clinical tool to objectively evaluate patients’ gait patterns. Furthermore, the GAMS may find application as a clinician-reported outcome measure in orthopedic rehabilitation. Further studies are required to verify the validity and accuracy of the new GAMS and its functionality in assessing clinical changes in gait patterns.

Inter-Rater and Intra-Rater Reliability of Return-to-Work Screening Tests for UK Firefighters Following Injury

“…The results estimated that a sample size of thirty-five would be required to establish inter-rater and intra-rater reliability (H0 = 0.00, H1 = 0.70, α = 0.05, single tail, power = 0.95) [ 30 ]. To allow for attrition, we increased this estimated sample size by 10% and rounded up to the nearest whole number [ 31 , 32 ], leaving a sample size of thirty-nine.…”