Tutorial on use of intraclass correlation coefficients for assessing intertest reliability and its application in functional near-infrared spectroscopy–based brain imaging

Li, Lin; Zeng, Li; Lin, Zi Jing; Cazzell, Mary; Liu, Hanli

doi:10.1117/1.jbo.20.5.050801

Cited by 63 publications

(70 citation statements)

References 44 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Between-day test-retest reliability of the metrics was evaluated for centre B through the intra-class correlation coefficients (ICCs) with a 95% confidence interval (CI). ICCs were calculated using a two-way random-effect model and absolute agreement (ICC2,k) [64]. An ICC lower than 0.39 was classified as poor, an ICC between 0.40 and 0.59 as fair, an ICC between 0.60 and 0.74 as moderate, and an ICC greater than 0.75 as excellent [65].…”

Section: Discussionmentioning

confidence: 99%

Is a Wearable Sensor-Based Characterisation of Gait Robust Enough to Overcome Differences Between Measurement Protocols? A Multi-Centric Pragmatic Study in Patients with Multiple Sclerosis

Angelini

Carpinella

Cattaneo

et al. 2019

Sensors

View full text Add to dashboard Cite

Inertial measurement units (IMUs) allow accurate quantification of gait impairment of people with multiple sclerosis (pwMS). Nonetheless, it is not clear how IMU-based metrics might be influenced by pragmatic aspects associated with clinical translation of this approach, such as data collection settings and gait protocols. In this study, we hypothesised that these aspects do not significantly alter those characteristics of gait that are more related to quality and energetic efficiency and are quantifiable via acceleration related metrics, such as intensity, smoothness, stability, symmetry, and regularity. To test this hypothesis, we compared 33 IMU-based metrics extracted from data, retrospectively collected by two independent centres on two matched cohorts of pwMS. As a worst-case scenario, a walking test was performed in the two centres at a different speed along corridors of different lengths, using different IMU systems, which were also positioned differently. The results showed that the majority of the temporal metrics (9 out of 12) exhibited significant between-centre differences. Conversely, the between-centre differences in the gait quality metrics were small and comparable to those associated with a test-retest analysis under equivalent conditions. Therefore, the gait quality metrics are promising candidates for reliable multi-centric studies aiming at assessing rehabilitation interventions within a routine clinical context.

show abstract

Section: Discussionmentioning

confidence: 99%

Is a Wearable Sensor-Based Characterisation of Gait Robust Enough to Overcome Differences Between Measurement Protocols? A Multi-Centric Pragmatic Study in Patients with Multiple Sclerosis

Angelini

Carpinella

Cattaneo

et al. 2019

Sensors

View full text Add to dashboard Cite

show abstract

“…As our aim was to assess the test-retest reliability of these measures, we calculated intraclass correlation coefficients (ICCs) comparing Session 1 and Session 2 networks. See Li, Zeng, Lin, Cazzell, and Liu (2015) for an introduction to the use of this statistic in the context of brain imaging. There are a total of six distinct statistical models sharing the ICC name, with the complete taxonomy first described by Shrout & Fleiss (1979).…”

Section: Statistical Analysesmentioning

confidence: 99%

Reliability of graph metrics derived from resting‐state human EEG

Kuntzelman

Miskovic

2016

Psychophysiology

View full text Add to dashboard Cite

It is increasingly appreciated that a complete description of brain functioning will necessarily involve the characterization of large-scale interregional temporal synchronization of neuronal assemblies. The need to capture the dynamic formation of such large-scale networks has yielded a renewed interest in the human EEG in combination with a suite of methods for estimating functional connectivity along with the graph theoretical approaches for characterizing network structure. While initial work has established generally good reproducibility for a limited selection of these graph theoretical measures, there remains an obvious need to document the reproducibility of a more extensive array of commonly used graph metrics. We sought to evaluate the test-retest reliability of a much richer suite of graph theoretic measures as applied to weighted networks derived from high-density resting-state human EEG. Our findings were promising overall, with some important qualifications when considering the frequency bands of interest and the method used to calculate functional connectivity as well as some substantial variance between individual graph metrics. In general, the reliability of networks in the α and β frequency bands was improved when functional connectivity was defined solely on the basis of relative phase distributions. In the δ and θ bands, reliability was substantially better when functional connectivity was based on coherence, which incorporates both phase and amplitude information.

show abstract

“…[1][2][3][4] The reliability of fNIRS hemodynamic measures is good to excellent (for review see Ref. 5). Test-retest performance has been examined in different conditions and age groups.…”

Section: Introductionmentioning

confidence: 99%

Test–retest reliability of brain mitochondrial cytochrome-c-oxidase assessed by functional near-infrared spectroscopy

Holper

Mann

2018

J. Biomed. Opt.

View full text Add to dashboard Cite

Test-retest reliability of brain mitochondrial cytochrome-c-oxidase assessed by functional near-infrared spectroscopy," J.Abstract. Functional near-infrared spectroscopy (fNIRS) is a noninvasive method for measuring in vivo both hemodynamic and mitochondrial metabolic activities in brain cortical structures. Although the test-retest reliability of the hemodynamic measures, such as reflected by oxygenated (HbO 2 ), deoxygenated (HHb) hemoglobin, and the tissue oxygenation index (TOI), has been previously reported to be good to excellent, the reliability of the metabolic signal indexed by oxidized cytochrome-c-oxidase (oxCCO) has not been reported. The present testretest study compared the reliability of the metabolic and hemodynamic signals in 10 healthy participants undergoing hypo-and hypercapnia challenges. The primary reliability measure was the intraclass correlation coefficient (ICC). Results of both hypo-and hypercapnia showed that the oxCCO signal (ICC ¼ 0.876∕0.757) had robust reliability comparable with that of the HbO 2 (ICC ¼ 0.841∕0.801), HHb (ICC ¼ 0.804∕0.571), and TOI (ICC ¼ 0.574∕0.614) signals. These findings show that the oxCCO signal can be assessed by fNIRS with comparable reliability to the hemodynamic measures. We discuss the results in light of current interest in a mitochondrial metabolic marker derived from fNIRS.

show abstract

Tutorial on use of intraclass correlation coefficients for assessing intertest reliability and its application in functional near-infrared spectroscopy–based brain imaging

Cited by 63 publications

References 44 publications

Is a Wearable Sensor-Based Characterisation of Gait Robust Enough to Overcome Differences Between Measurement Protocols? A Multi-Centric Pragmatic Study in Patients with Multiple Sclerosis

Is a Wearable Sensor-Based Characterisation of Gait Robust Enough to Overcome Differences Between Measurement Protocols? A Multi-Centric Pragmatic Study in Patients with Multiple Sclerosis

Reliability of graph metrics derived from resting‐state human EEG

Test–retest reliability of brain mitochondrial cytochrome-c-oxidase assessed by functional near-infrared spectroscopy

Contact Info

Product

Resources

About