Looking for Consistency in an Uncertain World: Test-Retest Reliability of Neurophysiological and Behavioral Readouts in Autism

Abstract

BackgroundAutism spectrum disorders (ASD) are associated with altered sensory processing and perception. Scalp recordings of electrical brain activity time-locked to sensory events (event-related potentials; ERPs) provide precise information on the time-course of related altered neural activity, and can be used to model the cortical loci of the underlying neural networks. Establishing the test-retest reliability of these sensory brain responses in ASD is critical to their use as biomarkers of neural dysfunction in this population. MethodsEEG and behavioral data were acquired from 33 children diagnosed with ASD aged 6-9.4 years old, while they performed a child friendly task at two different time-points, separated by an average of 5.2 months. In two blocked conditions, participants responded to the occurrence of an auditory target that was either preceded or not by repeating visual stimuli. Intraclass correlation coefficients (ICC) were used to assess test-retest reliability of measures of sensory (auditory and visual) ERPs and performance, for the two experimental conditions. To assess the degree of reliability of the variability of responses within individuals, this analysis was performed on the variance of the measurements, in addition to their means. In total, this yielded a total of 25 measures for which ICCs were calculated. ResultsThe data yielded significant good-to-excellent ICCs for 15 of the 25 measurements. These spanned across behavioral and ERPs data, experimental conditions, and mean as well as variance measures. Measures of the visual evoked responses accounted for a disproportionately large number of the significant ICCs. ConclusionsThis analysis reveals that sensory ERPs and related behavior can be highly reliable across multiple measurement time-points in ASD. The data further suggest that the inter-trial and inter-participant variability reported in the ASD literature likely often represents replicable individual participant neural processing differences. The stability of these neuronal readouts supports their use as biomarkers in clinical and translational studies on ASD. Given the minimum interval between test/retest sessions across our cohort, we also conclude that for the tested age-range of ~6 to 9.4 years these reliability measures are valid for at least a 3-month interval.

Attentional Influences on Neural Processing of Biological Motion in Typically Developing Children and Those on the Autism Spectrum

“…Thus, although emerging evidence highlights possible differences in neural mechanisms of biological motion processing in ASD, as well as potential implications for social function, a high degree of inconsistency in ndings makes it di cult to draw de nitive conclusions. Variability in ndings cannot be accounted for by within-subject unreliability as several studies have shown that behavioral and electrophysiologic responses to visual paradigms are highly consistent within individuals on repeated measures (45,46). Instead, potential mediators of such study heterogeneity may include betweensubjects developmental, cognitive and/or attentional factors.…”