SummaryData analysis workflows in many scientific domains have become increasingly complex and flexible. To assess the impact of this flexibility on functional magnetic resonance imaging (fMRI) results, the same dataset was independently analyzed by 70 teams, testing nine ex-ante hypotheses. The flexibility of analytic approaches is exemplified by the fact that no two teams chose identical workflows to analyze the data. This flexibility resulted in sizeable variation in hypothesis test results, even for teams whose statistical maps were highly correlated at intermediate stages of their analysis pipeline. Variation in reported results was related to several aspects of analysis methodology. Importantly, meta-analytic approaches that aggregated information across teams yielded significant consensus in activated regions across teams. Furthermore, prediction markets of researchers in the field revealed an overestimation of the likelihood of significant findings, even by researchers with direct knowledge of the dataset. Our findings show that analytic flexibility can have substantial effects on scientific conclusions, and demonstrate factors related to variability in fMRI. The results emphasize the importance of validating and sharing complex analysis workflows, and demonstrate the need for multiple analyses of the same data. Potential approaches to mitigate issues related to analytical variability are discussed.
During wakeful rest, individuals make small eye movements during fixation. We examined how these endogenously-driven oculomotor patterns impact topography and topology of functional brain networks. We used a dataset consisting of eyes-open resting-state (RS) fMRI data with simultaneous eye-tracking (Nilsonne et al., 2016). The eye-tracking data indicated minor movements during rest, which correlated modestly with RS BOLD data. However, eye-tracking data correlated well with echo-planar imaging time series sampled from the area of the Eye-Orbit (EO-EPI), which is a signal previously used to identify eye movements during exogenous saccades and movie viewing. Further analyses showed that EO-EPI data were correlated with activity in an extensive motor and sensory-motor network, including components of the dorsal attention network and the frontal eye fields. Partialling out variance related to EO-EPI from RS data reduced connectivity, primarily between sensory-motor and visual areas. It also produced networks with higher modularity, lower mean connectivity strength, and lower mean clustering coefficient. Our results highlight new aspects of endogenous eye movement control during wakeful rest. They show that oculomotor-related contributions form an important component of RS network topology, and that those should be considered in interpreting differences in network structure between populations, or as a function of different experimental conditions.
In the past three decades, multiple studies revealed that congenital blindness is associated with functional and structural reorganization in early visual areas and its interaction with other neural systems. Among the most reproducible findings is the weaker connectivity between the visual and sensorimotor cortices, which in sighted individuals plays a role in eye-motor coordination. Here we demonstrate an important exception to this reorganization phenomena: we find that in congenitally blind individuals (as for normally sighted ones), spontaneous, non-controlled eye movements correlate with connectivity between visual and sensorimotor cortices. Furthermore, using time-lagged regression, we show that eye movements drive activity in the visual cortex, which subsequently drives sensorimotor activity. Remarkably, this phenomenon persists even though blind participants often exhibit unsynchronized eye movements and cannot sense or regulate their eye positions. These findings provide evidence of a preserved, "non-functional" connectivity in congenitally blind individuals and reveal a firm, hard-wired constraint on connectivity that remains immune to any reorganization phenomena produced by lack of visual experience and oculomotor control.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.