No abstract

SummaryData analysis workflows in many scientific domains have become increasingly complex and flexible. To assess the impact of this flexibility on functional magnetic resonance imaging (fMRI) results, the same dataset was independently analyzed by 70 teams, testing nine ex-ante hypotheses. The flexibility of analytic approaches is exemplified by the fact that no two teams chose identical workflows to analyze the data. This flexibility resulted in sizeable variation in hypothesis test results, even for teams whose statistical maps were highly correlated at intermediate stages of their analysis pipeline. Variation in reported results was related to several aspects of analysis methodology. Importantly, meta-analytic approaches that aggregated information across teams yielded significant consensus in activated regions across teams. Furthermore, prediction markets of researchers in the field revealed an overestimation of the likelihood of significant findings, even by researchers with direct knowledge of the dataset. Our findings show that analytic flexibility can have substantial effects on scientific conclusions, and demonstrate factors related to variability in fMRI. The results emphasize the importance of validating and sharing complex analysis workflows, and demonstrate the need for multiple analyses of the same data. Potential approaches to mitigate issues related to analytical variability are discussed.

No abstract

White matter bundle segmentation using diffusion MRI fiber tractography has become the method of choice to identify white matter fiber pathways in vivo in human brains. However, like other analyses of complex data, there is considerable variability in segmentation protocols and techniques. This can result in different reconstructions of the same intended white matter pathways, which directly affects tractography results, quantification, and interpretation. In this study, we aim to evaluate and quantify the variability that arises from different protocols for bundle segmentation. Through an open call to users of fiber tractography, including anatomists, clinicians, and algorithm developers, 42 independent teams were given processed sets of human wholebrain streamlines and asked to segment 14 white matter fascicles on six subjects. In total, we received 57 different bundle segmentation protocols, which enabled detailed volume-based and streamline-based analyses of agreement and disagreement among protocols for each fiber pathway. Results show that even when given the exact same sets of underlying streamlines, the variability across protocols for bundle segmentation is greater than all other sources of variability in the virtual dissection process, including variability within protocols and variability across subjects. In order to foster the use of tractography bundle dissection in routine clinical settings, and as a fundamental analytical tool, future endeavors must aim to resolve and reduce this heterogeneity. Although external validation is needed to verify the anatomical accuracy of bundle dissections, reducing heterogeneity is a step towards reproducible research and may be achieved through the use of standard nomenclature and definitions of white matter bundles and well-chosen constraints and decisions in the dissection process.

Essential tremor (ET) is a neurological disease with both motor and nonmotor manifestations; however, little is known about its underlying brain basis. Furthermore, the overall organization of the brain network in ET remains largely unexplored. We investigated the topological properties of brain functional network, derived from resting‐state functional magnetic resonance imaging (MRI) data, in 23 ET patients versus 23 healthy controls. Graph theory analysis was used to assess the functional network organization. At the global level, the functional network of ET patients was characterized by lower small‐worldness values than healthy controls—less clustered functionality of the brain. At the regional level, compared with the healthy controls, ET patients showed significantly higher values of global efficiency, cost and degree, and a shorter average path length in the left inferior frontal gyrus (pars opercularis), right inferior temporal gyrus (posterior division and temporo‐occipital part), right inferior lateral occipital cortex, left paracingulate, bilateral precuneus bilaterally, left lingual gyrus, right hippocampus, left amygdala, nucleus accumbens bilaterally, and left middle temporal gyrus (posterior part). In addition, ET patients showed significant higher local efficiency and clustering coefficient values in frontal medial cortex bilaterally, subcallosal cortex, posterior cingulate cortex, parahippocampal gyri bilaterally (posterior division), right lingual gyrus, right cerebellar flocculus, right postcentral gyrus, right inferior semilunar lobule of cerebellum and culmen of vermis. Finally, the right intracalcarine cortex and the left orbitofrontal cortex showed a shorter average path length in ET patients, while the left frontal operculum and the right planum polare showed a higher betweenness centrality in ET patients. In conclusion, the efficiency of the overall brain functional network in ET is disrupted. Further, our results support the concept that ET is a disorder that disrupts widespread brain regions, including those outside of the brain regions responsible for tremor.