SummaryData analysis workflows in many scientific domains have become increasingly complex and flexible. To assess the impact of this flexibility on functional magnetic resonance imaging (fMRI) results, the same dataset was independently analyzed by 70 teams, testing nine ex-ante hypotheses. The flexibility of analytic approaches is exemplified by the fact that no two teams chose identical workflows to analyze the data. This flexibility resulted in sizeable variation in hypothesis test results, even for teams whose statistical maps were highly correlated at intermediate stages of their analysis pipeline. Variation in reported results was related to several aspects of analysis methodology. Importantly, meta-analytic approaches that aggregated information across teams yielded significant consensus in activated regions across teams. Furthermore, prediction markets of researchers in the field revealed an overestimation of the likelihood of significant findings, even by researchers with direct knowledge of the dataset. Our findings show that analytic flexibility can have substantial effects on scientific conclusions, and demonstrate factors related to variability in fMRI. The results emphasize the importance of validating and sharing complex analysis workflows, and demonstrate the need for multiple analyses of the same data. Potential approaches to mitigate issues related to analytical variability are discussed.
Dynamic autoregulation of cerebral hemodynamics in healthy humans is studied using the novel methodology of the Laguerre-Volterra network for systems with fast and slow dynamics (Mitsis, G. D., and V. Z. Marmarelis, Ann. Biomed. Eng. 30:272-281, 2002). Since cerebral autoregulation is mediated by various physiological mechanisms with significantly different time constants, it is used to demonstrate the efficacy of the new method. Results are presented in the time and frequency domains and reveal that cerebral autoregulation is a nonlinear and dynamic (frequency-dependent) system with considerable nonstationarities. Quantification of the latter reveals greater variability in specific frequency bands for each subject in the low and middle frequency range (below 0.1 Hz). The nonlinear dynamics are prominent also in the low and middle frequency ranges, where the frequency response of the system exhibits reduced gain.
Highlights:• Physiological response functions () vary considerably across subjects/sessions• Scan-specific curves can be obtained from data records longer than 5 minutes• The shape of the cardiac response function is linked to the mean heart rate (HR)• Brain regions affected by HR and breathing patterns exhibit substantial overlap• HR and breathing patterns affect distinct regions as compared to cardiac pulsatility
The effects of orthostatic stress, induced by lower body negative pressure (LBNP), on cerebral hemodynamics were examined in a nonlinear context. Spontaneous fluctuations of beat-to-beat mean arterial blood pressure (MABP) in the finger, mean cerebral blood flow velocity (MCBFV) in the middle cerebral artery, as well as breath-by-breath end-tidal CO2 concentration (P(ET(CO2))) were measured continuously in 10 healthy subjects under resting conditions and during graded LBNP to presyncope. A two-input nonlinear Laguerre-Volterra network model was employed to study the dynamic effects of MABP and P(ET(CO2)) changes, as well as their nonlinear interactions, on MCBFV variations in the very low (VLF; below 0.04 Hz), low (LF; 0.04-0.15 Hz), and high frequency (HF; 0.15-0.30 Hz) ranges. Dynamic cerebral autoregulation was described by the model terms corresponding to MABP, whereas cerebral vasomotor reactivity was described by the model P(ET(CO2)) terms. The nonlinear model terms reduced the output prediction normalized mean square error substantially (by 15-20%) and had a prominent effect in the VLF range, both under resting conditions and during LBNP. Whereas MABP fluctuations dominated in the HF range and played a significant role in the VLF and LF ranges, changes in P(ET(CO2)) accounted for a considerable fraction of the VLF and LF MCBFV variations, especially at high LBNP levels. The magnitude of the linear and nonlinear MABP-MCBFV Volterra kernels increased substantially above -30 mmHg LBNP in the VLF range, implying impaired dynamic autoregulation. In contrast, the magnitude of the P(ET(CO2))-MCBFV kernels reduced during LBNP at all frequencies, suggesting attenuated cerebral vasomotor reactivity under dynamic conditions. We speculate that these changes may reflect a progressively reduced cerebrovascular reserve to compensate for the increasingly unstable systemic circulation during orthostatic stress that could ultimately lead to cerebral hypoperfusion and syncope.
Transfer function analysis (TFA) is a frequently used method to assess dynamic cerebral autoregulation (CA) using spontaneous oscillations in blood pressure (BP) and cerebral blood flow velocity (CBFV). However, controversies and variations exist in how research groups utilise TFA, causing high variability in interpretation. The objective of this study was to evaluate between-centre variability in TFA outcome metrics. 15 centres analysed the same 70 BP and CBFV datasets from healthy subjects (n = 50 rest; n = 20 during hypercapnia); 10 additional datasets were computer-generated. Each centre used their in-house TFA methods; however, certain parameters were specified to reduce a priori between-centre variability. Hypercapnia was used to assess discriminatory performance and synthetic data to evaluate effects of parameter settings. Results were analysed using the Mann–Whitney test and logistic regression. A large non-homogeneous variation was found in TFA outcome metrics between the centres. Logistic regression demonstrated that 11 centres were able to distinguish between normal and impaired CA with an AUC > 0.85. Further analysis identified TFA settings that are associated with large variation in outcome measures. These results indicate the need for standardisation of TFA settings in order to reduce between-centre variability and to allow accurate comparison between studies. Suggestions on optimal signal processing methods are proposed.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.