Insights from functional Magnetic Resonance Imaging (fMRI), as well as recordings of large numbers of neurons, reveal that many cognitive, emotional, and motor functions depend on the multivariate interactions of brain signals. To decode brain dynamics, we propose an architecture based on recurrent neural networks to uncover distributed spatiotemporal signatures. We demonstrate the potential of the approach using human fMRI data during movie-watching data and a continuous experimental paradigm. The model was able to learn spatiotemporal patterns that supported 15-way movie-clip classification (∼90%) at the level of brain regions, and binary classification of experimental conditions (∼60%) at the level of voxels. The model was also able to learn individual differences in measures of fluid intelligence and verbal IQ at levels comparable to that of existing techniques. We propose a dimensionality reduction approach that uncovers low-dimensional trajectories and captures essential informational (i.e., classification related) properties of brain dynamics. Finally, saliency maps and lesion analysis were employed to characterize brain-region/voxel importance, and uncovered how dynamic but consistent changes in fMRI activation influenced decoding performance. When applied at the level of voxels, our framework implements a dynamic version of multivariate pattern analysis. Our approach provides a framework for visualizing, analyzing, and discovering dynamic spatially distributed brain representations during naturalistic conditions.
Insights from functional Magnetic Resonance Imaging (fMRI), as well as recordings of large numbers of neurons, reveal that many cognitive, emotional, and motor functions depend on the multivariate interactions of brain signals. To decode brain dynamics, we propose an architecture based on recurrent neural networks to uncover distributed spatiotemporal signatures. We demonstrate the potential of the approach using human fMRI data during movie-watching data and a continuous experimental paradigm. The model was able to learn spatiotemporal patterns that supported 15-way movie-clip classification (~90%) at the level of brain regions, and binary classification of experimental conditions (~60%) at the level of voxels. The model was also able to learn individual differences in measures of fluid intelligence and verbal IQ at levels comparable or better than existing techniques. We propose a dimensionality reduction approach that uncovers low-dimensional trajectories and captures essential informational (i.e., classification related) properties of brain dynamics. Finally, saliency maps were employed to characterize brain-region/voxel importance, and uncovered how dynamic but consistent changes in fMRI activation influenced decoding performance. When applied at the level of voxels, our framework implements a dynamic version of multivariate pattern analysis. We believe our approach provides a powerful framework for visualizing, analyzing, and discovering dynamic spatially distributed brain representations during naturalistic conditions.
Over the last decade there has been growing interest in understanding the brain activity in the absence of any task or stimulus captured by the resting-state functional magnetic resonance imaging (rsfMRI). These resting state patterns are not static, but exhibit complex spatio-temporal dynamics. In the recent years substantial effort has been put to characterize different FC configurations while brain states makes transitions over time. The dynamics governing this transitions and their relationship with stationary functional connectivity remains elusive. Over the last years a multitude of methods has been proposed to discover and characterize FC dynamics and one of the most accepted method is sliding window approach. Moreover, as these FC configurations are observed to be cyclically repeating in time there was further motivation to use of a generic clustering scheme to identify latent states of dynamics. We discover the underlying lower-dimensional manifold of the temporal structure which is further parameterized as a set of local density distributions, or latent transient states.We propose an innovative method that learns parameters specific to these latent states using a graph-theoretic model (temporal Multiple Kernel Learning, tMKL) and finally predicts the grand average functional connectivity (FC) of the unseen subjects by leveraging a state transition Markov model. tMKL thus learns a mapping between the underlying anatomical network and the temporal structure. Training and testing were done using the rs-fMRI data of 46 healthy participants and the results establish the viability of the proposed solution. Parameters of the model are learned via state-specific optimization formulations and yet the model performs at par or better than state-of-the-art models for predicting the grand average FC. Moreover, the model shows sensitivity towards subject-specific anatomy. The proposed model performs significantly better than the established models of predicting resting state functional connectivity based on whole-brain dynamic mean-field model, single diffusion kernel model and another version of multiple kernel learning model. In summary, We provide a novel solution that does not make strong assumption about underlying data and is generally applicable to resting or task data to learn subject specific state transitions and successful characterization of SC-dFC-FC relationship through an unifying framework.Since its discovery over two decades ago, there has been a keen interest in 2 investigating the spontaneous intrinsic activity of the human brain. This ac-3 tivity is measured via slow fluctuations in the functional magnetic resonance 4 images (fMRI) when subjects are at rest and not engaged in any task [1]. These 5 fluctuations are highly correlated and discovery of meaningful large-scale func-6 tional networks within these correlations led to the use of resting-state fMRI 7 (rsfMRI) to discover human brain function(s) [2, 3]. The resulting matrix of 8 pairwise correlations between regions of interest (ROIs) is t...
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.
hi@scite.ai
10624 S. Eastern Ave., Ste. A-614
Henderson, NV 89052, USA
Copyright © 2024 scite LLC. All rights reserved.
Made with 💙 for researchers
Part of the Research Solutions Family.