Thought experiment: Decoding cognitive processes from the fMRI data of one individual

Abstract

Cognitive processes, such as the generation of language, can be mapped onto the brain using fMRI. These maps can in turn be used for decoding the respective processes from the brain activation patterns. Given individual variations in brain anatomy and organization, analyzes on the level of the single person are important to improve our understanding of how cognitive processes correspond to patterns of brain activity. They also allow to advance clinical applications of fMRI, because in the clinical setting making diagnoses for single cases is imperative. In the present study, we used mental imagery tasks to investigate language production, motor functions, visuo-spatial memory, face processing, and resting-state activity in a single person. Analysis methods were based on similarity metrics, including correlations between training and test data, as well as correlations with maps from the NeuroSynth meta-analysis. The goal was to make accurate predictions regarding the cognitive domain (e.g. language) and the specific content (e.g. animal names) of single 30-second blocks. Four teams used the dataset, each blinded regarding the true labels of the test data. Results showed that the similarity metrics allowed to reach the highest degrees of accuracy when predicting the cognitive domain of a block. Overall, 23 of the 25 test blocks could be correctly predicted by three of the four teams. Excluding the unspecific rest condition, up to 10 out of 20 blocks could be successfully decoded regarding their specific content. The study shows how the information contained in a single fMRI session and in each of its single blocks can allow to draw inferences about the cognitive processes an individual engaged in. Simple methods like correlations between blocks of fMRI data can serve as highly reliable approaches for cognitive decoding. We discuss the implications of our results in the context of clinical fMRI applications, with a focus on how decoding can support functional localization.

AT-NeuroEAE: A Joint Extraction Model of Events With Attributes for Research Sharing-Oriented Neuroimaging Provenance Construction

“…Neuroimaging texts, especially scientific articles, are growing fast. Taking only fMRI ( Wegrzyn et al, 2018 ) as an example, 307 relevant articles have been published in the journal PLOS ONE in 2020. These neuroimaging texts are valuable knowledge resources for studying human intelligence, pathological mechanism of brain and mental diseases, brain-computer interface, and so on.…”

An event based topic learning pipeline for neuroimaging literature mining

“…• Gross brain anatomy (GRO): 519 brain region terms were collected from the whole brain atlas 1 . They included brain anatomy terms such as "frontal gyri", "basic ganglia", "limbic", and other brain region terms such as Brodmann region.…”

“…Neuroimaging text mining is to extract knowledge from neuroimaging texts [1] and has received widespread attention. Shardlow et al [2] combined active learning and deep learning to recognize various neuroscience entities for curating research information in computational neuroscience.…”

An Event Based Topic Learning Pipeline for Neuroimaging Literature Mining

“…Neuroimaging text mining is to extract knowledge from neuroimaging text [1] and has received widespread attention. In neuroinformatics and computational neuroscience, Shardlow et al [2] combined active learning and deep learning to recognize various neuroscience entities for curating research information in computational neuroscience.…”