Topographic Mapping of a Hierarchy of Temporal Receptive Windows Using a Narrated Story

Lerner, Yulia; Honey, Christopher J.; Silbert, Lauren J.; Hasson, Uri

doi:10.1523/jneurosci.3684-10.2011

Cited by 714 publications

(1,034 citation statements)

References 52 publications

(55 reference statements)

Supporting

144

Mentioning

881

Contrasting

Order By: Relevance

“…This suggests that the extensive shared brain responses seen during narrative speech comprehension are tied to the content of the story. This finding also reinforces previous findings that demonstrate that shared meaningless auditory input (e.g., reversed speech) does not result in the extensive reliable activity shared across listeners during the comprehension of meaningful auditory input (18). Moreover, the opposite is also true: Shared content without shared form has been shown to evoke reliable responses in high-order brain areas but not in low-order brain areas, such as correlations found between Russian listeners who listened to a Russian story and English listeners who listened to a translation of the story (46).…”

Section: Reliability Of Brain Activity During Comprehension Is Tied Tsupporting

confidence: 91%

“…These results are in contrast to the extensive bilateral set of brain areas reported to be activated during speech comprehension (16)(17)(18). Moreover, during comprehension, long segments of real-life speech activate a set of extralinguistic midline areas, such as the precuneus and medial prefrontal areas (18,19). It is not known whether production of real-life speech will also recruit these extralinguistic areas.…”

contrasting

confidence: 61%

See 1 more Smart Citation

Coupled neural systems underlie the production and comprehension of naturalistic narrative speech

Silbert

Honey

Simony

et al. 2014

Proc. Natl. Acad. Sci. U.S.A.

315

245

View full text Add to dashboard Cite

Neuroimaging studies of language have typically focused on either production or comprehension of single speech utterances such as syllables, words, or sentences. In this study we used a new approach to functional MRI acquisition and analysis to characterize the neural responses during production and comprehension of complex real-life speech. First, using a time-warp based intrasubject correlation method, we identified all areas that are reliably activated in the brains of speakers telling a 15-min-long narrative. Next, we identified areas that are reliably activated in the brains of listeners as they comprehended that same narrative. This allowed us to identify networks of brain regions specific to production and comprehension, as well as those that are shared between the two processes. The results indicate that production of a real-life narrative is not localized to the left hemisphere but recruits an extensive bilateral network, which overlaps extensively with the comprehension system. Moreover, by directly comparing the neural activity time courses during production and comprehension of the same narrative we were able to identify not only the spatial overlap of activity but also areas in which the neural activity is coupled across the speaker's and listener's brains during production and comprehension of the same narrative. We demonstrate widespread bilateral coupling between production-and comprehension-related processing within both linguistic and nonlinguistic areas, exposing the surprising extent of shared processes across the two systems.speech production | speech comprehension | intersubject correlation | brain-to-brain coupling S uccessful verbal communication requires the finely orchestrated interaction between production-based processes in the speaker's brain and comprehension-based processes in the listener's brain. The extent of brain areas involved in the production of real-world speech in a speaker's brain during naturalistic communication is largely unknown. As a result, the degree of overlap between the production and comprehension systems, and the ways in which they interact, remain controversial. This study pursues three aims: (i) to map all areas (including but not limited to sensory, motoric, linguistic, and extralinguistic) that are reliably activated during the production of complex, real-world narrative; (ii) to map the overlap between areas that respond reliably during the production and the comprehension of real-world narrative; and (iii) to assess the coupling between activity in the speaker's brain during naturalistic production and activity in the listener's brain during comprehension of the same narrative. We discuss each challenge in turn.The functional-anatomic architecture underlying the production of speech in an ecological context is incompletely characterized. Studies investigating production-based brain activity have been mainly restricted to the production of single phonemes (1-5), words (6-8), or short phrases in decontextualized, isolated environments (9-13) (see refs. 14...

show abstract

Section: Reliability Of Brain Activity During Comprehension Is Tied Tsupporting

confidence: 91%

contrasting

confidence: 61%

Coupled neural systems underlie the production and comprehension of naturalistic narrative speech

Silbert

Honey

Simony

et al. 2014

Proc. Natl. Acad. Sci. U.S.A.

315

245

View full text Add to dashboard Cite

show abstract

“…A more limited dataset was also available for an audio narrative involving a live recording of stand‐up comedy ( Pieman , Jim O'Grady),34 in forward and backward playback (12 healthy controls and 19 DOC patients). Unlike the Alice stimulus, only one recording was available per subject in healthy controls and patient datasets (resulting is a total of 35 recordings).…”

Section: Resultsmentioning

confidence: 99%

Divergent neural responses to narrative speech in disorders of consciousness

Iotzov

Fidali

Petroni

et al. 2017

Ann Clin Transl Neurol

View full text Add to dashboard Cite

ObjectiveClinical assessment of auditory attention in patients with disorders of consciousness is often limited by motor impairment. Here, we employ intersubject correlations among electroencephalography responses to naturalistic speech in order to assay auditory attention among patients and healthy controls.MethodsElectroencephalographic data were recorded from 20 subjects with disorders of consciousness and 14 healthy controls during of two narrative audio stimuli, presented both forwards and time‐reversed. Intersubject correlation of evoked electroencephalography signals were calculated, comparing responses of both groups to those of the healthy control subjects. This analysis was performed blinded and subsequently compared to the diagnostic status of each patient based on the Coma Recovery Scale‐Revised.ResultsSubjects with disorders of consciousness exhibit significantly lower intersubject correlation than healthy controls during narrative speech. Additionally, while healthy subjects had higher intersubject correlation values in forwards versus backwards presentation, neural responses did not vary significantly with the direction of playback in subjects with disorders of consciousness. Increased intersubject correlation values in the backward speech condition were noted with improving disorder of consciousness diagnosis, both in cross‐sectional analysis and in a subset of patients with longitudinal data.InterpretationIntersubject correlation of neural responses to narrative speech audition differentiates healthy controls from patients and appears to index clinical diagnoses in disorders of consciousness.

show abstract

“…A recent line of research introduced the concept of temporal receptive windows -in analogy to spatial receptive fields -reflecting the time window in which previously presented information can affect the processing of a newly arriving stimulus [48][49][50][51][52][53]. The length of temporal receptive fields was found to vary hierarchically from primary sensory areas, tracking fast changes of a scene on the order of milliseconds to seconds, to transmodal association areas, which encode slowly changing states of the world, complex concepts and situations, and integrate information across seconds, minutes, or longer ( Figure 1D).…”

Section: A Temporal Hierarchy Links Structural Gradients and Functionmentioning

confidence: 99%

Large-Scale Gradients in Human Cortical Organization

Huntenburg

Bazin

Margulies

2018

Trends in Cognitive Sciences

723

738

View full text Add to dashboard Cite

Recent advances in mapping cortical areas in the human brain provide a basis for investigating the significance of their spatial arrangement. Here we describe a dominant gradient in cortical features that spans between sensorimotor and transmodal areas. We propose that this gradient constitutes a core organizing axis of the human cerebral cortex, and describe an intrinsic coordinate system on its basis. Studying the cortex with respect to these intrinsic dimensions can inform our understanding of how the spectrum of cortical function emerges from structural constraints. The Significance of Cortical LocationFor more than a century, neuroscientists have studied the cerebral cortex by delineating individual cortical areas (see Glossary) and mapping their function [1]. This agenda has substantially advanced in recent years, as automated parcellation methods improve and data sets of unprecedented size and quality become available [2][3][4]. Nevertheless, our understanding of how the complex structure of the cerebral cortex emerges and gives rise to its elaborate functions remains fragmentary. To complement the description of individual cortical areas, we propose an inquiry into the significance of their spatial arrangement, asking the basic question: Why are cortical areas located where they are?Early formulations of this question date to theories from classical neuroanatomy [1,[5][6][7]. They state that the spatial layout of cortical areas is not arbitrary, but a consequence of developmental mechanisms, shaped through evolutionary selection. The location of an area among its neighbors thus provides insight into its microstructural characteristics [6], its connections to other parts of the brain [7], and eventually its position in global processing hierarchies [8]. Consider, for example, the well-researched visual system of the macaque monkey [9,10]. Along the visual hierarchy, low-level visual features are increasingly abstracted and integrated with information from other systems. Traditionally, areas are ordered based on their degree of microstructural differentiation, and the classification of their connections as feedforward or feedback [11]. The framework we advocate emphasizes that an area's position in the visual processing hierarchy -and thus many of its microstructural and connectional features -is strongly related to its distance from the primary visual area [12,13].More generally, we propose that the spatial arrangement of areas along a global gradient between sensorimotor and transmodal regions is a key feature of human cortical organization. A gradient is an axis of variance in cortical features, along which areas fall in a spatially continuous order. Areas that resemble each other with respect to the feature of interest occupy similar positions along the gradient. As we will point out, there is a strong relationship between the similarity of two areas -that is, their relative position along the gradient -and their relative position along the cortical surface. This important role of cortical location pro...

show abstract

Topographic Mapping of a Hierarchy of Temporal Receptive Windows Using a Narrated Story

Cited by 714 publications

References 52 publications

Coupled neural systems underlie the production and comprehension of naturalistic narrative speech

Coupled neural systems underlie the production and comprehension of naturalistic narrative speech

Divergent neural responses to narrative speech in disorders of consciousness

Large-Scale Gradients in Human Cortical Organization

Contact Info

Product

Resources

About