Semantic scene-object consistency modulates N300/400 EEG components, but does not automatically facilitate object representations

Chen, Lixiang; Cichy, Radoslaw Martin; Kaiser, Daniel

doi:10.1093/cercor/bhab433

Cited by 14 publications

(14 citation statements)

References 49 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…For each classification, a maximum of 144 trials (some trials were removed during preprocessing) were included in the training set (18 trials for each stimulus) and 16 trials were used for testing (2 trials for each stimulus). Before classification, principal component analysis (PCA) was applied to reduce the dimensionality of the data (Chen et al, 2022). Specifically, for each classification, PCA was performed on the training data, and the PCA solution was projected onto the testing data.…”

Section: Eeg Decoding Analysismentioning

confidence: 99%

Alpha-frequency feedback to early visual cortex orchestrates coherent naturalistic vision

Chen

Cichy

Kaiser

2023

Preprint

Self Cite

View full text Add to dashboard Cite

For coherent visual experience to emerge, the brain needs to spatially integrate the complex and dynamic information it receives from the environment. To meet this challenge, the visual system uses contextual information from one part of the visual field to create feedback signals that guide analysis in other parts of the visual field. Here, we set out to characterize the nature of this feedback across brain rhythms and cortical regions. In EEG and fMRI experiments, we experimentally recreated the spatially distributed nature of visual inputs by presenting natural videos at different visual field locations. Critically, we manipulated the spatiotemporal congruency of the videos, so that they did or did not demand integration into a coherent percept. Decoding stimulus information from frequency-specific EEG patterns revealed a shift from representations in feedforward-related gamma activity for spatiotemporally inconsistent videos to representations in feedback-related alpha activity for spatiotemporally consistent videos. Our fMRI data suggest high-level scene-selective areas as the putative source of this feedback. Combining the EEG data with spatially resolved fMRI recordings, we demonstrate that alpha-frequency feedback is directly associated with representations in early visual cortex. Together this demonstrates how the human brain orchestrates coherent visual experience across space: it uses feedback to integrate information from high-level to early visual cortex through a dedicated rhythmic code in the alpha frequency range.

show abstract

Section: Eeg Decoding Analysismentioning

confidence: 99%

Alpha-frequency feedback to early visual cortex orchestrates coherent naturalistic vision

Chen

Cichy

Kaiser

2023

Preprint

Self Cite

View full text Add to dashboard Cite

show abstract

“…For each classification, a maximum of 144 trials (some trials were removed during preprocessing) were included in the training set (18 trials for each stimulus) and 16 trials were used for testing (2 trials for each stimulus). Before classification, principal components analysis (PCA) was applied to reduce the dimensionality of the data ( 63 ). Specifically, for each classification, PCA was performed on the training data, and the PCA solution was projected onto the testing data.…”

Section: Methodsmentioning

confidence: 99%

Alpha-frequency feedback to early visual cortex orchestrates coherent naturalistic vision

Chen,

Cichy,

Kaiser

2023

Sci. Adv.

Self Cite

View full text Add to dashboard Cite

During naturalistic vision, the brain generates coherent percepts by integrating sensory inputs scattered across the visual field. Here, we asked whether this integration process is mediated by rhythmic cortical feedback. In electroencephalography (EEG) and functional magnetic resonance imaging (fMRI) experiments, we experimentally manipulated integrative processing by changing the spatiotemporal coherence of naturalistic videos presented across visual hemifields. Our EEG data revealed that information about incoherent videos is coded in feedforward-related gamma activity while information about coherent videos is coded in feedback-related alpha activity, indicating that integration is indeed mediated by rhythmic activity. Our fMRI data identified scene-selective cortex and human middle temporal complex (hMT) as likely sources of this feedback. Analytically combining our EEG and fMRI data further revealed that feedback-related representations in the alpha band shape the earliest stages of visual processing in cortex. Together, our findings indicate that the construction of coherent visual experiences relies on cortical feedback rhythms that fully traverse the visual hierarchy.

show abstract

“…Segments of data were considered significantly different if the two conditions (intact vs scrambled) were different for more than 25 ms, i.e. > 13 consecutive time-points (Chen et al 2021 ).…”

Section: Methodsmentioning

confidence: 99%

Automatic Brain Categorization of Discrete Auditory Emotion Expressions

Talwar,

Barbero,

Calce

et al. 2023

Brain Topogr

View full text Add to dashboard Cite

Seamlessly extracting emotional information from voices is crucial for efficient interpersonal communication. However, it remains unclear how the brain categorizes vocal expressions of emotion beyond the processing of their acoustic features. In our study, we developed a new approach combining electroencephalographic recordings (EEG) in humans with a frequency-tagging paradigm to ‘tag’ automatic neural responses to specific categories of emotion expressions. Participants were presented with a periodic stream of heterogeneous non-verbal emotional vocalizations belonging to five emotion categories: anger, disgust, fear, happiness and sadness at 2.5 Hz (stimuli length of 350 ms with a 50 ms silent gap between stimuli). Importantly, unknown to the participant, a specific emotion category appeared at a target presentation rate of 0.83 Hz that would elicit an additional response in the EEG spectrum only if the brain discriminates the target emotion category from other emotion categories and generalizes across heterogeneous exemplars of the target emotion category. Stimuli were matched across emotion categories for harmonicity-to-noise ratio, spectral center of gravity and pitch. Additionally, participants were presented with a scrambled version of the stimuli with identical spectral content and periodicity but disrupted intelligibility. Both types of sequences had comparable envelopes and early auditory peripheral processing computed via the simulation of the cochlear response. We observed that in addition to the responses at the general presentation frequency (2.5 Hz) in both intact and scrambled sequences, a greater peak in the EEG spectrum at the target emotion presentation rate (0.83 Hz) and its harmonics emerged in the intact sequence in comparison to the scrambled sequence. The greater response at the target frequency in the intact sequence, together with our stimuli matching procedure, suggest that the categorical brain response elicited by a specific emotion is at least partially independent from the low-level acoustic features of the sounds. Moreover, responses at the fearful and happy vocalizations presentation rates elicited different topographies and different temporal dynamics, suggesting that different discrete emotions are represented differently in the brain. Our paradigm revealed the brain’s ability to automatically categorize non-verbal vocal emotion expressions objectively (at a predefined frequency of interest), behavior-free, rapidly (in few minutes of recording time) and robustly (with a high signal-to-noise ratio), making it a useful tool to study vocal emotion processing and auditory categorization in general and in populations where behavioral assessments are more challenging.

show abstract

Semantic scene-object consistency modulates N300/400 EEG components, but does not automatically facilitate object representations

Cited by 14 publications

References 49 publications

Alpha-frequency feedback to early visual cortex orchestrates coherent naturalistic vision

Alpha-frequency feedback to early visual cortex orchestrates coherent naturalistic vision

Alpha-frequency feedback to early visual cortex orchestrates coherent naturalistic vision

Automatic Brain Categorization of Discrete Auditory Emotion Expressions

Contact Info

Product

Resources

About