Naturalistic Stimuli in Affective Neuroimaging: A Review

Saarimäki, Heini

doi:10.3389/fnhum.2021.675068

Cited by 66 publications

(70 citation statements)

References 195 publications

(433 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Video stimuli allowed us to present a narrative context that contributes to elicit different emotions. Such stimuli allow us to better understand the neural mechanisms underlying emotions and also enable us to better generalize to real-life contexts (Saarimäki, 2021). However, our feelings may change as we watch a video or a movie and elicit multiple emotions (Raz et al, 2016).…”

Section: Discussionmentioning

confidence: 99%

“…However, our feelings may change as we watch a video or a movie and elicit multiple emotions (Raz et al, 2016). This requires one to find the time at which emotion was experienced to isolate better the neural mechanisms specific to that emotional experience (Saarimäki, 2021). An important contribution of the study is the temporal localization of emotion experience to probe the frequency band that best captured the brain dynamics of such experiences.…”

Section: Discussionmentioning

confidence: 99%

“…The lack of context that may result in ambiguity is a problem with isolated stimuli like pictures (e.g., Ekman's face (Ekman and Friesen, 1971)) and sounds (e.g., oddball tones (Squires et al, 1975)). In contrast, emotional films provide a contextual and narrative structure for eliciting a more representative and better emotional experience (Saarimäki, 2021;Jääskeläinen et al, 2020). In addition, they may preserve the natural timing relations between the constituting functional components, which could be studied using EEG.…”

Section: Introductionmentioning

confidence: 99%

“…Even though multimodal film stimuli should be more effective in eliciting emotions (Saarimäki, 2021), EEG studies with such stimuli are very limited. Moreover, they did not probe felt emotions or limited themselves to very few emotional categories (Jessen and Kotz, 2011).…”

Section: Introductionmentioning

confidence: 99%

See 3 more Smart Citations

Manuscript

Mishra¹,

Srinivasan²,

Tiwary³

2022

Preprint

View full text Add to dashboard Cite

While naturalistic stimuli like movies better resemble the complexity of the real world and are perhaps crucial to understanding the dynamics of emotion processing, there is limited research on emotions with naturalistic stimuli. There is a need to understand the temporal dynamics of emotion processing and their relationship to different dimensions of emotion experience. In addition, there is a need to understand the dynamics of functional connectivity underlying different emotional experiences that occur during or prior to such experiences. To address these questions, we recorded EEG and asked participants to mark the temporal location of their emotional experience as they watched a video. We also obtained self-assessment ratings for emotional multimedia stimuli. We obtained dynamic functional connectivity (DFC) patterns in all the frequency bands. We also performed regression analysis to evaluate whether temporal variability in DFC (tvDFC) could predict different dimensions of emotional experience. We observed that the connectivity patterns in the upper beta band could differentiate emotion categories better during or prior to the reported emotional experience. The functional connectivity dynamics is primarily related to emotional arousal followed by dominance. The hubs in the functional networks were found across the right frontal and bilateral parietal lobes, which have been reported to facilitate affect, interoception, action and memory related processing. The results support constructivist theories of emotional experience and show that changes in dynamic functional connectivity can predict aspects of our emotional experience.

show abstract

Section: Discussionmentioning

confidence: 99%

Section: Discussionmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

See 2 more Smart Citations

Manuscript

Mishra¹,

Srinivasan²,

Tiwary³

2022

Preprint

View full text Add to dashboard Cite

show abstract

“…Videos are arguably more ecologically valid, and permit greater compliance in the scanner (Eickhoff, Milham, & Vanderwal, 2020; Vanderwal, Eilbott, & Castellanos, 2019) making them an ideal candidate to use for developmental and clinical samples (e.g., Richardson, 2019). While vfMRI data can be analyzed using conventional task‐ and connectivity‐ based approaches, a distinct analysis approach that is based on measuring similarity or synchrony among participant brain responses has gained prominence (Saarimäki, 2021). This inter‐subject correlation‐based approach (ISC; Hasson et al, 2004) presents its own distinct analytic requirements due to the dependencies inherent in similarity measurements (Chen et al, 2016; Nastase, Gazzola, Hasson, & Keysers, 2019).…”

Section: Introductionmentioning

confidence: 99%

Video‐evoked fMRI BOLD responses are highly consistent across different data acquisition sites

Byrge

Kliemann

et al. 2022

Human Brain Mapping

View full text Add to dashboard Cite

Naturalistic imaging paradigms, in which participants view complex videos in the scanner, are increasingly used in human cognitive neuroscience. Videos evoke temporally synchronized brain responses that are similar across subjects as well as within subjects, but the reproducibility of these brain responses across different data acquisition sites has not yet been quantified. Here, we characterize the consistency of brain responses across independent samples of participants viewing the same videos in functional magnetic resonance imaging (fMRI) scanners at different sites (Indiana University and Caltech). We compared brain responses collected at these different sites for two carefully matched datasets with identical scanner models, acquisition, and preprocessing details, along with a third unmatched dataset in which these details varied. Our overall conclusion is that for matched and unmatched datasets alike, video‐evoked brain responses have high consistency across these different sites, both when compared across groups and across pairs of individuals. As one might expect, differences between sites were larger for unmatched datasets than matched datasets. Residual differences between datasets could in part reflect participant‐level variability rather than scanner‐ or data‐ related effects. Altogether our results indicate promise for the development and, critically, generalization of video fMRI studies of individual differences in healthy and clinical populations alike.

show abstract

Neural signatures of shared subjective affective engagement and disengagement during movie viewing

Nanni‐Zepeda,

DeGutis,

et al. 2024

Human Brain Mapping

View full text Add to dashboard Cite

When watching a negative emotional movie, we differ from person to person in the ease with which we engage and the difficulty with which we disengage throughout a temporally evolving narrative. We investigated neural responses of emotional processing, by considering inter‐individual synchronization in subjective emotional engagement and disengagement. The neural underpinnings of these shared responses are ideally studied in naturalistic scenarios like movie viewing, wherein individuals emotionally engage and disengage at their own time and pace throughout the course of a narrative. Despite the rich data that naturalistic designs can bring to the study, there is a challenge in determining time‐resolved behavioral markers of subjective engagement and disengagement and their underlying neural responses. We used a within‐subject cross‐over design instructing 22 subjects to watch clips of either neutral or sad content while undergoing functional magnetic resonance imaging (fMRI). Participants watched the same movies a second time while continuously annotating the perceived emotional intensity, thus enabling the mapping of brain activity and emotional experience. Our analyses revealed that between‐participant similarity in waxing (engagement) and waning (disengagement) of emotional intensity was directly related to the between‐participant similarity in spatiotemporal patterns of brain activation during the movie(s). Similar patterns of engagement reflected common activation in the bilateral ventromedial prefrontal cortex, regions often involved in self‐referenced evaluation and generation of negative emotions. Similar patterns of disengagement reflected common activation in central executive and default mode network regions often involved in top‐down emotion regulation. Together this work helps to better understand cognitive and neural mechanisms underpinning engagement and disengagement from emotionally evocative narratives.

show abstract

Naturalistic Stimuli in Affective Neuroimaging: A Review

Cited by 66 publications

References 195 publications

Manuscript

Manuscript

Video‐evoked fMRI BOLD responses are highly consistent across different data acquisition sites

Neural signatures of shared subjective affective engagement and disengagement during movie viewing

Contact Info

Product

Resources

About