Modulation of spatial attention to visual targets by emotional environmental sounds.

Harrison, Neil; Davies, Simon

doi:10.3922/j.psns.2013.3.02

Cited by 10 publications

(7 citation statements)

References 27 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…To the best of our knowledge, evidence that emotion cues from the auditory modality can also influence non-emotional (basic) visual information processing is nearly missing. One study investigated the influence of emotional sounds on visual attention in a spatial cueing paradigm ( Harrison and Davies, 2013 ). Here, non-speech environmental sounds from the IADS were presented spatially matched to the locations of subsequent visual targets.…”

Section: Audio–visual Interactionsmentioning

confidence: 99%

Emotional pictures and sounds: a review of multimodal interactions of emotion cues in multiple domains

2014

View full text Add to dashboard Cite

In everyday life, multiple sensory channels jointly trigger emotional experiences and one channel may alter processing in another channel. For example, seeing an emotional facial expression and hearing the voice’s emotional tone will jointly create the emotional experience. This example, where auditory and visual input is related to social communication, has gained considerable attention by researchers. However, interactions of visual and auditory emotional information are not limited to social communication but can extend to much broader contexts including human, animal, and environmental cues. In this article, we review current research on audiovisual emotion processing beyond face-voice stimuli to develop a broader perspective on multimodal interactions in emotion processing. We argue that current concepts of multimodality should be extended in considering an ecologically valid variety of stimuli in audiovisual emotion processing. Therefore, we provide an overview of studies in which emotional sounds and interactions with complex pictures of scenes were investigated. In addition to behavioral studies, we focus on neuroimaging, electro- and peripher-physiological findings. Furthermore, we integrate these findings and identify similarities or differences. We conclude with suggestions for future research.

show abstract

Section: Audio–visual Interactionsmentioning

confidence: 99%

Emotional pictures and sounds: a review of multimodal interactions of emotion cues in multiple domains

2014

View full text Add to dashboard Cite

show abstract

“…Based on prior studies on the modulation of spatial attention to visual targets by auditory stimuli (Harrison and Davies, 2013;Wang et al, 2019a;Evans, 2020) and a power analysis using G * Power Version 3.1.9.2 (Faul et al, 2007) conducted for a repeated measurement ANOVA to detect a medium interaction effect of f = 0.25 with a statistical power of 0.95 and a significance level of 0.05, we aimed to recruit a sample size that included a minimum of 36 participants.…”

Section: Experiments 2 Methods Participantsmentioning

confidence: 99%

“…If you hear the familiar call of friends, you will immediately look toward them with a smile. In other words, sounds serve as warnings or rewarding signals in daily life that can be critical for survival and finetune our actions (Harrison and Davies, 2013;Gerdes et al, 2020;McDougall et al, 2020). A recent study has investigated auditory attentional bias employing white noise as negative auditory cue (Wang et al, 2019a), but white noise lacks ecological validity.…”

Section: Attentional Bias For Positive Emotional Stimulimentioning

confidence: 99%

Auditory and cross-modal attentional bias toward positive natural sounds: Behavioral and ERP evidence

Wang

Tang

Zhang

et al. 2022

Front. Hum. Neurosci.

View full text Add to dashboard Cite

Recently, researchers have expanded the investigation into attentional biases toward positive stimuli; however, few studies have examined attentional biases toward positive auditory information. In three experiments, the present study employed an emotional spatial cueing task using emotional sounds as cues and auditory stimuli (Experiment 1) or visual stimuli (Experiment 2 and Experiment 3) as targets to explore whether auditory or visual spatial attention could be modulated by positive auditory cues. Experiment 3 also examined the temporal dynamics of cross-modal auditory bias toward positive natural sounds using event-related potentials (ERPs). The behavioral results of the three experiments consistently demonstrated that response times to targets were faster after positive auditory cues than they were after neutral auditory cues in the valid condition, indicating that healthy participants showed a selective auditory attentional bias (Experiment 1) and cross-modal attentional bias (Experiment 2 and Experiment 3) toward positive natural sounds. The results of Experiment 3 showed that N1 amplitudes were more negative after positive sounds than they were after neutral sounds, which further provided electrophysiological evidence that positive auditory information enhances attention at early stages in healthy adults. The results of the experiments performed in the present study suggest that humans exhibit an attentional bias toward positive natural sounds.

show abstract

“…However, when emotionally valenced stimuli were auditorily presented, recognition of visually presented neutral stimuli was enhanced ( Zeelenberg and Bocanegra, 2010 ). Furthermore, another study found behavioral effects of emotional sounds on visual processing only when visual items were presented on the right visual hemifield 2 ( Harrison and Davies, 2013 ; see Brosch et al, 2008 for a study in which emotionally valenced pseudowords were used). Thus, these studies suggest that auditory emotional stimuli affect visual processing.…”

Section: Introductionmentioning

confidence: 99%

“… 2 It is worth clarifying at this point that in Table 1 in Gerdes et al (2014) , the study by Harrison and Davies (2013 , p. 5) is perhaps mistakenly cited as an example of no influence of emotional sounds on a visual task but in the text this mistake is not present. …”

mentioning

confidence: 99%

Cross-modal metaphorical mapping of spoken emotion words onto vertical space

et al. 2015

View full text Add to dashboard Cite

From the field of embodied cognition, previous studies have reported evidence of metaphorical mapping of emotion concepts onto a vertical spatial axis. Most of the work on this topic has used visual words as the typical experimental stimuli. However, to our knowledge, no previous study has examined the association between affect and vertical space using a cross-modal procedure. The current research is a first step toward the study of the metaphorical mapping of emotions onto vertical space by means of an auditory to visual cross-modal paradigm. In the present study, we examined whether auditory words with an emotional valence can interact with the vertical visual space according to a ‘positive-up/negative-down’ embodied metaphor. The general method consisted in the presentation of a spoken word denoting a positive/negative emotion prior to the spatial localization of a visual target in an upper or lower position. In Experiment 1, the spoken words were passively heard by the participants and no reliable interaction between emotion concepts and bodily simulated space was found. In contrast, Experiment 2 required more active listening of the auditory stimuli. A metaphorical mapping of affect and space was evident but limited to the participants engaged in an emotion-focused task. Our results suggest that the association of affective valence and vertical space is not activated automatically during speech processing since an explicit semantic and/or emotional evaluation of the emotionally valenced stimuli was necessary to obtain an embodied effect. The results are discussed within the framework of the embodiment hypothesis.

show abstract

Modulation of spatial attention to visual targets by emotional environmental sounds.

Cited by 10 publications

References 27 publications

Emotional pictures and sounds: a review of multimodal interactions of emotion cues in multiple domains

Emotional pictures and sounds: a review of multimodal interactions of emotion cues in multiple domains

Auditory and cross-modal attentional bias toward positive natural sounds: Behavioral and ERP evidence

Cross-modal metaphorical mapping of spoken emotion words onto vertical space

Contact Info

Product

Resources

About