The perception of emotions by ear and by eye

Social interaction contexts bias the perceived expressions of interactants.

“…For example, the same facial expression varies in appearance when presented in the context of different body postures (Aviezer, Trope, & Todorov, 2012). The perceived expression of a target face is also affected by vocal cues (de Gelder & Vroomen, 2000), concurrently presented visual scenes (Righart & de Gelder, 2008), and surrounding faces (in Japanese, but not Western participants; Masuda et al, 2008). The influence of context often occurs despite explicit instructions to disregard extraneous information (Aviezer, Bentin, Dudarev, & Hassin, 2011).…”

Crossmodal transfer of emotion by music

“…visual)? Research on crossmodal integration of auditory and visual emotions [5] shows that rating of affective information in one sensory modality can be biased towards the direction of the emotional valence of information in another sensory modality. Event-related-potential (ERP) studies presenting emotionally congruent and incongruent face-voice pairs reveal early ERP effects (N1, P2 components) for congruent face-voice pairs, suggesting an early interaction between auditory and visual emotional stimuli [15,22].…”

“…Earlier research [5,22] reported that emotions in auditory stimuli interact with emotions in visual stimuli for simultaneously presented auditory-visual stimuli. But our result extends it further by showing that such interaction could also occur for non-simultaneous processing, i.e.…”

The vocal communication of different kinds of smile

“…Affect is expressed throughout the body (Trevarthen & Malloch, 2000), and is detectable through different senses (De Gelder & Vroomen, 2000;Scherer et al, 1986). Therefore, different channels (or modes) of expression are likely to be involved in a single communicative act.…”