The Importance of Laughing in Your Face: Influences of Visual Laughter on Auditory Laughter Perception

Jordan, Timothy R.; Abedipour, Lily

doi:10.1068/p6752

Cited by 10 publications

(7 citation statements)

References 11 publications

(1 reference statement)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…For example, a beard may occlude much of the lower face, and the relevance of other facial areas (e.g., upper jaw/upper cheeks) may become greater than for other talkers. Moreover, speech may not be the only facial signal to tolerate substantial occlusion during social interaction, since the audibility of other socially significant facial signals, such as laughter, is also affected by seeing facial movement (Jordan & Abedipour, 2010). Indeed, laughter is often regarded as an evolutionary precursor to speech (e.g., Darwin, 1872;Niemitz, Loi, & Landerer, 2000;Provine, 2004), which may suggest that the tolerance of facial occlusion shown by speech perception has its origins at an evolutionarily earlier stage of human social communication that adapted to the demands of bimodal speech perception that eventually evolved.…”

mentioning

confidence: 99%

When half a face is as good as a whole: Effects of simple substantial occlusion on visual and audiovisual speech perception

Jordan

Thomas

2011

Atten Percept Psychophys

View full text Add to dashboard Cite

The visible movement of a talker's face is an influential component of speech perception. However, the ability of this influence to function when large areas of the face (~50%) are covered by simple substantial occlusions, and so are not visible to the observer, has yet to be fully determined. In Experiment 1, both visual speech identification and the influence of visual speech on identifying congruent and incongruent auditory speech were investigated using displays of a whole (unoccluded) talking face and of the same face occluded vertically so that the entire left or right hemiface was covered. Both the identification of visual speech and its influence on auditory speech perception were identical across all three face displays. Experiment 2 replicated and extended these results, showing that visual and audiovisual speech perception also functioned well with other simple substantial occlusions (horizontal and diagonal). Indeed, displays in which entire upper facial areas were occluded produced performance levels equal to those obtained with unoccluded displays. Occluding entire lower facial areas elicited some impairments in performance, but visual speech perception and visual speech influences on auditory speech perception were still apparent. Finally, implications of these findings for understanding the processes supporting visual and audiovisual speech perception are discussed.

show abstract

mentioning

confidence: 99%

When half a face is as good as a whole: Effects of simple substantial occlusion on visual and audiovisual speech perception

Jordan

Thomas

2011

Atten Percept Psychophys

View full text Add to dashboard Cite

show abstract

“…As supported by Equation (1), participants that experienced the lightscape in this condition showed weak sensitivity to soundscape perception. Equation (2) suggests that a perceived lightscape may enhance the perceived soundscape when eyes are open in the first condition, because perceived lightscape sensitivity may occupy the main cognitive resources, while the perceived soundscape may be a subsidiary cognition for the perceived lightscape, like a sense of background sound for visual perception [69]. The second condition, where L Aeq,5min variations were more than 1.24 dBA, was mostly in the morning and dusk, with active biophonies (e.g., birdsongs) present [16,70].…”

Section: Relationship Between the Sensitivity Of Perceived Soundscape And Lightscapementioning

confidence: 99%

Perceived Loudness Sensitivity Influenced by Brightness in Urban Forests: A Comparison When Eyes Were Opened and Closed

Hong

Wang

Liu

et al. 2020

Forests

View full text Add to dashboard Cite

Soundscape plays a positive, health-related role in urban forests, and there is a competitive allocation of cognitive resources between soundscapes and lightscapes. This study aimed to explore the relationship between perceived loudness sensitivity and brightness in urban forests through eye opening and closure. Questionnaires and measuring equipment were used to gather soundscape and lightscape information at 44 observation sites in urban forested areas. Diurnal variations, Pearson’s correlations, and formula derivations were then used to analyze the relationship between perception sensitivity and how perceived loudness sensitivity was influenced by lightscape. Our results suggested that soundscape variation plays a role in audio–visual perception in urban forests. Our findings also showed a gap in perception sensitivity between loudness and brightness, which conducted two opposite conditions bounded by 1.24 dBA. Furthermore, we found that the effect of brightness on perceived loudness sensitivity was limited if variations of brightness were sequential and weak. This can facilitate the understanding of individual perception to soundscape and lightscape in urban forests when proposing suitable design plans.

show abstract

“…It has been shown that speech and laughter become more intelligible, especially under noisy conditions, for humans when visual information is present [11], [12]. This finding has inspired research on audiovisual speech and emotion recognition.…”

Section: Introductionmentioning

confidence: 99%

Audiovisual Detection of Laughter in Human-Machine Interaction

Petridis

Leveque

Pantić

2013

2013 Humaine Association Conference on Affective Computing and Intelligent Interaction

View full text Add to dashboard Cite

Abstract-Laughter is clearly an audiovisual event, consisting of the laughter vocalization and of facial activity, mainly around the mouth and sometimes in the upper face. However, past research on laughter recognition has mainly focused on the information available in the audio channel only, mainly due to the lack of suitable audiovisual data. Only recently few works have been published which combine audio and visual information and most of them deal with the problem of discriminating laughter from speech or other nonlinguistic vocalisations using presegmented data. There are very few works on audiovisual laughter detection from unsegmented audiovisual streams and have either been tested on small datasets or use coarse visual features. As a consequence, results are mixed and it is not clear to what extent the addition of visual information to audio is beneficial for laughter detection. In this work, we attempt to overcome the limitation of previous studies and investigate the performance of audiovisual fusion for laughter detection using audiovisual continuous streams from the SEMAINE database. Our results suggest that there is indeed an improvement in laughter detection with the addition of visual information which is dependent on the performance of the voice activity detector.

show abstract

The Importance of Laughing in Your Face: Influences of Visual Laughter on Auditory Laughter Perception

Cited by 10 publications

References 11 publications

When half a face is as good as a whole: Effects of simple substantial occlusion on visual and audiovisual speech perception

When half a face is as good as a whole: Effects of simple substantial occlusion on visual and audiovisual speech perception

Perceived Loudness Sensitivity Influenced by Brightness in Urban Forests: A Comparison When Eyes Were Opened and Closed

Audiovisual Detection of Laughter in Human-Machine Interaction

Contact Info

Product

Resources

About