The Other-Race-Effect on Audiovisual Speech Integration in Infants: A NIRS Study

Ujiie, Yuta; Kanazawa, Susumu; Yamaguchi, Masami K.

doi:10.3389/fpsyg.2020.00971

Cited by 9 publications

(20 citation statements)

References 50 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The ratio of "fused" perception for audiovisual incongruent stimuli (/ta/ perception for the /pa/ sound and /ka/ video) was higher for the own-race face. Our results provide supportive evidence for the other-race effect within the McGurk effect (Ujiie et al, 2020). A previous study showed that 8-to 9-month-old infants can perceive the McGurk effect in the case of an own-race speaker, but not in the case of an other-race speaker (Ujiie et al, 2020).…”

Section: Discussionsupporting

confidence: 87%

“…Our results provide supportive evidence for the other-race effect within the McGurk effect (Ujiie et al, 2020). A previous study showed that 8- to 9-month-old infants can perceive the McGurk effect in the case of an own-race speaker, but not in the case of an other-race speaker (Ujiie et al, 2020). If the previous results reflect the same other-race effect as in facial perception (e.g., Kelly et al, 2007, 2009), it can be assumed that this effect would also be observed in adults.…”

Section: Methodssupporting

confidence: 79%

“…Considering previous results in infants (Ujiie et al, 2020), one interpretation is that the effect of familiar faces may reflect perceptual narrowing in the processing of facial speech that emerges through infant development. Developmental studies have suggested that with increased experiences with familiar faces in surrounding environments, our perceptual system becomes tuned to adapt to them through development from infancy (e.g., Lewkowicz & Ghazanfar, 2009; Pascalis et al, 2014).…”

Section: Discussionmentioning

confidence: 95%

“…Four types of speech stimuli were employed for each race condition: auditory-only, visual-only, congruent audiovisual, and incongruent audiovisual (McGurk) stimuli. We assumed that adults would experience a lesser degree of the McGurk effect under the other-race face condition than the own-race face condition, as observed in infants (Ujiie et al, 2020).…”

Section: Methodsmentioning

confidence: 99%

“…A recent study of infants supported the hypothesis of other-race effect in the McGurk effect (Ujiie et al, 2020). Ujiie and colleagues tested brain activation patterns when East Asian infants aged 8-9 months observed McGurktype speech stimuli under conditions involving own-and other-race faces.…”

Section: Introductionmentioning

confidence: 92%

See 4 more Smart Citations

Own-race faces promote integrated audiovisual speech information

Ujiie

Takahashi

2021

Quarterly Journal of Experimental Psychology

Self Cite

View full text Add to dashboard Cite

The other-race effect indicates a perceptual advantage when processing own-race faces. This effect has been demonstrated in individuals’ recognition of facial identity and emotional expressions. However, it remains unclear whether the other-race effect also exists in multisensory domains. We conducted two experiments to provide evidence for the other-race effect in facial speech recognition, using the McGurk effect (McGurk & MacDonald, 1976). Experiment 1 tested this issue among East Asian adults, examining the magnitude of the McGurk effect during stimuli using speakers from two different races (own-race vs other-race). We found that own-race faces induced a stronger McGurk effect than other-race faces. Experiment 2 indicated that the other-race effect was not simply due to different levels of attention being paid to the mouths of own and other-race speakers. Our findings demonstrated that own-race faces enhance the weight of visual input during audiovisual speech perception, and they provide evidence of the own-race effect in the audiovisual interaction for speech perception in adults.

show abstract

Section: Discussionsupporting

confidence: 87%

Section: Methodssupporting

confidence: 79%

Section: Discussionmentioning

confidence: 95%

Section: Methodsmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 92%

See 3 more Smart Citations

Own-race faces promote integrated audiovisual speech information

Ujiie

Takahashi

2021

Quarterly Journal of Experimental Psychology

Self Cite

View full text Add to dashboard Cite

show abstract

The effect of face orientation on audiovisual speech integration in infancy: An electrophysiological study

Szmytke,

Ilyka,

Duda‐Goławska

et al. 2023

Developmental Psychobiology

View full text Add to dashboard Cite

Humans pay special attention to faces and speech from birth, but the interplay of developmental processes leading to specialization is poorly understood. We investigated the effects of face orientation on audiovisual (AV) speech perception in two age groups of infants (younger: 5‐ to 6.5‐month‐olds; older: 9‐ to 10.5‐month‐olds) and adults. We recorded event‐related potentials (ERP) in response to videos of upright and inverted faces producing /ba/ articulation dubbed with auditory syllables that were either matching /ba/ or mismatching /ga/ the mouth movement. We observed an increase in the amplitude of audiovisual mismatch response (AVMMR) to incongruent visual /ba/‐auditory /ga/ syllable in comparison to other stimuli in younger infants, while the older group of infants did not show a similar response. AV mismatch response to inverted visual /ba/‐auditory /ga/ stimulus relative to congruent stimuli was also detected in the right frontal areas in the younger group and the left and right frontal areas in adults. We show that face configuration affects the neural response to AV mismatch differently across all age groups. The novel finding of the AVMMR in response to inverted incongruent AV speech may potentially imply the featural face processing in younger infants and adults when processing inverted faces articulating incongruent speech. The lack of visible differential responses to upright and inverted incongruent stimuli obtained in the older group of infants suggests a likely functional cortical reorganization in the processing of AV speech.

show abstract

Functional localization of audiovisual speech using near infrared spectroscopy

et al. 2022

View full text Add to dashboard Cite

Visual cues are especially vital for hearing impaired individuals such as cochlear implant (CI) users to understand speech in noise. Functional Near Infrared Spectroscopy (fNIRS) is a light-based imaging technology that is ideally suited for measuring the brain activity of CI users due to its compatibility with both the ferromagnetic and electrical components of these implants. In a preliminary step toward better elucidating the behavioral and neural correlates of audiovisual (AV) speech integration in CI users, we designed a speech-in-noise task and measured the extent to which 24 normal hearing individuals could integrate the audio of spoken monosyllabic words with the corresponding visual signals of a female speaker. In our behavioral task, we found that audiovisual pairings provided average improvements of 103% and 197% over auditory-alone listening conditions in −6 and −9 dB signal-to-noise ratios consisting of multi-talker background noise. In an fNIRS task using similar stimuli, we measured activity during auditory-only listening, visual-only lipreading, and AV listening conditions. We identified cortical activity in all three conditions over regions of middle and superior temporal cortex typically associated with speech processing and audiovisual integration. In addition, three channels active during the lipreading condition showed uncorrected correlations associated with behavioral measures of audiovisual gain as well as with the McGurk effect. Further work focusing primarily on the regions of interest identified in this study could test how AV speech integration may differ for CI users who rely on this mechanism for daily communication.

show abstract

The Other-Race-Effect on Audiovisual Speech Integration in Infants: A NIRS Study

Cited by 9 publications

References 50 publications

Own-race faces promote integrated audiovisual speech information

Own-race faces promote integrated audiovisual speech information

The effect of face orientation on audiovisual speech integration in infancy: An electrophysiological study

Functional localization of audiovisual speech using near infrared spectroscopy

Contact Info

Product

Resources

About