Age mitigates the correlation between cognitive processing speed and audio-visual asynchrony detection in speech

Alm, Magnus; Behne, Dawn M.

doi:10.1121/1.4896464

Cited by 4 publications

(4 citation statements)

References 39 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Although the participants were assessed as normal-hearing and had similar speech perception in quiet, small differences in audiometric thresholds were inferred to have resulted in the age-related differences in speech reception thresholds in the other background conditions. Such age dependent variations in the influence of noise may alter the way available cognitive resources are utilized in AV speech perception, for example, changing the relative processing of auditory and visual speech cues (e.g., Alm and Behne, 2014 ). Recent research also indicates that similar mechanism may be present for vision.…”

Section: Introductionmentioning

confidence: 99%

Do gender differences in audio-visual benefit and visual influence in audio-visual speech perception emerge with age?

Alm

Behne

2015

Front. Psychol.

Self Cite

View full text Add to dashboard Cite

Gender and age have been found to affect adults’ audio-visual (AV) speech perception. However, research on adult aging focuses on adults over 60 years, who have an increasing likelihood for cognitive and sensory decline, which may confound positive effects of age-related AV-experience and its interaction with gender. Observed age and gender differences in AV speech perception may also depend on measurement sensitivity and AV task difficulty. Consequently both AV benefit and visual influence were used to measure visual contribution for gender-balanced groups of young (20–30 years) and middle-aged adults (50–60 years) with task difficulty varied using AV syllables from different talkers in alternative auditory backgrounds. Females had better speech-reading performance than males. Whereas no gender differences in AV benefit or visual influence were observed for young adults, visually influenced responses were significantly greater for middle-aged females than middle-aged males. That speech-reading performance did not influence AV benefit may be explained by visual speech extraction and AV integration constituting independent abilities. Contrastingly, the gender difference in visually influenced responses in middle adulthood may reflect an experience-related shift in females’ general AV perceptual strategy. Although young females’ speech-reading proficiency may not readily contribute to greater visual influence, between young and middle-adulthood recurrent confirmation of the contribution of visual cues induced by speech-reading proficiency may gradually shift females AV perceptual strategy toward more visually dominated responses.

show abstract

Section: Introductionmentioning

confidence: 99%

Do gender differences in audio-visual benefit and visual influence in audio-visual speech perception emerge with age?

Alm

Behne

2015

Front. Psychol.

Self Cite

View full text Add to dashboard Cite

show abstract

“…For example, SJ tasks use an index calculated based on the temporal distribution of the simultaneous response rate (usually a bell‐shaped Gaussian curve). Indexes include: (1) the interval between the two SOA values corresponding to a 75% simultaneous response rate (Marsicano et al., 2022 ; Venskus et al., 2021 ; Zerr et al., 2019 ); (2) the interval between the SOA value corresponding to the point of subjective simultaneity and the SOA value corresponding to a 75% simultaneous response rate (just noticeable difference, JND) (Christie et al., 2019 ; Li et al., 2021 ); (3) half of the interval between the two SOA values corresponding to a 50% simultaneous response rate ( δ ) (Chen et al., 2018 , 2021 ); (4) the standard deviation of the distribution (SD or σ ) (Yarrow et al., 2016 ; Zampini et al., 2005 ); (5) the interval between the two SOA values corresponding to 50% of the maximum rate (full width at half height, FWHH) (Alm & Behne, 2014 ; Roseboom & Arnold, 2011 ; Roseboom et al., 2009 ); and (6) half of the interval between the two SOA values corresponding to 50% of the maximum rate (half width at half height, HWHH) (Fujisaki & Nishida, 2009 ). The larger these values, the larger the TBW, resulting in a lower temporal resolution of synchrony perception.…”

Section: Introductionmentioning

confidence: 99%

Olfactory–gustatory simultaneity judgments: A preliminary study on the congruency‐dependent temporal window of multisensory binding

Gotow

Kobayakawa

2022

Brain and Behavior

View full text Add to dashboard Cite

Background: A greater congruency of audio and video expands the temporal binding window (TBW). A similar phenomenon may occur with a combination of odor and taste, which are the main components of flavor.Objective: TBW is defined as the temporal resolution of synchrony perception. The larger the TBW, the lower the resolution. We hypothesized that the more congruent the odor and taste, the lower the temporal resolution of synchrony perception. Methods:To examine this hypothesis, 10 female participants performed simultaneity judgment (SJ) tasks under congruent (soy sauce odor with saline) and incongruent (cherry tree leaf odor with saline) conditions and evaluated the congruency with saltiness for the two odors. In the SJ tasks, participants reported whether odor and taste were presented simultaneously or successively. We assumed a Gaussian distribution for the temporal distributions of the simultaneous response rates and calculated the approximations. In addition, we computed the half width at half height (HWHH) as an index of TBW based on the coefficient of approximation for the temporal distribution of the simultaneous response rates.Results: HWHH was significantly larger under congruent condition than under incongruent condition. In addition, congruency with saltiness had a significant moderate positive correlation with HWHH. Conclusion:The larger the HWHH, the lower the temporal resolution of synchrony perception, supporting the hypothesis. This study suggests that the width of TBW depends on the cross-modal congruency similar to the case for audio-visual SJs.However, methodological improvements, including a larger sample size and genderindependent recruitment of participants, are essential to enhance the reliability of the findings because some of the results did not provide sufficient ESs or power.

show abstract

“…For this quest, various approaches using different senses such as visuals, audio, and physiological senses have been used in the past [7][8][9][10][11]. However, the two basic senses that are primarily used in developing automatic emotion recognition models are audio and visuals, out of which audio senses are well known for stimulating emotion cues [12][13][14][15] since audio signals have higher augment for emotion cues with less computational power requirements than visual signals [13,16]. Further, detecting emotions from visual data has ethical challenges in comparison to audio signals.…”

Section: Introductionmentioning

confidence: 99%

A Preliminary Investigation on Frequency Dependant Cues for Human Emotions

2022

View full text Add to dashboard Cite

The recent advances in Human-Computer Interaction and Artificial Intelligence have significantly increased the importance of identifying human emotions from different sensory cues. Hence, understanding the underlying relationships between emotions and sensory cues have become a subject of study in many fields including Acoustics, Psychology, Psychiatry, Neuroscience and Biochemistry. This work is a preliminary step towards investigating cues for human emotion on a fundamental level by aiming to establish relationships between tonal frequencies of sound and emotions. For that, an online perception test is conducted, in which participants are asked to rate the perceived emotions corresponding to each tone. The results show that a crossover point for four primary emotions lies in the frequency range of 417–440 Hz, thus consolidating the hypothesis that the frequency range of 432–440 Hz is neutral from human emotion perspective. It is also observed that the frequency dependant relationships between emotion pairs Happy—Sad, and Anger—Calm are approximately mirrored symmetric in nature.

show abstract

Age mitigates the correlation between cognitive processing speed and audio-visual asynchrony detection in speech

Cited by 4 publications

References 39 publications

Do gender differences in audio-visual benefit and visual influence in audio-visual speech perception emerge with age?

Do gender differences in audio-visual benefit and visual influence in audio-visual speech perception emerge with age?

Olfactory–gustatory simultaneity judgments: A preliminary study on the congruency‐dependent temporal window of multisensory binding

A Preliminary Investigation on Frequency Dependant Cues for Human Emotions

Contact Info

Product

Resources

About