Audio-Visual Causality and Stimulus Reliability Affect Audio-Visual Synchrony Perception

Abstract

People can discriminate the synchrony between audio-visual scenes. However, the sensitivity of audio-visual synchrony perception can be affected by many factors. Using a simultaneity judgment task, the present study investigated whether the synchrony perception of complex audio-visual stimuli was affected by audio-visual causality and stimulus reliability. In Experiment 1, the results showed that audio-visual causality could increase one's sensitivity to audio-visual onset asynchrony (AVOA) of both action stimuli and speech stimuli. Moreover, participants were more tolerant of AVOA of speech stimuli than that of action stimuli in the high causality condition, whereas no significant difference between these two kinds of stimuli was found in the low causality condition. In Experiment 2, the speech stimuli were manipulated with either high or low stimulus reliability. The results revealed a significant interaction between audio-visual causality and stimulus reliability. Under the low causality condition, the percentage of “synchronous” responses of audio-visual intact stimuli was significantly higher than that of visual_intact/auditory_blurred stimuli and audio-visual blurred stimuli. In contrast, no significant difference among all levels of stimulus reliability was observed under the high causality condition. Our study supported the synergistic effect of top-down processing and bottom-up processing in audio-visual synchrony perception.

The process of spatial frequency information in temporal synchrony perception for audiovisual stimuli

“…In this study, the repetitions of each SOA condition include 24 trials. Some previous studies using a traditional SJ and TOJ tasks employed a similar number of repetitions (e.g., Kanai et al, 2017;Li et al, 2021); however, it might not be sufficient for the current model's parameters estimation. García-Pérez and Alcalá-Quintana (2020) provided the model used in this study.…”

The Effectiveness of Audiovisual Media on Increasing Knowledge about HIV-AIDS Housewives in Makassar City

“…Another study conducted by Shao (2016) which investigated the effect of video in raising awareness about HIV and AIDS and HIV testing among online audiences around the world also yielded similar results. After watching the videos, respondents who used the internet in English or Spanish showed increased knowledge about HIV and AIDS testing [8].…”

Olfactory–gustatory simultaneity judgments: A preliminary study on the congruency‐dependent temporal window of multisensory binding

“…Previous studies on temporal synchrony of multisensory information used combinations of physical stimuli such as visual, auditory, and tactile stimuli (e.g., audio–visual combinations (Li et al., 2021 ; Peter et al., 2019 ; Takeshima, 2021 ), audio–tactile combinations (Fujisaki & Nishida, 2009 ; Machulla et al., 2016 ; Stanley et al., 2019 ), and visuotactile combinations (Chen et al., 2018 ; Di Luca & Mahnan, 2019 ; Lange et al., 2018 )). By contrast, the use of combinations involving chemical stimuli such as olfaction and gustation is extremely rare (Gotow & Kobayakawa, 2017 , 2019 , 2021 ).…”

“…For example, SJ tasks use an index calculated based on the temporal distribution of the simultaneous response rate (usually a bell‐shaped Gaussian curve). Indexes include: (1) the interval between the two SOA values corresponding to a 75% simultaneous response rate (Marsicano et al., 2022 ; Venskus et al., 2021 ; Zerr et al., 2019 ); (2) the interval between the SOA value corresponding to the point of subjective simultaneity and the SOA value corresponding to a 75% simultaneous response rate (just noticeable difference, JND) (Christie et al., 2019 ; Li et al., 2021 ); (3) half of the interval between the two SOA values corresponding to a 50% simultaneous response rate ( δ ) (Chen et al., 2018 , 2021 ); (4) the standard deviation of the distribution (SD or σ ) (Yarrow et al., 2016 ; Zampini et al., 2005 ); (5) the interval between the two SOA values corresponding to 50% of the maximum rate (full width at half height, FWHH) (Alm & Behne, 2014 ; Roseboom & Arnold, 2011 ; Roseboom et al., 2009 ); and (6) half of the interval between the two SOA values corresponding to 50% of the maximum rate (half width at half height, HWHH) (Fujisaki & Nishida, 2009 ). The larger these values, the larger the TBW, resulting in a lower temporal resolution of synchrony perception.…”