Auditory–visual integration during nonconscious perception

Ching, April; Kim, Jeesun; Davis, Chris

doi:10.1016/j.cortex.2019.02.014

Cited by 6 publications

(8 citation statements)

References 41 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Instead, their findings can be explained by association and comparison of information from different senses that may be maintained unconsciously in working memory processes as has previously been demonstrated 68 – 70 . This result, along with studies showing that the McGurk illusion falters under Continuous flash suppression 29 , 30 , supports the hypothesis that only low (i.e. spatial), but not high level (i.e.…”

Section: Discussionsupporting

confidence: 85%

“…These results therefore suggest that invisible flashes can influence sound perception via mechanisms of audiovisual integration. By contrast, the McGurk illusion, which arises for instance by integrating a ‘ba’ phoneme with a ‘ga’ viseme into an illusionary ‘da’ percept 28 , is abolished when the facial articulatory movements are suppressed from observers’ awareness 29 , 30 . These discrepancies may be explained by the fact that the spatial ventriloquist illusion relies on low level spatial cues, while the McGurk illusion requires the extraction and integration of complex phonological features (i.e.…”

Section: Introductionmentioning

confidence: 97%

See 1 more Smart Citation

Semantic and spatial congruency mould audiovisual integration depending on perceptual awareness

Delong

Noppeney

2021

Sci Rep

View full text Add to dashboard Cite

Information integration is considered a hallmark of human consciousness. Recent research has challenged this tenet by showing multisensory interactions in the absence of awareness. This psychophysics study assessed the impact of spatial and semantic correspondences on audiovisual binding in the presence and absence of visual awareness by combining forward–backward masking with spatial ventriloquism. Observers were presented with object pictures and synchronous sounds that were spatially and/or semantically congruent or incongruent. On each trial observers located the sound, identified the picture and rated the picture’s visibility. We observed a robust ventriloquist effect for subjectively visible and invisible pictures indicating that pictures that evade our perceptual awareness influence where we perceive sounds. Critically, semantic congruency enhanced these visual biases on perceived sound location only when the picture entered observers’ awareness. Our results demonstrate that crossmodal influences operating from vision to audition and vice versa are interactively controlled by spatial and semantic congruency in the presence of awareness. However, when visual processing is disrupted by masking procedures audiovisual interactions no longer depend on semantic correspondences.

show abstract

Section: Discussionsupporting

confidence: 85%

Section: Introductionmentioning

confidence: 97%

Semantic and spatial congruency mould audiovisual integration depending on perceptual awareness

Delong

Noppeney

2021

Sci Rep

View full text Add to dashboard Cite

show abstract

“…Importantly, expectations based on visual perception can create illusory auditory percepts (Mcgurk and Macdonald, 1976 ) and expectations based on auditory percepts can create illusory tactile percepts (Jousmäki and Hari, 1998 ). Such intermodal illusions provided support for a “global workspace” model of conscious attention (Baars, 2007 ) but they can arise without conscious perception (Ching et al, 2019 ). During a sleeplike state induced by ketamine/xylazine anesthesia in rats, the intracellular responses of neurons in primary somatosensory (S1) cortex to repetitive patterns of electrotactile stimulation of the paw were modulated by microstimulation of remote cortical areas that generated no direct responses in S1 (Etemadi et al, 2022 ).…”

Section: The Biological Substratementioning

confidence: 98%

Remembrance of things perceived: Adding thalamocortical function to artificial neural networks

Loeb

2023

Front. Integr. Neurosci.

View full text Add to dashboard Cite

Recent research has illuminated the complexity and importance of the thalamocortical system but it has been difficult to identify what computational functions it performs. Meanwhile, deep-learning artificial neural networks (ANNs) based on bio-inspired models of purely cortical circuits have achieved surprising success solving sophisticated cognitive problems associated historically with human intelligence. Nevertheless, the limitations and shortcomings of artificial intelligence (AI) based on such ANNs are becoming increasingly clear. This review considers how the addition of thalamocortical connectivity and its putative functions related to cortical attention might address some of those shortcomings. Such bio-inspired models are now providing both testable theories of biological cognition and improved AI technology, much of which is happening outside the usual academic venues.

show abstract

“…Several studies also suggest that auditory perception is affected by subliminal visual stimuli (Delong et al, 2018;Delong & Noppeney, 2021;Doi & Shinohara, 2015). There are also reports of audio-visual integration when both types of stimuli are subliminal (Ching et al, 2019;Faivre et al, 2014;Scott et al, 2018) and of audio-olfactory integration during sleep (Arzi et al, 2012).…”

Section: Multisensorymentioning

confidence: 99%

Unconscious integration: Current evidence for integrative processing under subliminal conditions

Zher-Wen

2023

British J of Psychology

View full text Add to dashboard Cite

Integrative processing is traditionally believed to be dependent on consciousness. While earlier studies within the last decade reported many types of integration under subliminal conditions (i.e. without perceptual awareness), these findings are widely challenged recently. This review evaluates the current evidence for 10 types of subliminal integration that are widely studied: arithmetic processing, object-context integration, multi-word processing, same-different processing, multisensory integration and 5 different types of associative learning. Potential methodological issues concerning awareness measures are also taken into account. It is concluded that while there is currently no reliable evidence for subliminal integration, this does not necessarily refute 'unconscious' integration defined through non-subliminal (e.g. implicit) approaches.

show abstract

Auditory–visual integration during nonconscious perception

Cited by 6 publications

References 41 publications

Semantic and spatial congruency mould audiovisual integration depending on perceptual awareness

Semantic and spatial congruency mould audiovisual integration depending on perceptual awareness

Remembrance of things perceived: Adding thalamocortical function to artificial neural networks

Unconscious integration: Current evidence for integrative processing under subliminal conditions

Contact Info

Product

Resources

About