Perception and Interactive Technology

Scheller, Meike; Petrini, Karin; Proulx, Michael J.

doi:10.1002/9781119170174.epcn215

Cited by 6 publications

(5 citation statements)

References 221 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…On all but the auditory-only trials, participants were required to report the number of flashes they perceived. Importantly, due to structural and functional differences in the auditory and visual sensory systems, audition has a higher temporal resolution than vision, making it the more reliable sense for estimating event numerosity in a fast sequence of events (Lukas et al, 2014; Morein-Zamir et al, 2003; Recanzone, 2003; Scheller et al, 2018; Shams et al, 2002; Shimojo et al, 2001). This difference in reliability between the senses typically leads to a strong influence of audition on vision.…”

Section: Does Self-relevance Modulate “Perception”? the Need For A Cl...mentioning

confidence: 99%

Social relevance modulates multisensory integration.

Scheller¹,

Shen²

2022

Journal of Experimental Psychology: Human Perception and Perfor

Self Cite

View full text Add to dashboard Cite

When interacting with the environment, humans exhibit robust biases toward information that pertains to themselves: Self-relevant information is processed faster and yields more accurate responses than information linked to others. Recent studies have shown that simple social associations can lead to the instant deployment of this benefit in the processing of abstract stimuli. However, how self-prioritization evolves across the processing hierarchy has been a subject of intense debate. Furthermore, there is little empirical evidence about the functional efficiency of social relevance in natural environments in which information is present across multiple senses. Across three experiments (each n = 40), the present study shows that self-prioritization effects (a) can arise in simple audio-visual numerosity judgements, (b) can be efficiently deployed across the senses by funneling perception toward self-relevant information in the more reliable sensory modality, and (c) modulate the integration of auditory and visual information into a multisensory representation. Taken together, the present findings suggest that social relevance can influence multisensory processing at both perceptual and postperceptual stages via early attentional modulations of sensory integration and later, task-dependent attentional control. Public Significance StatementThis study provides evidence that self-relevance of abstract information (temporal event numerosity) leads to changes in multisensory perception. Establishing self-relevance via social associations of oneself or another person with two visual event numerosities leads to a relative performance facilitation for self-related information that transfers to auditory and multisensory contexts. Furthermore, in relation to other-associated information, self-association with event numerosities modulates audio-visual integration by increasing sensitivity and decreasing bias in the fusion illusion. Together, the present findings suggest that social salience can influence multisensory processing via attentional modulations.

show abstract

Section: Does Self-relevance Modulate “Perception”? the Need For A Cl...mentioning

confidence: 99%

Social relevance modulates multisensory integration.

Scheller¹,

Shen²

2022

Journal of Experimental Psychology: Human Perception and Perfor

Self Cite

View full text Add to dashboard Cite

show abstract

“…This uncertainty depends on how well our sensory systems are tuned to process specific environmental features. For instance, as the layout of the retina allows the visual system to process more bits of information in parallel, vision is typically more dominant in spatial tasks, while the auditory system is better attuned to the temporal information structure (Bresciani et al, 2005(Bresciani et al, , 2008Scheller et al, 2018;Shams, Ma, et al, 2005;Wozny et al, 2008). The relative uncertainty of the sensory systems explains various perceptual phenomena and illusions, reflecting how perception disambiguates environmental information by weighing different sensory cues by their individual reliabilities (Alais & Burr, 2004;Bruns, 2019;Heron et al, 2004;Magnotti & Beauchamp, 2017;Shams et al, 2000;Shams & Beierholm, 2022;Shams, Ma, et al, 2005).…”

Section: Backgrou N Dmentioning

confidence: 99%

Self as a prior: The malleability of Bayesian multisensory integration to social salience

Scheller,

Fang,

Sui

2023

British J of Psychology

Self Cite

View full text Add to dashboard Cite

Our everyday perceptual experiences are grounded in the integration of information within and across our senses. Due to this direct behavioural relevance, cross‐modal integration retains a certain degree of contextual flexibility, even to social relevance. However, how social relevance modulates cross‐modal integration remains unclear. To investigate possible mechanisms, Experiment 1 tested the principles of audio‐visual integration for numerosity estimation by deriving a Bayesian optimal observer model with perceptual prior from empirical data to explain perceptual biases. Such perceptual priors may shift towards locations of high salience in the stimulus space. Our results showed that the tendency to over‐ or underestimate numerosity, expressed in the frequency and strength of fission and fusion illusions, depended on the actual event numerosity. Experiment 2 replicated the effects of social relevance on multisensory integration from Scheller & Sui, 2022 JEP:HPP, using a lower number of events, thereby favouring the opposite illusion through enhanced influences of the prior. In line with the idea that the self acts like a prior, the more frequently observed illusion (more malleable to prior influences) was modulated by self‐relevance. Our findings suggest that the self can influence perception by acting like a prior in cue integration, biasing perceptual estimates towards areas of high self‐relevance.

show abstract

“…The technology is grounded in the understanding that the brain can interpret sensory information from one modality (e.g., sound) as information from a different modality (e.g., visual) (Shimojo & Shams, 2001; Solomon-Harris et al, 2013). Numerous devices designed specifically for sensory substitution have been developed (Scheller et al, 2018), such as The vOICe (visual-to-auditory) (Meijer, 1992), and BrainPort (visual-to-tactile) (Fale et al, 2016). Many devices designed specifically for sensory substitution have been successful in improving functional outcomes where sensory restoration devices have struggled (Erickson-Davis & Korzybska, 2021; Garcia et al, 2015).…”

Section: Introductionmentioning

confidence: 99%

Assessing people with visual impairments’ access to information, awareness and satisfaction with high-tech assistive technology

Liang¹,

Spencer

Scheller

et al. 2022

British Journal of Visual Impairment

Self Cite

View full text Add to dashboard Cite

Assistive technology (AT) devices are designed to help people with visual impairments (PVIs) perform activities that would otherwise be difficult or impossible. Devices specifically designed to assist PVIs by attempting to restore sight or substitute it for another sense have a very low uptake rate. This study, conducted in England, aimed to investigate why this is the case by assessing accessibility to knowledge, awareness, and satisfaction with AT in general and with sensory restoration and substitution devices in particular. From a sample of 25 PVIs, ranging from 21 to 68 years old, results showed that participants knew where to find AT information; however, health care providers were not the main source of this information. Participants reported good awareness of different ATs, and of technologies they would not use, but reported poor awareness of specific sensory substitution and restoration devices. Only three participants reported using AT, each with different devices and varying levels of satisfaction. The results from this study suggest a possible breakdown in communication between health care providers and PVIs, and dissociation between reported AT awareness and reported access to AT information. Moreover, awareness of sensory restoration and substitution devices is poor, which may explain the limited use of such technology.

show abstract

Perception and Interactive Technology

Cited by 6 publications

References 221 publications

Social relevance modulates multisensory integration.

Social relevance modulates multisensory integration.

Self as a prior: The malleability of Bayesian multisensory integration to social salience

Assessing people with visual impairments’ access to information, awareness and satisfaction with high-tech assistive technology

Contact Info

Product

Resources

About