There Is Something Out There: Distal Attribution in Sensory Substitution, Twenty Years Later

Abstract

Sensory substitution constitutes an interesting domain of study to consider the philosopher's classical question of distal attribution: how we can distinguish between a sensation and the perception of an object that causes this sensation. We tested the hypothesis that distal attribution consists of three distinct components: an object, a perceptual space, and a coupling between subjects' movements and stimulation. We equipped sixty participants with a visual-to-auditory substitution device, without any information about it. The device converts the video stream produced by a head-mounted camera into a sound stream. We investigated several experimental conditions: the existence or not of a correlation between movements and resulting stimulation, the direct or indirect manipulation of an object, and the presence of a background environment. Participants were asked to describe their impressions by rating their experiences in terms of seven possible "scenarios". These scenarios were carefully chosen to distinguish the degree to which the participants attributed their sensations to a distal cause. Participants rated the scenarios both before and after they were given the possibility to interrupt the stimulation with an obstacle. We were interested in several questions. Did participants extract laws of co-variation between their movements and resulting stimulation? Did they deduce the existence of a perceptual space originating from this coupling? Did they individuate objects that caused the sensations? Whatever the experimental conditions, participants were able to establish that there was a link between their movements and the resulting auditory stimulation. Detection of the existence of a coupling was more frequent than the inferences of distal space and object.

The Enactive Torch: A New Tool for the Science of Perception

“…However, it appears that most of the participants were also mainly focused on the vibrations on their wrist (LI-1; GA 20), and many of them also "paid attention to the sound of the motors in order to find [their] way" (LI-14; GA 15). 2 This would seem to suggest that, in addition to having had an experience of external obstacles, most of the participants still retained some awareness of aspects pertaining to the functioning of the device itself.…”

“…Previous work in this area has already shown the value of using minimal technological interfaces in the science of perception (e.g., [32], [5], [2]. The ET is an original contribution to this domain.…”

The evolution of a visual-to-auditory sensory substitution device using interactive genetic algorithms

“…One device, the Vibe, is similar to the tactile systems in that it presents the whole field of view at once and relies on the natural localisation abilities of the ear by expressing horizontal (left/right) position by controlling the relative amplitude in each ear (Auvray, Hanneton, Lenay, & O'Regan, 2005). The vOICe (which forms the basis for this study and is described in more detail below) encodes horizontal position temporally; i.e.…”

Software Design for Low-Latency Visuo-Auditory Sensory Substitution on Mobile Devices

“…More recently, another project called TheVibe (Auvray et al, 2005;Durette et al, 2008;Hanneton et al, 2010) has been developed. With its default configuration, this system associates a specific tone to each region of the acquired image.…”

“…It has been shown that the trajectories of moving visual targets can be differentiated following a short training period (Ambard et al, 2015). These systems have proven useful for walking (Bologna et al, 2009a;Durette et al 2008), and they allow for the development of distal attribution (Auvray et al, 2005).…”