Sensory substitution systems provide their users with environmental information through a human sensory channel (eye, ear, or skin) different from that normally used, or with the information processed in some useful way. We review the methods used to present visual, auditory, and modified tactile information to the skin. First, we discuss present and potential future applications of sensory substitution, including tactile vision substitution (TVS), tactile auditory substitution, and remote tactile sensing or feedback (teletouch). Next, we review the relevant sensory physiology of the skin, including both the mechanisms of normal touch and the mechanisms and sensations associated with electrical stimulation of the skin using surface electrodes (electrotactile (also called electrocutaneous) stimulation). We briefly summarize the information-processing ability of the tactile sense and its relevance to sensory substitution. Finally, we discuss the limitations of current tactile display technologies and suggest areas requiring further research for sensory substitution systems to become more practical.

No abstract

No abstract

No abstract

The human postural coordination mechanism is an example of a complex closed-loop control system based on multisensory integration [9,10,13,14]. In models of this process, sensory data from vestibular, visual, tactile and proprioceptive systems are integrated as linearly additive inputs that drive multiple sensory-motor loops to provide effective coordination of body movement, posture and alignment [5-8, 10, 11]. In the absence of normal vestibular (such as from a toxic drug reaction) and other inputs, unstable posture occurs. This instability may be the result of noise in a functionally open-loop control system [9]. Nonetheless, after sensory loss the brain can utilize tactile information from a sensory substitution system for functional compensation [1-4, 12]. Here we have demonstrated that head-body postural coordination can be restored by means of vestibular substitution using a head-mounted accelerometer and a brain-machine interface that employs a unique pattern of electrotactile stimulation on the tongue. Moreover, postural stability persists for a period of time after removing the vestibular substitution, after which the open-loop instability reappears.

No abstract

Forty years ago a project to explore late brain plasticity was initiated that was to lead into a broad area of sensory substitution studies. The questions at that time were: Can a person who has never seen learn to see as an adult? Is the brain sufficiently plastic to develop an entirely new sensory system? The short answer to both questions is yes, first clearly demonstrated in 1969 (Bach‐y‐Rita et al., 1969). To reach that conclusion, it was first necessary to find a way to get visual information to the brain. That took many years and is still the most challenging aspect of the research and the development of practical sensory substitution and augmentation systems. The sensor array is not a problem: a TV camera for blind persons; an accelerometer for persons with vestibular loss; a microphone for deaf persons. These are common and fully developed devices. The problem is the brain‐machine interface (BMI). In this short report, only two substitution systems are discussed, vision and vestibular substitution.

Patients with bilateral vestibular loss (BVL) of both central and peripheral origin experience multiple problems with balance and posture control, movement, and abnormal gait.Wicab, Inc. has developed the BrainPort balance device to transmit head position/orientation information normally provided by the vestibular system to the brain through a substitute sensory channel: electrotactile stimulation of the tongue. Head-orientation data (artificially sensed) serves as the input signal for the BrainPort balance device to control the movement of a small pattern of stimulation on the tongue that relates to head position in real-time. With training, the brain learns to appropriately interpret the information from the device and utilize it to function as it would with data from a normal-functioning natural sense. Ina total of 40 subjects trained with the BrainPort, 18 have been tested using standardized quantitative measurements of the treatment effects. A specialized set of exercises, testing, and training procedures has been developed that may serve as the course of intensive physical therapy with the BrainPort balance device. Our results demonstrate consistent positive and statistically significant balance rehabilitation effects independent of aging and etiology of balance deficit.