A perceptual interface for vision substitution in a color matching experiment

Bologna, Guido; Deville, Benoît; Vinckenbosch, Michel; Pun, Thierry

doi:10.1109/ijcnn.2008.4634014

Cited by 9 publications

(4 citation statements)

References 9 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…High luminance uses high-pitched notes, while low luminance uses low-pitched notes. See ColOr has been evaluated for color recognition [23], navigation, and object localization [24].…”

Section: Related Work 21 Auditory Representation Of Colormentioning

confidence: 99%

Multi-Sensory Color Code Based on Sound and Scent for Visual Art Appreciation

Quero¹,

Lee²,

Cho³

2021

Electronics

View full text Add to dashboard Cite

The development of assistive technologies is improving the independent access of blind and visually impaired people to visual artworks through non-visual channels. Current single modality tactile and auditory approaches to communicate color contents must compromise between conveying a broad color palette, ease of learning, and suffer from limited expressiveness. In this work, we propose a multi-sensory color code system that uses sound and scent to represent colors. Melodies express each color’s hue and scents the saturated, light, and dark color dimensions for each hue. In collaboration with eighteen participants, we evaluated the color identification rate achieved when using the multi-sensory approach. Seven (39%) of the participants improved their identification rate, five (28%) remained the same, and six (33%) performed worse when compared to an audio-only color code alternative. The participants then evaluated and compared a color content exploration prototype that uses the proposed color code with a tactile graphic equivalent using the System Usability Scale. For a visual artwork color exploration task, the multi-sensory color code integrated prototype received a score of 78.61, while the tactile graphics equivalent received 61.53. User feedback indicates that the multi-sensory color code system improved the convenience and confidence of the participants.

show abstract

“…High luminance uses high-pitched notes, while low luminance uses low-pitched notes. See ColOr has been evaluated for color recognition [23], navigation, and object localization [24].…”

Section: Related Work 21 Auditory Representation Of Colormentioning

confidence: 99%

Multi-Sensory Color Code Based on Sound and Scent for Visual Art Appreciation

Quero¹,

Lee²,

Cho³

2021

Electronics

View full text Add to dashboard Cite

show abstract

“…Depth perception was later incorporated through stereoscopic camera disparity maps and was conveyed through the length of the sound files being played between 90-300 ms duration -closer distances had briefer sonifications, referred to as its rhythm frequency (Bologna et ai, 2010). Experiments have found the device useful for colour categorization (Bologna et al, 2008) as well as navigation and object localization (Bologna et ai, 2010).…”

Section: Seeing Colours With An Orchestra See Color (2007)mentioning

confidence: 99%

Representing Colour Through Hearing and Touch in Sensory Substitution Devices

Hamilton-Fletcher

Ward

2013

Multisens Res

View full text Add to dashboard Cite

Visual sensory substitution devices (SSDs) allow visually-deprived individuals to navigate and recognise the 'visual world'; SSDs also provide opportunities for psychologists to study modality-independent theories of perception. At present most research has focused on encoding greyscale vision. However at the low spatial resolutions received by SSD users, colour information enhances object-ground segmentation, and provides more stable cues for scene and object recognition. Many attempts have been made to encode colour information in tactile or auditory modalities, but many of these studies exist in isolation. This review brings together a wide variety of tactile and auditory approaches to representing colour. We examine how each device constructs 'colour' relative to veridical human colour perception and report previous experiments using these devices. Theoretical approaches to encoding and transferring colour information through sound or touch are discussed for future devices, covering alternative stimulation approaches, perceptually distinct dimensions and intuitive cross-modal correspondences.

show abstract

“…Finally, all participants to the experiments were successful when asked to find a bright red door in a picture representing a churchyard with trees, grass and a house. The work described in [9] introduced an experiment during which ten blindfolded individuals participants tried to match pairs of uniform coloured socks by pointing a head mounted camera and by listening to the generated sounds. Figure 2 illustrates an experiment participant observing a blue socket.…”

Section: Previous Experiments Without Depth Sonificationmentioning

confidence: 99%

“…For the mobility of visually impaired individuals, we consider that colour perception is very important, as it can facilitate the recognition of potential landmarks. The See ColOr interface encodes a limited number of coloured pixels by spatialised musical instrument sounds, in order to represent and emphasize the colour and location of visual entities in their environment [7,8,9,10,11]. The basic idea is to represent a pixel as a directional sound source with depth estimated by stereo-vision.…”

Section: Introductionmentioning

confidence: 99%

Toward local and global perception modules for vision substitution

et al. 2011

View full text Add to dashboard Cite

Although retinal neural implants have considerably progressed they raise a number of questions concerning user acceptance, risk rejection and cost. For the time being we support a low cost approach based on the transmission of limited vision information by means of the auditory channel. The See ColOr mobility aid for visually impaired individuals transforms a small portion of a coloured video image into sound sources represented by spatialised musical instruments. Basically, the conversion of colours into sounds is achieved by quantisation of the HSL colour system. Our purpose is to provide blind people with a capability of perception of the environment in real time. In this work the novelty is the simultaneous sonification of colour and depth, the last parameter being coded by sound rhythm. The main drawback of our approach is that the sonification of a limited portion of a captured image involves limited perception.As a consequence, we propose to extend the local perception module by introducing a new global perception module aiming at providing the user with a clear picture of the entire scene characteristics.Finally, we present several experiments to illustrate the limited perception module, such as: (1) detecting an open door in order to go out from the office; (2) walking in a hallway and looking for a blue cabinet; (3) walking in a hallway and looking for a red tee shirt; (4) avoiding two red obstacles; (5) moving outside and avoiding a parked car. Videos of experiments are available on http://www.youtube.com/guidobologna.

show abstract

A perceptual interface for vision substitution in a color matching experiment

Cited by 9 publications

References 9 publications

Multi-Sensory Color Code Based on Sound and Scent for Visual Art Appreciation

Multi-Sensory Color Code Based on Sound and Scent for Visual Art Appreciation

Representing Colour Through Hearing and Touch in Sensory Substitution Devices

Toward local and global perception modules for vision substitution

Contact Info

Product

Resources

About