Communicating graphical information to blind users using music

Alty, James L.; Rigas, Dimitrios

doi:10.1145/274644.274721

Cited by 58 publications

(43 citation statements)

References 17 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Despite this evidence, the examples of simultaneous union of audio and tactile information are quite rare in communication devices for the visually impaired. In particular, the experiments in synesthetic translation of color through sound operated by the Audiograph (Alty, Rigas, 1998), and the studies on human interfaces based on sounds (Gaver, 1986). The theme is of high interest because technological help, able to combine touch and hearing to allow a better perception of reality for blind people, can lead the visually impaired to a more complete life and an autonomous exploration of the world.…”

Section: Tactile Exploration For the Visually Impairedmentioning

confidence: 99%

Tooteko: A Case Study of Augmented Reality for an Accessible Cultural Heritage. Digitization, 3d Printing and Sensors for an Audio-Tactile Experience

D'Agnano

Balletti

Guerra

et al. 2015

Int. Arch. Photogramm. Remote Sens. Spatial Inf. Sci.

View full text Add to dashboard Cite

ABSTRACT:Tooteko is a smart ring that allows to navigate any 3D surface with your finger tips and get in return an audio content that is relevant in relation to the part of the surface you are touching in that moment. Tooteko can be applied to any tactile surface, object or sheet. However, in a more specific domain, it wants to make traditional art venues accessible to the blind, while providing support to the reading of the work for all through the recovery of the tactile dimension in order to facilitate the experience of contact with art that is not only "under glass." The system is made of three elements: a high-tech ring, a tactile surface tagged with NFC sensors, and an app for tablet or smartphone. The ring detects and reads the NFC tags and, thanks to the Tooteko app, communicates in wireless mode with the smart device. During the tactile navigation of the surface, when the finger reaches a hotspot, the ring identifies the NFC tag and activates, through the app, the audio track that is related to that specific hotspot. Thus a relevant audio content relates to each hotspot. The production process of the tactile surfaces involves scanning, digitization of data and 3D printing. The first experiment was modelled on the facade of the church of San Michele in Isola, made by Mauro Codussi in the late fifteenth century, and which marks the beginning of the Renaissance in Venice. Due to the absence of recent documentation on the church, the Correr Museum asked the Laboratorio di Fotogrammetria to provide it with the aim of setting up an exhibition about the order of the Camaldolesi, owners of the San Michele island and church. The Laboratorio has made the survey of the facade through laser scanning and UAV photogrammetry. The point clouds were the starting point for prototypation and 3D printing on different supports. The idea of the integration between a 3D printed tactile surface and sensors was born as a final thesis project at the Postgraduate Mastercourse in Digital Architecture of the University of Venice (IUAV) in 2012. Now Tooteko is now a start up company based in Venice, Italy.

show abstract

Section: Tactile Exploration For the Visually Impairedmentioning

confidence: 99%

Tooteko: A Case Study of Augmented Reality for an Accessible Cultural Heritage. Digitization, 3d Printing and Sensors for an Audio-Tactile Experience

D'Agnano

Balletti

Guerra

et al. 2015

Int. Arch. Photogramm. Remote Sens. Spatial Inf. Sci.

View full text Add to dashboard Cite

show abstract

“…This concern about the importance of the context of a local piece of information on its role in the overall data representation is in general relevant to most representation media (Kurze, 1998;Alty & Rigas, 1998).…”

Section: Lack Of Overall Picture Of the Data Structure Containing Infmentioning

confidence: 99%

Using Non-speech Sounds to Improve Access to 2D Tabular Numerical Information for Visually Impaired Users

Ramloll

Brewster

et al. 2001

People and Computers XV—Interaction Without Frontiers

View full text Add to dashboard Cite

We investigated two solutions for numerical (2D) tabular data discovery and overview for visually impaired and blind users. One involved accessing information in tables (26 rows x 10 columns containing integers between and including 0 and 100) by this target user group using both speech and non-speech sounds. The other involved accessing similar information in tables of the same size through speech only by the same user group. We found that opportunities to access data through non-speech sounds result in a highly significant decrease in the overall subjective workload, more specifically in the mental, temporal, performance and frustration workload categories. This subjective workload assessment was supported by our quantitative results which showed a highly significant decrease in the average time taken to complete a given data comprehension task and a significant increase in the number of successfully completed tasks.

show abstract

“…They were able to demonstrate that users could accurately draw the shapes of the graphs that they heard. Alty and Rigas [1998] describe their AUDIOGRAPH system that can be used to display simple diagrams to users. They vary the pitch of two tones of different timbres to represent x, y position in a two dimensional space.…”

Section: Non-visual Cueing For Teaching Shape Informationmentioning

confidence: 99%

Multimodal Trajectory Playback for Teaching Shape Information and Trajectories to Visually Impaired Computer Users

Crossan

Brewster

2008

ACM Trans. Access. Comput.

View full text Add to dashboard Cite

There are difficulties in presenting non-textual or dynamic information to blind or visually impaired users through computers. This paper examines the potential of haptic and auditory trajectory playback as a method of teaching shapes and gestures to visually impaired people. Two studies are described which test the success of teaching simple shapes. The first study examines haptic trajectory playback alone, played through a forcefeedback device and compares performance of visually impaired users with sighted users. It demonstrates that the task is significantly harder for visually impaired users. The second study builds on these results, combining force-feedback with audio to teach visually impaired users to recreate shapes. The results suggest that users performed significantly better when presented with multimodal haptic and audio playback of the shape rather than haptic only. Finally, an initial test of these ideas in an application context is described, with sighted participants describing drawings to visually impaired participants through touch and sound. This study demonstrates in what situations trajectory playback can provide a useful role in a collaborative setting.

show abstract

Communicating graphical information to blind users using music

Cited by 58 publications

References 17 publications

Tooteko: A Case Study of Augmented Reality for an Accessible Cultural Heritage. Digitization, 3d Printing and Sensors for an Audio-Tactile Experience

Tooteko: A Case Study of Augmented Reality for an Accessible Cultural Heritage. Digitization, 3d Printing and Sensors for an Audio-Tactile Experience

Using Non-speech Sounds to Improve Access to 2D Tabular Numerical Information for Visually Impaired Users

Multimodal Trajectory Playback for Teaching Shape Information and Trajectories to Visually Impaired Computer Users

Contact Info

Product

Resources

About