Learning non-visual graphical information using a touch-based vibro-audio interface

Giudice, Nicholas A.; Palani, Hari Prasath; Brenner, Eric D.; Kramer, K.

doi:10.1145/2384916.2384935

Cited by 96 publications

(56 citation statements)

References 27 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…TeDUB [21] or the VTPlayer tactile mouse with a graphics tablet [28]; or presentation on a touchscreen device using a mixture of haptic or audio feedback as the user explores the graphic, e.g. GraVVITAS [11] or [10]. The advantage of the last approach is that it does not rely on expensive tactile graphics or overlays but still allows the user to use both hands to explore the graphic and build up a mental model of it.…”

Section: Presentation Technologies For Accessible Graphicsmentioning

confidence: 99%

Accessible On-Line Floor Plans

Goncu

Madugalla

Marinai³

et al. 2015

Proceedings of the 24th International Conference on World Wide Web

View full text Add to dashboard Cite

Better access to on-line information graphics is a pressing need for people who are blind or have severe vision impairment. We present a new model for accessible presentation of on-line information graphics and demonstrate its use for presenting floor plans. While floor plans are increasingly provided on-line, people who are blind are at best provided with only a high-level textual description. This makes it difficult for them to understand the spatial arrangement of the objects on the floor plan. Our new approach provides users with significantly better access to such plans. The users can automatically generate an accessible version of a floor plan from an on-line floor plan image quickly and independently by using a web service. This generates a simplified graphic showing the rooms, walls, doors and windows in the original floor plan as well as a textual overview. The accessible floor plan is presented on an iPad using audio feedback. As the users touch graphic elements on the screen, the element they are touching is described by speech and non-speech audio in order to help them navigate the graphic.

show abstract

Section: Presentation Technologies For Accessible Graphicsmentioning

confidence: 99%

Accessible On-Line Floor Plans

Goncu

Madugalla

Marinai³

et al. 2015

Proceedings of the 24th International Conference on World Wide Web

View full text Add to dashboard Cite

show abstract

“…Research on vibrotactile interfaces for disabled users has specially focused on visually-impaired users to help them in their interaction with the environment or with other people: to enhance navigation abilities [9][10], to interact with nearby objects [11], to present graphical information non-visually [12], to enrich interpersonal communication [13] [14], to play with videogames [15][16] [17], to teach choreographed dance [18] or to generate Braille on a mobile [19].…”

Section: Vibrotactile Interfaces and Disabilitymentioning

confidence: 99%

A Vibrotactile Interface to Motivate Movement for Children with Severe to Profound Disabilities

Manresa-Yee

Morrison

Larsen

et al. 2014

Proceedings of the XV International Conference on Human Computer Interaction

View full text Add to dashboard Cite

V-Sense is a vibrotactile interface that encourages children with severe or profound cognitive, sensory and physical impairments to move. The interface makes use of touch, in particular vibrations, as a supportive function to motivate users' actions. Specifically, we propose a vibrotactile interface on the arm and around the shoulder using the saltation perceptual illusion to induce movement of the corresponding joint. In this paper we describe the design principles of the interface and the proposed experimental design to evaluate it.

show abstract

“…Access to the information from these channels is obtained through relatively inexpensive sensors such as microphones, cameras, accelerometers, compasses, gyroscopes and magnetometers. The output information, besides the screen of the mobile device, can reach to the users as synthesized or natural voice, or as vibrations [26].…”

Section: User Interactionmentioning

confidence: 99%

Blind-environment interaction through voice augmented objects

Ivanov

2014

J Multimodal User Interfaces

View full text Add to dashboard Cite

This article presents an Java-based mobile service that enables blind-environment interaction through voice-augmented objects. To make this possible, it is necessary to tag the object with an associated radio frequency identification and record its voice-based description. The blind users can later use the service to scan surrounding augmented objects and verbalize their identity and characteristics. We use a user centred design in order to guarantee the accessibility of the service for visually impaired and blind people. The required hardware is a near field communication-enabled mobile phone with built-in accelerometer. The client-side application does not require pushing any buttons, browsing any menus, or touching any screens to select and activate any of supported modes: registration, calibration, voice recording, physical object identification, delete voice recording(s), cloud-based file sync and share. Twelve visually impaired individuals (aged 31-84, 6 men and 6 women) have tested the service in two different scenarios: (1) a test based on comparison with a PenFriend labeling unit, and (2) a users' experience test. The results show that selected tangible, multimodal interface (object touching, phone shaking and tilt, voice output) can be used very easily (58 %) or easily (33 %) by blind and visually impaired users who have had no previous experience with other mobile services. Most of participants from the test group agreed that the service could be useful for their daily activities. The service can be used both at home and in public buildings for voice description of objects such as food,

show abstract

Learning non-visual graphical information using a touch-based vibro-audio interface

Cited by 96 publications

References 27 publications

Accessible On-Line Floor Plans

Accessible On-Line Floor Plans

A Vibrotactile Interface to Motivate Movement for Children with Severe to Profound Disabilities

Blind-environment interaction through voice augmented objects

Contact Info

Product

Resources

About