PantoGuide: A Haptic and Audio Guidance System To Support Tactile Graphics Exploration

Chase, Elyse D. Z.; Siu, Alexa F.; Boadi-Agyemang, Abena; Kim, Gene S-H; Gonzalez, Eric J.; Follmer, Sean

doi:10.1145/3373625.3418023

Cited by 7 publications

(6 citation statements)

References 24 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Their generation process was divided into five basic parts: (1) the input data, which are the raw data presented in the chart; (2) the user input, which specifies characteristics that can be set or triggered by the user inside the user interface; (3) the user interface that provides an interactive SVG file within the preview; (4) the rendering process, which receives the input data from the user interface to generate the output data presented to the user; and (5) design guidelines, which highly depend on user input, particularly on raw data [51]. Chase et al [52] proposed a system that provided audio and haptic direction through skin-stretch feedback to the dorsum of a BVI's hand, while exploring a tactile graphic overlaid on a touchscreen. The system was able to support two teaching scenarios (synchronous and asynchronous) and two guidance interactions (point-to-point and continuous) and demonstrate their use in two applications: a bar chart and tactile graphics of a marble rolling down an inclined plane.…”

Section: Currently Available Methods Using Audiomentioning

confidence: 99%

“…School art teachers showed interest in applying the design as an educational instrument in the classroom. As a result of the analysis, additional audio feedback was proven to be an effective method for making it easier for BVI individuals to perceive tactile graphics [7,11,[51][52][53]61,64].…”

Section: Currently Available Methods Using Audiomentioning

confidence: 99%

“…Additionally, because current braille embossers cannot print ink, QR codes had to be printed on a separate sheet of paper and glued onto the tactile graphic. In the last three years, the interactive use of tactile graphic, audio and haptic methods to explain school teaching materials to blind students has been deemed an effective research direction by many scholars [51][52][53]61,64]. Creating different charts and converting them to a tactile graphic with software that has an easy and convenient graphical user interface is not be a problem, even for teachers without a good understanding of computers [51].…”

Section: Advantages and Disadvantages Of Current Methodsmentioning

confidence: 99%

“…One of the device's drawbacks is that the user interface is only available in the German language and does not support other languages. Haptic guidance was also created as an aid to audio information in the teaching process in [52]. Their device has the advantage of helping students understand complex mathematical charts and graphs through haptic point-to-point directional cues.…”

Section: Advantages and Disadvantages Of Current Methodsmentioning

confidence: 99%

See 3 more Smart Citations

A Systematic Literature Review on the Automatic Creation of Tactile Graphics for the Blind and Visually Impaired

Mukhiddinov

Kim

2021

Processes

View full text Add to dashboard Cite

Currently, a large amount of information is presented graphically. However, visually impaired individuals do not have access to visual information. Instead, they depend on tactile illustrations—raised lines, textures, and elevated graphics that are felt through touch—to perceive geometric and various other objects in textbooks. Tactile graphics are considered an important factor for students in the science, technology, engineering, and mathematics fields seeking a quality education because teaching materials in these fields are frequently conveyed with diagrams and geometric figures. In this paper, we conducted a systematic literature review to identify the current state of research in the field of automatic tactile graphics generation. Over 250 original research papers were screened and the most appropriate studies on automatic tactile graphic generation over the last six years were classified. The reviewed studies explained numerous current solutions in static and dynamic tactile graphics generation using conventional computer vision and artificial intelligence algorithms, such as refreshable tactile displays for education and machine learning models for tactile graphics classification. However, the price of refreshable tactile displays is still prohibitively expensive for low- and middle-income users, and the lack of training datasets for the machine learning model remains a problem.

show abstract

Section: Currently Available Methods Using Audiomentioning

confidence: 99%

Section: Currently Available Methods Using Audiomentioning

confidence: 99%

Section: Advantages and Disadvantages Of Current Methodsmentioning

confidence: 99%

Section: Advantages and Disadvantages Of Current Methodsmentioning

confidence: 99%

See 2 more Smart Citations

A Systematic Literature Review on the Automatic Creation of Tactile Graphics for the Blind and Visually Impaired

Mukhiddinov

Kim

2021

Processes

View full text Add to dashboard Cite

show abstract

“…This approach's limitations are restricted precision in placing markers on the coil array and the impossibility of scaling this technology to other tactile graphic readers. Another navigation interface alternative is to use additional hand-wearable technologies that implement haptic feedback during pinpointing interactions [8,[36][37][38]. Some of these technologies were extended and used for sighted people when exploring 3D virtual environments [39,40].…”

Section: Tactile Graphic Readersmentioning

confidence: 99%

Developing Dynamic Audio Navigation UIs to Pinpoint Elements in Tactile Graphics

Ramôa

Schmidt

König

2022

MTI

View full text Add to dashboard Cite

Access to complex graphical information is essential when connecting blind and visually impaired (BVI) people with the world. Tactile graphics readers enable access to graphical data through audio-tactile user interfaces (UIs), but these have yet to mature. A challenging task for blind people is locating specific elements–areas in detailed tactile graphics. To this end, we developed three audio navigation UIs that dynamically guide the user’s hand to a specific position using audio feedback. One is based on submarine sonar sounds, another relies on the target’s coordinate plan x and y-axis, and the last uses direct voice instructions. The UIs were implemented in the Tactonom Reader device, a new tactile graphic reader that enhances swell paper graphics with pinpointed audio explanations. To evaluate the effectiveness of the three different dynamic navigation UIs, we conducted a within-subject usability test that involved 13 BVI participants. Beyond comparing the effectiveness of the different UIs, we observed and recorded the interaction of the visually impaired participants with the different navigation UI to further investigate their behavioral patterns during the interaction. We observed that user interfaces that required the user to move their hand in a straight direction were more likely to provoke frustration and were often perceived as challenging for blind and visually impaired people. The analysis revealed that the voice-based navigation UI guides the participant the fastest to the target and does not require prior training. This suggests that a voice-based navigation strategy is a promising approach for designing an accessible user interface for the blind.

show abstract

Take My Hand: Automated Hand-Based Spatial Guidance for the Visually Impaired

Rahman

Azim

Heo

2023

Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems

View full text Add to dashboard Cite

PantoGuide: A Haptic and Audio Guidance System To Support Tactile Graphics Exploration

Cited by 7 publications

References 24 publications

A Systematic Literature Review on the Automatic Creation of Tactile Graphics for the Blind and Visually Impaired

A Systematic Literature Review on the Automatic Creation of Tactile Graphics for the Blind and Visually Impaired

Developing Dynamic Audio Navigation UIs to Pinpoint Elements in Tactile Graphics

Take My Hand: Automated Hand-Based Spatial Guidance for the Visually Impaired

Contact Info

Product

Resources

About