Exploring Art with a Voice Controlled Multimodal Guide for Blind People

Bartolomé, Jorge Iranzo; Quero, Luis Cavazos; Kim, Sun‐Hee; Um, Myung-Yong; Cho, Jun-Dong

doi:10.1145/3294109.3300994

Cited by 23 publications

(23 citation statements)

References 7 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…While most of the studies for improving the accessibility of images that can be accessed with digital devices tend to focus on how to collect the metadata that can be read out to screen reader users, others investigated how to deliver image-related information with tactile feedback [2,4,5,23,24]. Götzelmann et al [23], for instance, presented a 3D-printed map to convey geographic information by touch.…”

Section: Image Accessibilitymentioning

confidence: 99%

“…To improve the accessibility of images for people who are blind or have low vision (BLV), a number of studies have been conducted to assess the effectiveness of custommade tactile versions of images [2][3][4][5][6][7][8]. Cavazos et al [5], for instance, proposed a 2.5D tactile representation of the artwork where blind users can feel the artwork by touch while listening to audio feedback.…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Image Accessibility for Screen Reader Users: A Systematic Review and a Road Map

Joh

Lee

2021

Electronics

View full text Add to dashboard Cite

A number of studies have been conducted to improve the accessibility of images using touchscreen devices for screen reader users. In this study, we conducted a systematic review of 33 papers to get a holistic understanding of existing approaches and to suggest a research road map given identified gaps. As a result, we identified types of images, visual information, input device and feedback modalities that were studied for improving image accessibility using touchscreen devices. Findings also revealed that there is little study how the generation of image-related information can be automated. Moreover, we confirmed that the involvement of screen reader users is mostly limited to evaluations, while input from target users during the design process is particularly important for the development of assistive technologies. Then we introduce two of our recent studies on the accessibility of artwork and comics, AccessArt and AccessComics, respectively. Based on the identified key challenges, we suggest a research agenda for improving image accessibility for screen reader users.

show abstract

Section: Image Accessibilitymentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Image Accessibility for Screen Reader Users: A Systematic Review and a Road Map

Joh

Lee

2021

Electronics

View full text Add to dashboard Cite

show abstract

“…To address these limitations, research has designed a variety of tools that allow for multimodal interfaces (e.g., [2,17,24,31]) and to support collaboration between BVIP and sighted people. For example, Thieme et al [30] investigated how tools can assist during collaborative programming tasks.…”

Section: State Of the Artmentioning

confidence: 99%

Accessible Multimodal Tool Support for Brainstorming Meetings

Koutny

Günther

Dhingra

et al. 2020

Lecture Notes in Computer Science

View full text Add to dashboard Cite

In recent years, assistive technology and digital accessibility for blind and visually impaired people (BVIP) has been significantly improved. Yet, group discussions, especially in a business context, are still challenging as non-verbal communication (NVC) is often depicted on digital whiteboards, including deictic gestures paired with visual artifacts. However, as NVC heavily relies on the visual perception, whichrepresents a large amount of detail, an adaptive approach is required that identifies the most relevant information for BVIP. Additionally, visual artifacts usually rely on spatial properties such as position, orientation, and dimensions to convey essential information such as hierarchy, cohesion, and importance that is often not accessible to the BVIP. In this paper, we investigate the requirements of BVIP during brainstorming sessions and, based on our findings, provide an accessible multimodal tool that uses non-verbal and spatial cues as an additional layer of information. Further, we contribute by presenting a set of input and output modalities that encode and decode information with respect to the individual demands of BVIP and the requirements of different use cases.

show abstract

“…Touch Graphics Inc. exhibits a reproduced painting called "Talking Tactile" at the San Diego Museum of Art [3]. Recently, "BlindTouch" [4,5] has been introduced to enhance PVI's artwork experience by reproducing painting masterpieces as 3D-printed models that contain touch recognition sensors (based on conductive painting) and provide relevant audio descriptions and sound effects (such as the sound of the wind or a flying butterfly) while the user explores the different features of the artwork with their fingers. The touch interface was evaluated by PVI and found to be effective.…”

Section: Introductionmentioning

confidence: 99%

Sound Coding Color to Improve Artwork Appreciation by People with Visual Impairments

Cho

Jeong²,

Kim³

et al. 2020

Electronics

View full text Add to dashboard Cite

The recent development of color coding in tactile pictograms helps people with visual impairments (PVI) appreciate the visual arts. The auditory sense, in conjunction with (or possibly as an alternative to) the tactile sense, would allow PVI to perceive colors in a way that would be difficult to achieve with just a tactile stimulus. Sound coding colors (SCCs) can replicate three characteristics of colors, i.e., hue, chroma, and value, by matching them with three characteristics of sound, i.e., timbre, intensity, and pitch. This paper examines relationships between sound (melody) and color mediated by tactile pattern color coding and provides sound coding for hue, chroma, and value to help PVI deepen their relationship with visual art. Our two proposed SCC sets use melody to improve upon most SCC sets currently in use by adding more colors (18 colors in 6 hues). User experience and identification tests were conducted with 12 visually impaired and 8 sighted adults, and the results suggest that the SCC sets were helpful for the participants.

show abstract

Exploring Art with a Voice Controlled Multimodal Guide for Blind People

Cited by 23 publications

References 7 publications

Image Accessibility for Screen Reader Users: A Systematic Review and a Road Map

Image Accessibility for Screen Reader Users: A Systematic Review and a Road Map

Accessible Multimodal Tool Support for Brainstorming Meetings

Sound Coding Color to Improve Artwork Appreciation by People with Visual Impairments

Contact Info

Product

Resources

About