Providing synthesized audio description for online videos

Kobayashi, Masatomo; Fukuda, Kentarou; Takagi, Hironobu; Asakawa, Chieko

doi:10.1145/1639642.1639699

Cited by 21 publications

(5 citation statements)

References 3 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Manual methods, for instance, include specialized authoring tools [4], peer feedback mechanisms on audio descriptions [44,56], accessibility verification checks [38], and dedicated platforms for hosting these descriptions [42]. Platforms like LiveDescribe [4] and Rescribe [48] aim to democratize the generation of audio descriptions by offering user-friendly interfaces that even novices can leverage to produce audio descriptions with fewer resources [29]. Nevertheless, these manual methods can be inefficient for content creators and do not scale well to the enormous corpus of video content currently available.…”

Section: Related Work 21 Audio Descriptions Generationmentioning

confidence: 99%

SPICA: Interactive Video Content Exploration through Augmented Audio Descriptions for Blind or Low-Vision Viewers

Ning,

Wimer,

Jiang

et al. 2024

Proceedings of the CHI Conference on Human Factors in Computing Systems

View full text Add to dashboard Cite

Blind or Low-Vision (BLV) users often rely on audio descriptions (AD) to access video content. However, conventional static ADs can leave out detailed information in videos, impose a high mental load, neglect the diverse needs and preferences of BLV users, and lack immersion. To tackle these challenges, we introduce Spica, an AI-powered system that enables BLV users to interactively explore video content. Informed by prior empirical studies on BLV video consumption, Spica offers interactive mechanisms for supporting temporal navigation of frame captions and spatial exploration of objects within key frames. Leveraging an audio-visual machine learning pipeline, Spica augments existing ADs by adding interactivity, spatial sound effects, and individual object descriptions without requiring additional human annotation. Through a user study with 14 BLV participants, we evaluated the usability and usefulness of Spica and explored user behaviors, preferences, and mental models when interacting with augmented ADs. CCS CONCEPTS• Human-centered computing → Auditory feedback; Accessibility technologies; Accessibility systems and tools; • Computing methodologies → Scene understanding.

show abstract

Section: Related Work 21 Audio Descriptions Generationmentioning

confidence: 99%

SPICA: Interactive Video Content Exploration through Augmented Audio Descriptions for Blind or Low-Vision Viewers

Ning,

Wimer,

Jiang

et al. 2024

Proceedings of the CHI Conference on Human Factors in Computing Systems

View full text Add to dashboard Cite

show abstract

“…We also learned that there exist challenges for people with visual impairments to understand video tutorial content for makeup (Section 4.3.1), such as the lack of descriptive data [28,51,65,73,77,98] in makeup tutorial videos and overuse of demonstrative pronouns in videos. Specifically for makeup tutorial videos, our participants mentioned that detailed applications and product information are essential for their purposes of watching them (e.g., brand, volume, where and how to apply) (Section 4.3.1), which has different focuses comparing with general videos.…”

Section: Improve Support For Better Makeup Learning Experiencesmentioning

confidence: 99%

"It Feels Like Taking a Gamble": Exploring Perceptions, Practices, and Challenges of Using Makeup and Cosmetics for People with Visual Impairments

Li,

Spektor,

Xia

et al. 2022

Preprint

View full text Add to dashboard Cite

Makeup and cosmetics offer the potential for self-expression and the reshaping of social roles for visually impaired people. However, there exist barriers to conducting a beauty regime because of the reliance on visual information and color variances in makeup. We present a content analysis of 145 YouTube videos to demonstrate visually impaired individuals' unique practices before, during, and after doing makeup. Based on the makeup practices, we then conducted semi-structured interviews with 12 visually impaired people to discuss their perceptions of and challenges with the makeup process in more depth. Overall, through our findings and discussion, we present novel perceptions of makeup from visually impaired individuals (e.g., broader representations of blindness and beauty).The existing challenges provide opportunities for future research to address learning barriers, insufficient feedback, and physical and environmental barriers, making the experience of doing makeup more accessible to people with visual impairments. CCS Concepts: • Human-centered computing → Empirical studies in accessibility.

show abstract

“…Similarly, Kobayashi et al (2009) describe the application of TTS AD in online videos on websites. A wide survey in which three kinds of voices were tested (human, standard TTS and prototype TTS) followed by in-depth interview sessions, both in Japan and in the US, showed that TTS AD was accepted by end-users, especially for relatively short videos and informational content.…”

Section: Technology In Audio Descriptionmentioning

confidence: 99%

Speaker diarization and speech recognition in the semi-automatization of audio description: An exploratory study on future possibilities?

2015

View full text Add to dashboard Cite

Providing synthesized audio description for online videos

Cited by 21 publications

References 3 publications

SPICA: Interactive Video Content Exploration through Augmented Audio Descriptions for Blind or Low-Vision Viewers

SPICA: Interactive Video Content Exploration through Augmented Audio Descriptions for Blind or Low-Vision Viewers

"It Feels Like Taking a Gamble": Exploring Perceptions, Practices, and Challenges of Using Makeup and Cosmetics for People with Visual Impairments

Speaker diarization and speech recognition in the semi-automatization of audio description: An exploratory study on future possibilities?

Contact Info

Product

Resources

About