Evaluation of an English Word Look-Up Tool for Web-Browsing with Sign Language Video for Deaf Readers

Hariharan, Dhananjai; Al-khazraji, Sedeeq; Huenerfauth, Matt

doi:10.1007/978-3-319-92049-8_15

Cited by 8 publications

(6 citation statements)

References 30 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…These projects include systems that provide sign language animation content on webpages to supplement text content for users. There has also been some work on providing on-demand definitions of terminology in ASL (e.g., by linking to ASL dictionary resources [51]). As discussed in [51], prior work has found that displaying static images of signs provides limited benefit, and generally users have preferred interfaces that combine both text and sign content.…”

Section: Ui/ux Designmentioning

confidence: 99%

See 1 more Smart Citation

Sign Language Recognition, Generation, and Translation

Bragg

Koller

Bellard

et al. 2019

The 21st International ACM SIGACCESS Conference on Computers and Accessibility

Self Cite

265

130

View full text Add to dashboard Cite

Developing successful sign language recognition, generation, and translation systems requires expertise in a wide range of fields, including computer vision, computer graphics, natural language processing, human-computer interaction, linguistics, and Deaf culture. Despite the need for deep interdisciplinary knowledge, existing research occurs in separate disciplinary silos, and tackles separate portions of the sign language processing pipeline. This leads to three key questions: 1) What does an interdisciplinary view of the current landscape reveal? 2) What are the biggest challenges facing the field? and 3) What are the calls to action for people working in the field? To help answer these questions, we brought together a diverse group of experts for a two-day workshop. This paper presents the results of that interdisciplinary workshop, providing key background that is often overlooked by computer scientists, a review of the state-of-the-art, a set of pressing challenges, and a call to action for the research community.Each group focused on the following questions:

show abstract

Section: Ui/ux Designmentioning

confidence: 99%

“…Recent work has used such approaches. For instance, researchers have used Wizardof-Oz methodologies to study how Deaf users would like to issue commands to personal assistants [95] or how Deaf users may benefit from a tool that enables ASL dictionary lookup on-demand when reading English text webpages [51].…”

Section: Interface Designmentioning

confidence: 99%

Sign Language Recognition, Generation, and Translation

Bragg

Koller

Bellard

et al. 2019

The 21st International ACM SIGACCESS Conference on Computers and Accessibility

Self Cite

265

130

View full text Add to dashboard Cite

show abstract

“…Prior work has also investigated other approaches to provide linguistic assistance to DHH adults for making information on the web more accessible, such as the the use of images or dictionary deinitions (in English or ASL) (e.g. [25,31,52]). However, no signiicant improvements in comprehension have been identiied from their use [25,31].…”

Section: Automatic Text Simplification As Reading Assistance Toolsmentioning

confidence: 99%

Reading-Assistance Tools Among Deaf and Hard-of-Hearing Computing Professionals in the U.S.: Their Reading Experiences, Interests and Perceptions of Social Accessibility

Alonzo

Elliot

Dingman

et al. 2022

ACM Trans. Access. Comput.

Self Cite

View full text Add to dashboard Cite

Automatic Text Simplification (ATS) software aims to automatically rewrite complex text to make it simpler to read. Prior research has explored the use of ATS as a reading assistance technology, identifying benefits from providing these technologies to different groups of users, including Deaf and Hard-of-hearing (DHH) adults. However, little work has investigated the interests and requirements of specific groups of potential users of this technology. Considering prior work establishing that computing professionals often need to read about new technologies in order to stay current in their profession, in this study, we investigated the reading experiences and interests of DHH individuals with work experience in the computing industry in ATS-based reading assistance tools, as well as their perspective on the social accessibility of those tools. Through a survey and two sets of interviews, we found that these users read relatively often, especially in support of their work, and were interested in tools to assist them with complicated texts; but misperceptions arising from public use of these tools may conflict with participants’ desired image in a professional context. This empirical contribution motivates further research into ATS-based reading assistance tools for these users, prioritizing which reading activities users are most interested in seeing application of this technology, and highlighting design considerations for creating ATS tools for DHH adults, including considerations for social accessibility.

show abstract

“…In this application, user can click a picture of the story, and the SMARTSign AR mobile application automatically converts it to the corresponding sign. Though not specific to textbook learning, Hariharan, Al-hkhazraji, and Huenerfauth [16] proposed a web-based tool to translate words to ASL for improving accessibility. Initial results show that participants preferred having support tools in their interfaces as opposed to none.…”

Section: Related Workmentioning

confidence: 99%

SignText: a web-based tool for providing accessible text book contents for Deaf learners

Joy¹,

Balakrishnan

Sreeraj³

2021

Univ Access Inf Soc

View full text Add to dashboard Cite

Lack of Sign Language-based learning tools is a hindrance in acquiring knowledge for deaf students. Technology-based tools have introduced innovative ways of learning textbook contents. Augmenting textbook contents with sign can significantly help in learning. This paper proposes SignText, a bilingual tool for learning textbook lessons. This web-based tool works on a web browser to provide sign language-based instructions. Along with signs, simultaneous text-based instructions are also provided to enhance learning. The effectiveness of this tool was studied using an experiment in which 34 deaf students participated. Both quantitative and qualitative studies were conducted to find the effectiveness of SignText. Results show that SignText improves learning for deaf students.

show abstract

Evaluation of an English Word Look-Up Tool for Web-Browsing with Sign Language Video for Deaf Readers

Cited by 8 publications

References 30 publications

Sign Language Recognition, Generation, and Translation

Sign Language Recognition, Generation, and Translation

Reading-Assistance Tools Among Deaf and Hard-of-Hearing Computing Professionals in the U.S.: Their Reading Experiences, Interests and Perceptions of Social Accessibility

SignText: a web-based tool for providing accessible text book contents for Deaf learners

Contact Info

Product

Resources

About