Rapid Construction of a Web-Enabled Medical Speech to Sign Language Translator Using Recorded Video

Ahmed, Farhia; Bouillon, Pierrette; Destefano, Chelle; Gerlach, Johanna; Hooper, Angela; Rayner, Manny; Strasly, Irène; Tsourakis, Nikos; Weiss, Catherine

doi:10.1007/978-3-319-69365-1_10

Cited by 3 publications

(3 citation statements)

References 8 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Videos are recorded using the same third-party recording tool as is used for recording audio content; the tool had already been adapted for this purpose in a previous project (Ahmed et al, 2016). The workflow for recording is modalityindependent.…”

Section: Lara and íTmmentioning

confidence: 99%

LARA in the Service of Revivalistics and Documentary Linguistics: Community Engagement and Endangered Languages

Zuckermann

Vigfússon²,

Rayner

et al. 2021

computel

Self Cite

View full text Add to dashboard Cite

We argue that LARA, a new web platform that supports easy conversion of text into an online multimedia form designed to support non-native readers, is a good match to the task of creating high-quality resources useful for languages in the revivalistics spectrum. We illustrate with initial case studies in three widely different endangered/revival languages: Irish (Gaelic); Icelandic Sign Language (ÍTM); and Barngarla, a reclaimed Australian Aboriginal language. The exposition is presented from a language community perspective. Links are given to examples of LARA resources constructed for each language.

show abstract

Section: Lara and íTmmentioning

confidence: 99%

LARA in the Service of Revivalistics and Documentary Linguistics: Community Engagement and Endangered Languages

Zuckermann

Vigfússon²,

Rayner

et al. 2021

computel

Self Cite

View full text Add to dashboard Cite

show abstract

“…The second file lists the declared video examples which have not yet been recorded. This is uploaded to a web tool which prompts the signer to create the actual videos [17].…”

Section: Videosmentioning

confidence: 99%

Menusigne: A Serious Game for Learning Sign Language Grammar

Rayner¹,

Strasly²,

Tsourakis³

et al. 2017

7th ISCA Workshop on Speech and Language Technology in Education (SLaTE 2017)

Self Cite

View full text Add to dashboard Cite

We present Menusigne, a serious game designed to help beginner students learn basic sign language grammar. At the first level, the game uses a generation grammar and a signing avatar to let the student create signed utterances from menu-based patterns; at higher levels, the game presents avatar-generated or human-produced signed utterances, and the student uses the menus to indicate the meaning. The intention is to introduce the students to the principles of sign language grammar, and the game in particular emphasises the crucial role played by nonmanual (non-hand) movements. We describe an initial course for teaching basic Langue des Signes Française (French sign language) to French students.

show abstract

“…Bi-directional communication in the machine translation, system comprises of two sub-systems: (i) receives the speech or text as input and generates the corresponding gesture as output, (ii) captures the gesture as input and generates the text or speech as output [8,84]. As per Ethnologue 2019, there are 7111 spoken languages and near about 200 sign languages in the world [3,45]. Approximately 6 million hearing impaired people are living in India [90].…”

Section: Introductionmentioning

confidence: 99%

An automatic machine translation system for multi-lingual speech to Indian sign language

Dhanjal

Singh

2021

Multimed Tools Appl

View full text Add to dashboard Cite

Sign language (SL) is the best suited communication medium for hearing impaired people. Even with the advancement of technology, there is a communication gap between the hearing impaired and hearing people. The aim of this research work is to bridge this gap by developing an automatic system that translates the speech to Indian Sign Language using Avatar (SISLA). The whole system works in three phases: (i) The first phase includes the speech recognition (SR) of isolated words for English, Hindi and Punjabi in speaker independent environment (ii) The second phase translates the source language into Indian Sign Language (ISL) (iii) HamNoSys based 3D avatar represents the ISL gestures. The four major implementation modules for SISLA include: requirement analysis, data collection, technical development and evaluation. The multi-lingual feature makes the system more efficient. The training and testing speech sample files for English (12,660, 4218), Hindi (12,610, 4211) and Punjabi (12,600, 4193) have been used to train and test the SR models. Empirical results of automatic machine translation show that the proposed trained models have achieved the minimum accuracy of 91%, 89% and 89% for English, Punjabi and Hindi respectively. Sign language experts have also been used to evaluate the sign error rate through feedback. Future directions to enhance the proposed system using non-manual SL features along with the sentence level translation has been suggested. Usability testing based on survey results confirm that the proposed SISLA system is suitable for education as well as communication purpose for hearing impaired people.

show abstract

Rapid Construction of a Web-Enabled Medical Speech to Sign Language Translator Using Recorded Video

Cited by 3 publications

References 8 publications

LARA in the Service of Revivalistics and Documentary Linguistics: Community Engagement and Endangered Languages

LARA in the Service of Revivalistics and Documentary Linguistics: Community Engagement and Endangered Languages

Menusigne: A Serious Game for Learning Sign Language Grammar

An automatic machine translation system for multi-lingual speech to Indian sign language

Contact Info

Product

Resources

About