Computer animated visual translation from natural language to sign language

Lee, Jintae; Kunii, Tosiyasu L.

doi:10.1002/vis.4340040203

Cited by 11 publications

(6 citation statements)

References 8 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Besides, there is a limitation in this system that the link connecting two joints in the 3Dmodel should be the same length as the signlanguage actor's link [3]. J. Lee et al [4] use some special motion codes carefully pre-defined from the motion features of sign language. These codes define the movements or shape of the arms and hands.…”

Section: Related Workmentioning

confidence: 99%

A Direct3D-Based Multi-model E-Learning System for Chinese Sign Language

Liu

Chen

Yan

et al. 2009

2009 International Conference on Digital Image Processing

View full text Add to dashboard Cite

This paper describes a Direct3D-based multi-model e-learning system for Chinese sign language (CSL), which we design for both hearing-impaired people and hearing people to learn standard CSL. This system includes two key techniques: 3D human model animation and gesture motion retargeting. A novel virtual human animation approach is proposed to realize high-quality and realistic 3D human model animation. This approach utilizes skinned mesh technique based on Direct3D and the effect of 3D human model animation shows that the approach we proposed have good performance and can successfully solve the serration problem which is a definite flaw of traditional CSL. In addition, a constraint-based Inverse Kinematics (IK) algorithm for gesture motion retargeting is also presented in this paper. As there are multiple models in our system, the proposed algorithm is aimed to retarget the sign language data captured by motion capture device to different 3D human models with different sizes and proportions. Experimental results prove that it can greatly improve the exactness of sign language.

show abstract

Section: Related Workmentioning

confidence: 99%

A Direct3D-Based Multi-model E-Learning System for Chinese Sign Language

Liu

Chen

Yan

et al. 2009

2009 International Conference on Digital Image Processing

View full text Add to dashboard Cite

show abstract

“…Very early efforts focused exclusively on the manual aspects of the language (Lee and Kunii, 1993;Zhao et al, 2000;Grieve-Smith 2002). Some acknowledge the need for nonmanual signals but have not yet implemented them for all facial features (Karpouzis, Caridakis, Fotinea and Efthimiou, 2007).…”

Section: Related Workmentioning

confidence: 99%

Generating Co-occurring Facial Nonmanual Signals in Synthesized American Sign Language

Schnepp

Wolfe

McDonald

et al. 2013

Proceedings of the International Conference on Computer Graphics Theory and Applications and International Conference on Inform

View full text Add to dashboard Cite

Translating between English and American Sign Language (ASL) requires an avatar to display synthesized ASL. Essential to the language are nonmanual signals that appear on the face. In the past, these have posed a difficult challenge for signing avatars. Previous systems were hampered by an inability to portray simultaneously-occurring nonmanual signals on the face. This paper presents a method designed for supporting co-occurring nonmanual signals in ASL. Animations produced by the new system were tested with 40 members of the Deaf community in the United States. Participants identified all of the nonmanual signals even when they co-occurred. Co-occurring question nonmanuals and affect information were distinguishable, which is particularly striking because the two processes move an avatar's brows in a competing manner. This breakthrough brings the state of the art one step closer to the goal of an automatic English-to-ASL translator. .

show abstract

“…In addition, they can be entirely characterized by units defined as: -hand shape, -hand orientation, -location and dynamics of the movement [2].…”

Section: Statementioning

confidence: 99%

Synthesis of sign language gestures

Gibet

1994

Conference Companion on Human Factors in Computing Systems - CHI '94

View full text Add to dashboard Cite

Communication with the hearing-impaired can be improved by an interface that is capable of translating natural language into animated sign-language. This short-paper presents a model that simulates natural hand-arm movements. A simple command, specified in terms of successive target end-points is translated through the control model into a complete movement trajectory. The main issues of this model are :-the synthesized gestures me very natural, -the command is very efficient since it straightforwardly translates sign language specification into joint angles or positions.

show abstract

Computer animated visual translation from natural language to sign language

Cited by 11 publications

References 8 publications

A Direct3D-Based Multi-model E-Learning System for Chinese Sign Language

A Direct3D-Based Multi-model E-Learning System for Chinese Sign Language

Generating Co-occurring Facial Nonmanual Signals in Synthesized American Sign Language

Synthesis of sign language gestures

Contact Info

Product

Resources

About