Emotional facial expressions in synthesised sign language avatars: a manual evaluation

Smith, Robert G.; Nolan, Brian

doi:10.1007/s10209-015-0410-7

Cited by 15 publications

(8 citation statements)

References 4 publications

(4 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In presenting the results of the literature review an overview of the corpus of papers found in the search will first be provided in order to offer a detailed context for the review findings; particularly in relation to access needs, age range, technologies and intended purpose of technology use .18 papers involved users with sensory impairments as their primary user group. Of these, three involved blind users [21,20,33]; seven involved visually impaired users; three involved both blind and visually impaired users [17,18,20]); two involved deaf users [29,31]; two involved deaf or hard of hearing users [24,28]and one involved hard of hearing users [22]. 14 papers involved users with learning disability as their primary user group.…”

Section: Review Methodsmentioning

confidence: 99%

See 1 more Smart Citation

In Search of a Decision-Making Framework for Involving Users Who Have Learning Disabilities or Sensory Impairments in the Process of Designing Future Technologies

Tai-Seale

Carrizosa

Rix

et al. 2019

Advances in Intelligent Systems and Computing

View full text Add to dashboard Cite

A comprehensive literature review was undertaken in order to identify design approaches that have been employed with users who have learning disabilities or sensory impairment; the factors that influenced their choices and the extent to which the approaches and techniques adopted were successful. There was a huge variation across the corpus regarding whether a justification was offered for the choice of approach and the extent to which those justifications were supported by evidence. In addition there was a lack of comprehensive evaluation of the design approaches. Technology designers who intend working with users with learning disabilities or sensory impairments therefore currently have little to help them decide which design approach might be the most appropriate or effective.

show abstract

Section: Review Methodsmentioning

confidence: 99%

“…Two of the papers offered no definition of UCD or justification as to why UCD might be an appropriate approach to employ with the user group [31,40]. One paper did not offer a definition of UCD, but did cite the ISO standard for UCD [49].…”

Section: User-centred Designmentioning

confidence: 99%

In Search of a Decision-Making Framework for Involving Users Who Have Learning Disabilities or Sensory Impairments in the Process of Designing Future Technologies

Tai-Seale

Carrizosa

Rix

et al. 2019

Advances in Intelligent Systems and Computing

View full text Add to dashboard Cite

show abstract

“…In [6] there was a special issue of the journal Universal Access in the Information Society on using avatars in SL recognition, a collected volume based on presentations given at the symposium Sign Language Translation and Avatar Technology (SLTAT) held in 2013. That included a paper [7] where the authors explored the effect of adding facial expressions which reveal emotional clues, into ISL recognition. They augmented an existing avatar for displaying ISL with basic universal emotions leading to improved recognition.…”

Section: Automatic Recognition Of Irish Sign Languagementioning

confidence: 99%

Recognising Irish Sign Language Using Electromyography

Galea

Smeaton

2019

2019 International Conference on Content-Based Multimedia Indexing (CBMI)

View full text Add to dashboard Cite

Sign language is the non-verbal communication used by people with hearing and speaking impairments. The automatic recognition of sign languages is usually based on video analysis of the signer though this is difficult when considering different light levels or the surrounding environment. The work in this paper uses electromyography (EMG) and focuses on letters of the Irish Sign Language (ISL) alphabet. EMG is the recording of the electrical activity produced to stimulate movement in the skeletal muscles. We capture muscle signals and inertial movement data using the Thalmic MYO armband and, in real time, recognise the ISL alphabet. Our implementation is based on signal processing, feature extraction and machine learning. The only input required to translate the ISL gestures are EMG and movement data, thus our approach is usable in scenarios where using video for automatic recognition video is not possible.

show abstract

“…A restriction imposed by the low-level SiGML representation is that nonmanual activities cannot be extended across several manual activities in a straightforward way; however, workarounds have been introduced for this (Ebling and Glauert, 2015). Experience with SiGML has shown that it is capable of supporting signed animation of satisfactory quality (Smith and Nolan, 2015).…”

Section: Runtime Functionality and Formalismmentioning

confidence: 99%

An Open Web Platform for Rule-Based Speech-to-Sign Translation

Rayner¹,

Bouillon²,

Ebling³

et al. 2016

Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers)

View full text Add to dashboard Cite

We present an open web platform for developing, compiling, and running rulebased speech to sign language translation applications. Speech recognition is performed using the Nuance Recognizer 10.2 toolkit, and signed output, including both manual and non-manual components, is rendered using the JASigning avatar system. The platform is designed to make the component technologies readily accessible to sign language experts who are not necessarily computer scientists. Translation grammars are written in a version of Synchronous Context-Free Grammar adapted to the peculiarities of sign language. All processing is carried out on a remote server, with content uploaded and accessed through a web interface. Initial experiences show that simple translation grammars can be implemented on a time-scale of a few hours to a few days and produce signed output readily comprehensible to Deaf informants. Overall, the platform drastically lowers the barrier to entry for researchers interested in building applications that generate high-quality signed language.

show abstract

Emotional facial expressions in synthesised sign language avatars: a manual evaluation

Abstract: ABSTRACT

Cited by 15 publications

References 4 publications

In Search of a Decision-Making Framework for Involving Users Who Have Learning Disabilities or Sensory Impairments in the Process of Designing Future Technologies

In Search of a Decision-Making Framework for Involving Users Who Have Learning Disabilities or Sensory Impairments in the Process of Designing Future Technologies

Recognising Irish Sign Language Using Electromyography

An Open Web Platform for Rule-Based Speech-to-Sign Translation

Contact Info

Product

Resources

About