Design of an efficient framework for fast prototyping of customized human–computer interfaces and virtual environments for rehabilitation

Avola, Danilo; Spezialetti, Matteo; Placidi, Giuseppe

doi:10.1016/j.cmpb.2013.01.009

Cited by 59 publications

(39 citation statements)

References 21 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Hand gesture recognition provides a means to decode the information expressed by the reported categories which are always more used to interact with innovative applications, such as interactive games [3], [4], serious games [5], [6], sign language recognition [7]- [10], emotional expression identification [11], [12], remote control in robotics [13], [14] or alternative computer interfaces [15]- [18]. In general, the approaches used in hand gesture recognition can be divided into two main classes: 3D model-based [19] and appearancebased [20].…”

Section: Introductionmentioning

confidence: 99%

Exploiting Recurrent Neural Networks and Leap Motion Controller for the Recognition of Sign Language and Semaphoric Hand Gestures

Avola

Bernardi

Cinque

et al. 2019

IEEE Trans. Multimedia

Self Cite

151

View full text Add to dashboard Cite

In human interactions, hands are a powerful way of expressing information that, in some cases, can be used as a valid substitute for voice, as it happens in Sign Language. Hand gesture recognition has always been an interesting topic in the areas of computer vision and multimedia. These gestures can be represented as sets of feature vectors that change over time. Recurrent Neural Networks (RNNs) are suited to analyse this type of sets thanks to their ability to model the long term contextual information of temporal sequences. In this paper, a RNN is trained by using as features the angles formed by the finger bones of human hands. The selected features, acquired by a Leap Motion Controller (LMC) sensor, have been chosen because the majority of human gestures produce joint movements that generate truly characteristic corners. A challenging subset composed by a large number of gestures defined by the American Sign Language (ASL) is used to test the proposed solution and the effectiveness of the selected angles. Moreover, the proposed method has been compared to other state of the art works on the SHREC dataset, thus demonstrating its superiority in hand gesture recognition accuracy.• the search of a robust solution able to recognize also gestures that are similar to each other; • the achievement of the highest accuracy level compared with works of the current literature.

show abstract

Section: Introductionmentioning

confidence: 99%

Exploiting Recurrent Neural Networks and Leap Motion Controller for the Recognition of Sign Language and Semaphoric Hand Gestures

Avola

Bernardi

Cinque

et al. 2019

IEEE Trans. Multimedia

Self Cite

151

View full text Add to dashboard Cite

show abstract

“…The use of a gaming system may contribute to the improvement of personal motivation when performing rehabilitation exercises [7]. The use of a low-cost device leads to the feasible set-up of the rehabilitation exercise in a home-based environment [8]. This could make the users more comfortable and at ease when performing rehabilitation exercises.…”

Section: Discussionmentioning

confidence: 99%

Serious game and functional rehabilitation for the lower limbs

Tannous¹,

Istrate²,

Tho³

et al. 2016

European Research in Telemedicine / La Recherche Européenne en

View full text Add to dashboard Cite

“…Other researchers [3], in an effort to aid the therapist in adapting rehabilitation exercises to the characteristics of the patients, developed a customized interface. The game commands, however, are performed using broad movements, captured by the Kinect, which are not appropriate for the leisure of children with severe motor impairments.…”

Section: Discussionmentioning

confidence: 99%

“…In this sense, the need for interfaces that suit individuals' needs is evident [3]. Relevant requirements for achieving this objective include the ability to use an interface in real time and with precision.…”

Section: Introductionmentioning

confidence: 97%

“…In addition, computers have been used in combination with virtual environments for the rehabilitation of patients who have experienced cerebrovascular accidents [3]; simulated training [4,5]; the cognitive rehabilitation of patients with different types of mental health disorders [6,7]; providing leisure activities for the visually impaired [8]; and analyzing movements [9,10]. Another study [11] has demonstrated that virtual environments can play an important role in the treatment and training of individuals with disabilities.…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

The design and evaluation of a peripheral device for use with a computer game intended for children with motor disabilities

Scardovelli

2015

Computer Methods and Programs in Biomedicine

View full text Add to dashboard Cite

Design of an efficient framework for fast prototyping of customized human–computer interfaces and virtual environments for rehabilitation

Cited by 59 publications

References 21 publications

Exploiting Recurrent Neural Networks and Leap Motion Controller for the Recognition of Sign Language and Semaphoric Hand Gestures

Exploiting Recurrent Neural Networks and Leap Motion Controller for the Recognition of Sign Language and Semaphoric Hand Gestures

Serious game and functional rehabilitation for the lower limbs

The design and evaluation of a peripheral device for use with a computer game intended for children with motor disabilities

Contact Info

Product

Resources

About