Vision-based gesture modeling for signed expressions recognition

Kapuściński, Tomasz; Inglot, Krzysztof

doi:10.1016/j.procs.2022.09.156

Cited by 1 publication

(1 citation statement)

References 13 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…A more suitable approach is vision-based detection. Gestures are captured by a video camera which creates a sequence of images [10], [11]. The use of deep learning algorithms, especially convolutional networks (CNN), contributes to the high performance of hand gesture recognition and demonstrates high accuracy [12], [1].…”

Section: Introductionmentioning

confidence: 99%

A Novel Hybrid Deep Learning Architecture for Dynamic Hand Gesture Recognition

Hax,

Penava,

Krodel

et al. 2024

IEEE Access

View full text Add to dashboard Cite

Hand gestures are a form of natural communication used in human-computer interaction, however, when gestures are video-based, extraction of features for classification is complex. Current machine learning models struggle to achieve high accuracies when using videos recorded in realistic environments. In this work, we propose a hybrid architecture consisting of a recurrent neural network (RNN), including a long short-term memory layer, on top of a convolutional neural network, to recognize dynamic hand gestures recorded in realistic environments. We used a dataset of 6 dynamic hand gestures: scroll-left, scroll-right, scroll-up, scroll-down, zoom-in, and zoom-out. Our implemented inception-v3 model extracted features and provided the wrapped frame-feature map as input for the RNN, which performs the final classification. The proposed model classifies gestures with an average accuracy of 83.66%. By doing so, we intend to narrow the disparity between realistic environments and high accuracy. Finally, we compare the accuracy of our proposed dynamic hand gesture recognition model with that of the benchmark.

show abstract