A fully connected deep learning approach to upper limb gesture recognition in a secure FES rehabilitation environment

Abstract

Stroke is one of the leading causes of death and disability in the world. The rehabilitation of Patients' limb functions has great medical value, for example, the therapy of functional electrical stimulation (FES) systems, but suffers from effective rehabilitation evaluation. In this paper, six gestures of upper limb rehabilitation were monitored and collected using microelectromechanical systems sensors, where data stability was guaranteed using data preprocessing methods, that is, deweighting, interpolation, and feature extraction. A fully connected neural network has been proposed investigating the effects of different hidden layers, and determining its activation functions and optimizers. Experiments have depicted that a three‐hidden‐layer model with a softmax function and an adaptive gradient descent optimizer can reach an average gesture recognition rate of 97.19%. A stop mechanism has been used via recognition of dangerous gesture to ensure the safety of the system, and the lightweight cryptography has been used via hash to ensure the security of the system. Comparison to the classification models, for example, k‐nearest neighbor, logistic regression, and other random gradient descent algorithms, was conducted to verify the outperformance in recognition of upper limb gesture data. This study also provides an approach to creating health profiles based on large‐scale rehabilitation data and therefore consequent diagnosis of the effects of FES rehabilitation.

Deep CNN-LSTM With Self-Attention Model for Human Activity Recognition Using Wearable Sensor

“…Nevertheless, their used sensor collects incorrect data, but the model they proposed performs well with abnormal data. To recognize the upper limb gesture in a rehabilitation setting, the authors in [36] used a fully connected deep learning approach. They compare their model to various machine learning algorithms and show that the proposed fully connected neural network outperforms them in gesture recognition.…”

Towards open-set text recognition via label-to-prototype learning

“…In recent years, the study of human gestures based on cameras and sensors has gained increasing significance in human-machine interaction (HMI) [1], [2], [3]. In this interaction paradigm, gesture recognition serves as a foundational task and has been extensively applied across diverse domains, such as rehabilitation robotics [4], [5], mobile interaction [6], [7], virtual reality [8] and exoskeleton control [9].…”

Graph convolutional network‐based deep feature learning for cardiovascular disease recognition from heart sound signals

“…To classify data, CNN architectures in 1D, 2D, 22 and 3D 23 variants can be utilized. Each method requires a large amount of data to train CNN 24 . The deep transfer learning (DTL) method 25 can eliminate the need for large input data for CNNs.…”

“…Each method requires a large amount of data to train CNN. 24 The deep transfer learning (DTL) method 25 can eliminate the need for large input data for CNNs. CNN networks can be tuned using transfer learning (TL) to improve both time and comprehensiveness.…”