Multiday EMG-Based Classification of Hand Motions with Deep Learning Techniques

Abstract

Pattern recognition of electromyography (EMG) signals can potentially improve the performance of myoelectric control for upper limb prostheses with respect to current clinical approaches based on direct control. However, the choice of features for classification is challenging and impacts long-term performance. Here, we propose the use of EMG raw signals as direct inputs to deep networks with intrinsic feature extraction capabilities recorded over multiple days. Seven able-bodied subjects performed six active motions (plus rest), and EMG signals were recorded for 15 consecutive days with two sessions per day using the MYO armband (MYB, a wearable EMG sensor). The classification was performed by a convolutional neural network (CNN) with raw bipolar EMG samples as the inputs, and the performance was compared with linear discriminant analysis (LDA) and stacked sparse autoencoders with features (SSAE-f) and raw samples (SSAE-r) as inputs. CNN outperformed (lower classification error) both LDA and SSAE-r in the within-session, between sessions on same day, between the pair of days, and leave-out one-day evaluation (p < 0.001) analyses. However, no significant difference was found between CNN and SSAE-f. These results demonstrated that CNN significantly improved performance and increased robustness over time compared with standard LDA with associated handcrafted features. This data-driven features extraction approach may overcome the problem of the feature calibration and selection in myoelectric control.

Deep Learning in Physiological Signal Data: A Survey

“…Hand motion recognition [9][10][11][12][13][14][15][16][17], Muscle activity recognition [18][19][20][21][22][23] ECG Heartbeat signal classification , Heart disease classification [49][50][51][52][53][54][55][56][57][58][59][60][61][62][63], Sleep-stage classification [64][65][66][67][68], Emotion classification [69], age and gender prediction [70] EEG Brain functionality classification , Brain disease classification , Emotion classification [122][123][124][125][126][127][128][129], Sleep-stage classification [130][131][132][133]…”

Conventional and non conventional body motions modelling and control. Application to the handwriting process

“…As for kinematic models, they generate curvilinear speed profiles reflecting the effect of neuromuscular impulses involved in the generation of motions. Many models have been developed under this approach such as the deltalognormal [10][11][12][13][14][15][16][17][18][19][20][21][22][23][24][25][26][27][28][29], the double gaussian [30], the sigma-lognormal [31], the double beta [32]. The problem of kinematic models is the lack of information on the spatial aspect of the movement.…”

Identification of Hand Movements from Electromyographic Signals Using Machine Learning

“…Finally, in DL, different architectures are reported, including fully connected artificial neural networks (ANN) and convolutional neural networks (CNN). In particular, [21] used an architecture that includes a convolution layer with 32 filters, a ReLu activation layer, a MaxPooling layer, a fully connected layer, and, lastly, a softmax output layer with six units.…”