A Novel Gait Phase Recognition Method Based on DPF-LSTM-CNN Using Wearable Inertial Sensors

Abstract

Gait phase recognition is of great importance in the development of rehabilitation devices. The advantages of Long Short-Term Memory (LSTM) and Convolutional Neural Network (CNN) are combined (LSTM-CNN) in this paper, then a gait phase recognition method based on LSTM-CNN neural network model is proposed. In the LSTM-CNN model, the LSTM layer is used to process temporal sequences and the CNN layer is used to extract features A wireless sensor system including six inertial measurement units (IMU) fixed on the six positions of the lower limbs was developed. The difference in the gait recognition performance of the LSTM-CNN model was estimated using different groups of input data collected by seven different IMU grouping methods. Four phases in a complete gait were considered in this paper including the supporting phase with the right hill strike (SU-RHS), left leg swimming phase (SW-L), the supporting phase with the left hill strike (SU-LHS), and right leg swimming phase (SW-R). The results show that the best performance of the model in gait recognition appeared based on the group of data from all the six IMUs, with the recognition precision and macro-F1 unto 95.03% and 95.29%, respectively. At the same time, the best phase recognition accuracy for SU-RHS and SW-R appeared and up to 96.49% and 95.64%, respectively. The results also showed the best phase recognition accuracy (97.22%) for SW-L was acquired based on the group of data from four IMUs located at the left and right thighs and shanks. Comparably, the best phase recognition accuracy (97.86%) for SU-LHS was acquired based on the group of data from four IMUs located at left and right shanks and feet. Ulteriorly, a novel gait recognition method based on Data Pre-Filtering Long Short-Term Memory and Convolutional Neural Network (DPF-LSTM-CNN) model was proposed and its performance for gait phase recognition was evaluated. The experiment results showed that the recognition accuracy reached 97.21%, which was the highest compared to Deep convolutional neural networks (DCNN) and CNN-LSTM.

Estimation of Muscle Forces of Lower Limbs Based on CNN–LSTM Neural Network and Wearable Sensor System

“…Suin et al developed a wearable sensor system and estimated the lower limb muscle forces; however, the estimation method was an inverse dynamicsbased static optimization method [31]. We also discussed gait phase recognition using DPF-LSTM-CNN [32] and muscle force estimation in the STS process using sensors [33].…”

Ubiquitous Gait Analysis through Footstep-Induced Floor Vibrations

“…These approaches can achieve high accuracy in well-calibrated clinics but are unsuitable for ubiquitous gait analysis in daily life because they are expensive and require long calibration time and professionally trained staff to operate [ 12 ]. To enable ubiquitous gait analysis, other studies have developed portable cameras, wearable devices, pressure mats, and radio frequency (RF)-based systems for daily tracking [ 13 , 14 , 15 , 16 , 17 , 18 , 19 ]. However, they have raised privacy concerns and operational limitations such as direct line-of-sight, having to carry/charge devices, and dense sensor deployment, preventing them from being widely adopted.…”