No abstract

Gesture recognition technology is widely used in the flexible and precise control of manipulators in the assisted medical field. Our MResLSTM algorithm can effectively perform dynamic gesture recognition. The result of surface EMG signal decoding is applied to the controller, which can improve the fluency of artificial hand control. Much current gesture recognition research using sEMG has focused on static gestures. In addition, the accuracy of recognition depends on the extraction and selection of features. However, Static gesture research cannot meet the requirements of natural human-computer interaction and dexterous control of manipulators. Therefore, a multi-stream residual network (MResLSTM) is proposed for dynamic hand movement recognition. This study aims to improve the accuracy and stability of dynamic gesture recognition. Simultaneously, it can also advance the research on the smooth control of the Manipulator. We combine the residual model and the convolutional short-term memory model into a unified framework. The architecture extracts spatiotemporal features from two aspects: global and deep, and combines feature fusion to retain essential information. The strategy of pointwise group convolution and channel shuffle is used to reduce the number of network calculations. A dataset is constructed containing six dynamic gestures for model training. The experimental results show that on the same recognition model, the gesture recognition effect of fusion of sEMG signal and acceleration signal is better than that of only using sEMG signal. The proposed approach obtains competitive performance on our dataset with the recognition accuracies of 93.52%, achieving state-of-the-art performance with 89.65% precision on the Ninapro DB1 dataset. Our bionic calculation method is applied to the controller, which can realize the continuity of human-computer interaction and the flexibility of manipulator control.

No abstract

The feature layers of different layers in the single shot multibox detector (SSD) are independently used as the input of the classification network, so it is easy to detect the same object. This article proposes an improved SSD model based on deep feature fusion. In the SSD algorithm, the deep feature fusion between the target detection layer and its adjacent feature layer is used, including convolution kernels and pooling kernels of different sizes, down-sampling of low-level features and up-sampling of deconvolution of high-level features. The network is improved by combining the target frame recommendation strategy in the SSD algorithm and the frame regression algorithm. The experimental results show that the improved SSD algorithm improves the detection accuracy and detection rate of the target, and the effect is more obvious for the relatively small-scale target.