Research on gesture segmentation method based on FCN combined with CBAM-ResNet50

Abstract

As a key step of gesture recognition, gesture segmentation can effectively reduce the impact of complex backgrounds on recognition results and improve the accuracy of gesture recognition. The gesture segmentation algorithm based on image processing is easily affected by the complex backgrounds in the image, resulting in poor gesture segmentation effect and low precision. To improve the effect of gesture segmentation under complex backgrounds, this paper proposes a gesture segmentation method based on FCN combined with the CBAM-ResNet50 network model. The trunk network of FCN is proposed as a new ResNet-50 framework. CBAM attention mechanism is introduced into the residual structure to enhance the extraction ability of multi-scale context information. And we achieve deep feature and shallow feature extraction and fusion by combining expansion convolution and enhancing the parameters of the convolutional layer, so as to improve the precision of gesture segmentation. In addition, the methods of data preprocessing and loading pre-training weights are used to enhance the model’s robustness and performance and expedite the training time. In the experiments, the NUS-II gesture data set with a complex background was used for testing. The average recognition rate of gesture pixels was 97.41% and gesture IoU was 94.54%. The experimental results show that the proposed method has a good effect on gesture segmentation for gesture images with complex backgrounds.