A CNN Model for Human Parsing Based on Capacity Optimization

Abstract

Although a state-of-the-art performance has been achieved in pixel-specific tasks, such as saliency prediction and depth estimation, convolutional neural networks (CNNs) still perform unsatisfactorily in human parsing where semantic information of detailed regions needs to be perceived under the influences of variations in viewpoints, poses, and occlusions. In this paper, we propose to improve the robustness of human parsing modules by introducing a depth-estimation module. A novel scheme is proposed for the integration of a depth-estimation module and a human-parsing module. The robustness of the overall model is improved with the automatically obtained depth labels. As another major concern, the computational efficiency is also discussed. Our proposed human parsing module with 24 layers can achieve a similar performance as the baseline CNN model with over 100 layers. The number of parameters in the overall model is less than that in the baseline model. Furthermore, we propose to reduce the computational burden by replacing a conventional CNN layer with a stack of simplified sub-layers to further reduce the overall number of trainable parameters. Experimental results show that the integration of two modules contributes to the improvement of human parsing without additional human labeling. The proposed model outperforms the benchmark solutions and the capacity of our model is better matched to the complexity of the task.

Part-aware Panoptic Segmentation

“…However, dense part-level segmentation remained for a long time instance-agnostic, as it is usually treated as a semantic segmentation problem [17,22,23,30,36,41,43,44,45,64]. In the trend of coming to more holistic tasks, a dense pose task was introduced in [1] and a unification of pose estimation and part segmentation is provided in [14].…”

Special Features on Intelligent Imaging and Analysis

“…Many imaging techniques have been recently developed with CNN (convolutional neural network). A new approach with a depth module has been applied to human parsing by Jiang and Chi [5]. The method integrates a depth estimation module and a segmentation module as a variation of CNN (convolutional neural network) for image analysis, thus improving the performance for human parsing.…”