Accuracy-aware Structured Filter Pruning for Deep Neural Networks

Abstract

Deep neural networks (DNNs) have several technical issues on computational complexity, redundancy, and the parameter sizeespecially when applied in embedded devices. Among those issues, lots of parameters require high memory capacity which causes migration problem to embedded devices. Many pruning techniques are proposed to reduce the network size in deep neural networks, but there are still various issues that exist for applying pruning techniques to DNNs. In this paper, we propose a simple-yetefficient scheme, accuracy-aware structured pruning based on the characterization of each convolutional layer. We investigate the accuracy and compression rate of individual layer with a fixed pruning ratio and re-order the pruning priority depending on the accuracy of each layer. To achieve a further compression rate, we also add quantization to the linear layers. Our results show that the order of the layers pruned does affect the final accuracy of the deep neural network. Based on our experiments, the pruned AlexNet and VGG16 models' parameter size is compressed up to 47.28x and 35.21x with less than 1% accuracy drop with respect to the original model.