A Parasitic Mechanism-Based Filter Pruning Method for Deep Convolutional Neural Networks

Xu, Han; Xue, Lei; Xu, Ying; Huang, Keju

doi:10.1109/iciba50161.2020.9277078

Cited by 2 publications

(2 citation statements)

References 9 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…This has significantly reduced the overall computational complexity of the network. Xu Han et al [8] has proposed a Parasitic-Mechanism (PAM) based filter pruning. In first step, Parasitic Layer is constructed which intelligently learns unimportant filters during training process for pruning.…”

Section: A Network Compression Using Pruning Methodsmentioning

confidence: 99%

See 1 more Smart Citation

Resource-Restricted Environments Based Memory-Efficient Compressed Convolutional Neural Network Model for Image-Level Object Classification

et al. 2023

View full text Add to dashboard Cite

In the past decade, Convolutional Neural Networks (CNNs) have achieved tremendous success in solving complex classification problems. CNN architectures require an excessive number of computations to achieve high accuracy. However, these models are deficient due to the heavy cost of storage and energy, which prohibits the application of CNNs to resource-constrained edge-devices. Hence, developing aggressive optimization schemes for efficient deployment of CNNs on edge devices has become the most important requirement. To find the optimal approach, we present a resource-limited environment based memoryefficient network compression model for image-level object classification. The main aim is to compress CNN architecture by achieving low computational cost and memory requirements without dropping system's accuracy. To achieve the said goal, we propose a network compression strategy, that works in a collaborative manner, where Soft Filter Pruning is first applied to reduce the computational cost of the model. In the next step, the model is divided into No-Pruning Layers (NP-Layers) and Pruning Layers (P-Layers). Incremental Quantization is applied to P-Layers due to irregular weights distribution, while for NP-Layers, we propose a novel Optimized Quantization algorithm for the quantization of weights up to optimal levels obtained from the Optimizer. This scheme is designed to achieve the best trade-off between compression ratio and accuracy of the model. Our proposed system is validated for image-level object classification on LeNet-5, CIFARquick, and VGG-16 networks using MNIST, CIFAR-10, and ImageNet ILSVRC2012 datasets respectively. We have achieved high compression ratio with negligible accuracy drop, outperforming the state-of-the-art methods.

show abstract

Section: A Network Compression Using Pruning Methodsmentioning

confidence: 99%

“…Additionally, pruning can reduce the number of weights by up to 90%, as described by Han et a. [8]. Despite the success of these two methods, there is still a need to design an efficient compression model that can reduce memory consumption while preserving the system's performance [9].…”

Section: Introductionmentioning

confidence: 99%