Reweighted Dynamic Group Convolution

Abstract

Computational efficiency of modern deep convolutional networks is always desired in real world applications. Various types of group convolutions have been widely used to reduce the complexity of the networks. Inspired by the previous work, a new reweighted dynamic group convolution (RDGC) structure, including a reweighted pruning module and a survival loss, is proposed in this work for more precise channel pruning. Specifically, a layer-wise pruning rate adjustment strategy is employed with an intra-cluster loss to guide the learning of self-attention implicitly. The proposed model is more capable to select the suitable channels to construct the filter groups. Its effectiveness is demonstrated by extensive experiments on four public datasets, namely CIFAR-10, CIFAR-100 and two fine-grained image datasets (Stanford Dogs and Stanford Cars).

SCINet: Semantic Cue Infusion Network for Lane Detection

“…We set the number of weight channels of each output branch to be equal. Then we perform a dynamic group convolution [21] and 1 × 1 convolutions on F seg to obtain different channel numbers of three output branches (i.e., the confidence value: 1 channel; the offset value: 2 channels; the feature value: 4 channels).…”