Learning enhanced features and inferring twice for fine-grained image classification

Abstract

Fine-Grained Visual Categorization (FGVC) aims to distinguish between extremely similar subordinate-level categories within the same basic-level category. Existing research has proven the great importance of the discriminative features in FGVC but ignored the contributions for correct classification from other features, and the extracted features always contain more information about the obvious regions but less about subtle regions. In this paper, firstly, a novel module named forcing module is proposed to force the network to extract more diverse features for FGVC, which generates a suppression mask based on the class activation maps to suppress the most distinguishable regions, so as to force the network to extract other secondary distinguishable features as the final features. The forcing module consists of the original branch and the forcing branch. The original branch focuses on the primary discriminative regions while the forcing branch focuses on secondary discriminative regions. Secondly, in order to solve the problem that information of small-scale distinguishable features is lost seriously after multi-layer down-sampling, according to the class activation maps of the first prediction, the object is cropped and scaled as the second input. To reduce the prediction error, the first and second prediction probabilities are fused as the final prediction result. Experimental results indicate that the proposed method not only outperforms the baseline model by a large margin (3.7%, 5.9%, 3.1% respectively) on CUB-200-2011, Stanford-Cars, and FGVC-Aircraft, but also achieves state-of-the-art performance on FGVC-Aircraft.

Pyramid convolution and multi-frequency spatial attention for fine-grained visual categorization

“…Backbone Bird Air Cars Attention cutout [19] MC-Loss [20] NTS-Net [4] CIN [11] TASN [10] F-Net [7] DB [5] SDNs [21] FBSD [6] 2, our method outperforms all other methods on CUB-200-2011, and the accuracy is higher than the second best FBSD by 0.2%. The FBSD adopts ResNet50 as the backbone and only use the convolution for feature enhancement, whose feature representation is poor than our proposed PCMFSA.…”

“…Sun et al [6] proposed feature boosting, suppression, and diversification (FBSD) model for FGVC, which forces the network to learn more feature information by boosting and suppression module, and learn complementary information through diversification module. And, Nie et al [7] designed a forcing module that consists of two branches. The original branch focuses on the most discriminative regions, while the forcing branch learns other feature information.…”

Multi-Model Fusion Fine-Grained Image Classification Method Based on Migration Learning

“…These three methods are respectively a fine-grained image classification method based on multiscale feature fusion (MSF-FGVC), a fine-grained image classification method based on learning enhanced features and double inference (LEF-FGVC), and a trusted multigranular information fusion method. Fine-grained image classification method (TMG-FGVC) [19][20][21]. The accuracy changes with iterations of the research method and three advanced methods on the two data sets were analyzed, and the results are shown in Figure 12.…”