Domain Adaptation for Rare Classes Augmented with Synthetic Samples

Abstract

To alleviate lower classification performance on rare classes in imbalanced datasets, a possible solution is to augment the underrepresented classes with synthetic samples. Domain adaptation can be incorporated in a classifier to decrease the domain discrepancy between real and synthetic samples. While domain adaptation is generally applied on completely synthetic source domains and real target domains, we explore how domain adaptation can be applied when only a single rare class is augmented with simulated samples. As a testbed, we use a camera trap animal dataset with a rare deer class, which is augmented with synthetic deer samples. We adapt existing domain adaptation methods to two new methods for the single rare class setting: DeerDANN, based on the Domain-Adversarial Neural Network (DANN), and DeerCORAL, based on deep correlation alignment (Deep CORAL) architectures. Experiments show that DeerDANN has the highest improvement in deer classification accuracy of 24.0% versus 22.4% improvement of DeerCORAL when compared to the baseline. Further, both methods require fewer than 10k synthetic samples, as used by the baseline, to achieve these higher accuracies. DeerCORAL requires the least number of synthetic samples (2k deer), followed by DeerDANN (8k deer).

Automated detection of an insect‐induced keystone vegetation phenotype using airborne LiDAR

“…Collecting more training data of C. nigriceps-occupied trees will likely increase the accuracy of our model (Huang et al, 2016), which would involve either geotagging more C. nigriceps-occupied trees or finding creative ways of bootstrapping inputs from graphic engines (e.g. Beery et al, 2018;Das et al, 2021). Better representation schemes for input point clouds is another option to explore: in reducing 3D point clouds to multi-aspect 2D representations, structural information is lost.…”

A Survey on Deep Transfer Learning and Beyond

“…Dual-stream architectures [59][60][61][62][63][64][65][66][67][68][69][70][71][72] and approaches that operate directly on image features [73][74][75] are representative ways to perform discrepancy-based DTL. In addition, optimizing the network architecture [99] and improving the feature alignment [100][101][102][103] have also received attention from researchers in recent years. The essence of the above approaches is to minimize the feature differences between the source and target domain datasets.…”

“…With the great success of the generative adversarial network (GAN) [99] in image processing, researchers have attempted to incorporate the idea of GAN with TL to improve cross-domain learning. GAN is composed of two sub-networks (multilayer perception), including a generator G(•) and a discriminator D(•).…”