A Survey on Generative Adversarial Networks for imbalance problems in computer vision tasks

Abstract

Any computer vision application development starts off by acquiring images and data, then preprocessing and pattern recognition steps to perform a task. When the acquired images are highly imbalanced and not adequate, the desired task may not be achievable. Unfortunately, the occurrence of imbalance problems in acquired image datasets in certain complex real-world problems such as anomaly detection, emotion recognition, medical image analysis, fraud detection, metallic surface defect detection, disaster prediction, etc., are inevitable. The performance of computer vision algorithms can significantly deteriorate when the training dataset is imbalanced. In recent years, Generative Adversarial Networks (GANs) have gained immense attention by researchers across a variety of application domains due to their capability to model complex real-world image data. It is particularly important that GANs can not only be used to generate synthetic images, but also its fascinating adversarial learning idea showed good potential in restoring balance in imbalanced datasets. In this paper, we examine the most recent developments of GANs based techniques for addressing imbalance problems in image data. The real-world challenges and implementations of synthetic image generation based on GANs are extensively covered in this survey. Our survey first introduces various imbalance problems in computer vision tasks and its existing solutions, and then examine key concepts such as deep generative image models and GANs. After that, we propose a taxonomy to summarize GANs based techniques for addressing imbalance problems in computer vision tasks into three major categories: 1. Image level imbalances in classification, 2. object level imbalances in object detection and 3. pixel level imbalances in segmentation tasks. We elaborate the imbalance problems of each group, and further provide GANs based solutions in each group. Readers will understand how GANs based techniques can handle the problem of imbalances and boost performance of the computer vision algorithms.

Image Defect Recognition Method Based on Deep Learning Network

“…In addition to heavy-equipment manufacturers and other companies using film inspection, most domestic companies have developed to CR and DR digital ray detection imaging technology for welding quality inspection [4][5][6]. In the defect assessment stage, due to the unevenness and diversity of the nature of defects such as form, location, direction, and size, making it difficult to find a set of common means and methods to automatically identify weld defects in the actual production process [7], the weld defects are usually assessed manually in the assessment process. In the process of manual evaluation of the film, first is to determine whether there are defects on the weld flaw detection image, then determine the type of defects, followed by the determination of defect data, and finally the quality level assessment according to the quality acceptance criteria.…”

Ready, Steady, Go AI: A practical tutorial on fundamentals of artificial intelligence and its applications in phenomics image analysis

“…92 While there exist other algorithms to synthesize data, such as the synthetic minority oversampling technique (SMOTE) 93 and adaptive synthetic sampling (ADASYN), 94 they are mostly suitable for tabular data, which restricts their application in high-dimensional complex image data. 95 DCGAN instead can generate synthetic images with high visual fidelity. When it was first introduced, Radford et al 92 identified an architecture that allows training the algorithm to generate higher-resolution images.…”

Automated Seed Quality Testing System using GAN & Active Learning

“…Generative Methods for Class Imbalance. Generative models can not only be used to generate images [17], but adversarial learning showed good potential in restoring balance in imbalanced datasets [18]. Generative models can generate samples that are difficult for the object detector to classify.…”