Generative Adversarial Networks (GANs) have achieved impressive results in various image synthesis tasks, and are becoming a hot topic in computer vision research because of the impressive performance they achieved in various applications. In this paper, we introduce the recent research on GANs in the field of image processing, including image synthesis, image generation, image semantic editing, image-to-image translation, image super-resolution, image inpainting, and cartoon generation. We analyze and summarize the methods used in these applications which have improved the generated results. Then, we discuss the challenges faced by GANs and introduce some methods to deal with these problems. We also preview some likely future research directions in the field of GANs, such as video generation, facial animation synthesis and 3D face reconstruction. The purpose of this review is to provide insights into the research on GANs and to present the various applications based on GANs in different scenarios. INDEX TERMS Generative adversarial networks, image synthesis, image-to-image translation, image editing, cartoon generation.

Video object tracking is an important research topic of computer vision, which finds a wide range of applications in video surveillance, robotics, human-computer interaction and so on. Although many moving object tracking algorithms have been proposed, there are still many difficulties in the actual tracking process, such as illumination change, occlusion, motion blurring, scale change, self-change and so on. Therefore, the development of object tracking technology is still challenging. The emergence of deep learning theory and method provides a new opportunity for the research of object tracking, and it is also the main theoretical framework for the research of moving object tracking algorithm in this paper. In this paper, the existing deep tracking-based target tracking algorithms are classified and sorted out. Based on the previous knowledge and my own understanding, several solutions are proposed for the existing methods. In addition, the existing deep learning target tracking method is still difficult to meet the requirements of real-time, how to design the network and tracking process to achieve speed and effect improvement, there is still a lot of research space.

No abstract

Although image inpainting based on the generated adversarial network (GAN) has made great breakthroughs in accuracy and speed in recent years, they can only process low-resolution images because of memory limitations and difficulty in training. For high-resolution images, the inpainted regions become blurred and the unpleasant boundaries become visible. Based on the current advanced image generation network, we proposed a novel high-resolution image inpainting method based on multi-scale neural network. This method is a two-stage network including content reconstruction and texture detail restoration. After holding the visually believable fuzzy texture, we further restore the finer details to produce a smoother, clearer, and more coherent inpainting result. Then we propose a special application scene of image inpainting, that is, to delete the redundant pedestrians in the image and ensure the reality of background restoration. It involves pedestrian detection, identifying redundant pedestrians and filling in them with the seemingly correct content. To improve the accuracy of image inpainting in the application scene, we proposed a new mask dataset, which collected the characters in COCO dataset as a mask. Finally, we evaluated our method on COCO and VOC dataset. the experimental results show that our method can produce clearer and more coherent inpainting results, especially for high-resolution images, and the proposed mask dataset can produce better inpainting results in the special application scene.

No abstract