An improved pix2pix model based on Gabor filter for robust color image rendering

Abstract

<abstract><p>In recent years, with the development of deep learning, image color rendering method has become a research hotspot once again. To overcome the detail problems of color overstepping and boundary blurring in the robust image color rendering method, as well as the problems of unstable training based on generative adversarial networks, we propose an color rendering method using Gabor filter based improved pix2pix for robust image. Firstly, the multi-direction/multi-scale selection characteristic of Gabor filter is used to preprocess the image to be rendered, which can retain the detailed features of the image while preprocessing to avoid the loss of features. Moreover, among the Gabor texture feature maps with 6 scales and 4 directions, the texture map with the scale of 7 and the direction of 0° has the comparable rendering performance. Finally, by improving the loss function of pix2pix model and adding the penalty term, not only the training can be stabilized, but also the ideal color image can be obtained. To reflect image color rendering quality of different models more objectively, PSNR and SSIM indexes are adopted to evaluate the rendered images. The experimental results of the proposed method show that the robust image rendered by this method has better visual performance and reduces the influence of light and noise on the image to a certain extent.</p></abstract>

Revisiting crowd counting: State-of-the-art, trends, and future perspectives

“…Speckle noise using Rayleigh distribution was added to the training images to generate image pairs of original and noisy images. Authors in [35] use a Pix2Pix GAN with a penalty term to render greyscale images into color images. The performance is evaluated over PSNR and SSIM metrics.…”

Bio-Inspired Optimal Dispatching of Wind Power Consumption Considering Multi-Time Scale Demand Response and High-Energy Load Participation

“…An increasing number of bio-inspired algorithms have been developed in recent decades. Many intelligent algorithms have been adopted recently, such as artificial intelligence algorithms [46][47][48], the mathematical analytic methods [49][50][51][52], ant colonial algorithm [53,54], genetic algorithm [55], particle swarm algorithm, deep learning [56,57] and so forth. Previous studies introduced a mixed-integer linear programming approach to maximize system performance and improve system operational stability [58].…”

Image Color Rendering Based on Hinge-Cross-Entropy GAN in Internet of Medical Things

“…Image color rendering based on deep learning can render the grayscale image into a color image to highlight the deep information and help readers to quickly understand the depth of information contained in the image [8][9][10][11]. With the rapid development of computer graphics, computer vision and related software and hardware technologies, the method of rendering existing images and enhancing details by using high-quality image data has attracted extensive research attention, and has been gradually applied to medical image processing and analysis in IoMT [12][13][14].…”