3D Model Inpainting Based on 3D Deep Convolutional Generative Adversarial Network

Abstract

In recent years, the problem of hole repairing in the 3D model has been widely concerned in related fields. As the Generative Adversarial Network (GAN) has achieved great success in generating realistic images, a 3D mesh model repair method based on the 3D Deep Convolutional Generative Adversarial Network (3D-DCGAN) is proposed in this paper. The algorithm contains two GANs: a local GAN and a global GAN. Four steps have been used to implement this concept. First, the 3D model is voxelized, and a mask is used to identify the repairing area; Second, the repairing area is generated by training local GAN; Third, the repaired region is combined with the 3D model to be repaired, thereafter, the global GAN is trained with the combined model. Finally, a decent repaired model is obtained with the perfect transition. The experimental results show that this algorithm can effectively generate the repairing area while retaining the details of the area and blend it with the model to be repaired. INDEX TERMS 3D model inpainting, GAN, local GAN, global GAN.

Three-dimensional deep learning to automatically generate cranial implant geometry

“…The images are then replaced by higher resolution data by direct search. In addition, Wang et al 21 proposed a scheme that contains a local GAN 12 and a global GAN 12 to repair 3D mesh model in 80 × 80 × 80…”

Three-Dimensional Deep Learning to Automatically Generate Cranial Implant Geometry

“…The images are then replaced by higher resolution data by direct search. In addition, Wang et al 19 proposed a scheme that contains a local GAN 12 and a global GAN 12 to repair 3D mesh model in 80×80×80 voxels. The performance demonstrations of these contributions, however, are all based on simple geometric shapes such as airplanes, desks, and chairs.…”