3D Face Modeling using Face Image

Abstract

IntroductionThe big popularity of plastic surgery has created a booming plastic surgery industry. Due to the prevalence of plastic surgery, the importance of plastic surgery patients' satisfaction has been increasing. It has thus never been more important for plastic surgeons to rigorously measure and report on patient satisfaction and quality of life following aesthetic procedures. According to the study, among the patients who have had plastic surgery, nearly 20% of surgery patients reported their normal appearance altered in an unfavorable way. To remedy such problem, our study focuses on 3D face modeling. 3D face modeling can realistically express face deformation and pose variation with depth information. This method can generate highly accurate 3D facial shapes by using real 3D information calculated from the camera geometry. With these advantages, 3D face models can be applied to estimate plastic surgery result for patients. By calculating patients' 3D facial shapes after the surgery, it can be expected the rate of a failure of plastic surgery can decrease significantly (1, 2).In this paper, we aim to develop a realistic 3D face modeling method that generates accurate 3D face modeling for plastic surgery results. First, we get 3D FSMs which are calculated from pre-defined feature points. Second, to get a detailed face shape, generic model fitting is performed. Finally, texture mapping is applied by stitching face parts. Thus, we can provide a 3D deformable face modeling to be used to preview the surgery result and be provided to plastic surgery patients. Materials and MethodsTo introduce the proposed system, Fig. 1 shows a workflow of the whole process in this paper. 3D Face Shape Estimation using Multi-view 3D FSMs in the Mirror SystemA method proposed uses two mirrors on each side of the front face to overcome the lack of depth direction. Since synchronization problem may arise when using cameras, the mirror system was employed instead of adding the cameras.A proposed method uses the pre-defined feature points. These points are used to calculate 3D coordinates by adjusting param- PurposeZZIt has been stated that patient satisfaction is the crucial factor for determining success in plastic surgery. The convergence of medical science and computer vision has made easier to satisfy patients who wants to have plastic surgery. In this paper, we try to apply 3D face modeling in plastic surgical area.Materials and MethodsZZThe author introduces a method for accurate 3D face modeling techniques using a statistical model-based 3D face modeling approach in a mirror system.ResultsZZWe could successfully obtain highly accurate 3D face shape results.ConclusionZZThe method suggested could be used for acquiring 3D face models from 2D face image and the result obtained from this could be effectively used for plastic surgical areas. Generic Model FittingAfter 3D face shape estimation, the 3D positions of other vertices can be determined by a generic 3D face model. The generic face model has been used in various applica...