Tracking and recording the lip dynamics for the integration of a dynamic virtual patient: A novel dental technique

Abstract

A step‐by‐step technique is described for tracking and recording, in real time, the lip dynamics of a patient and integrating them into a 3D virtual patient representation using facial trackers and motion engine software programs. The main advantage of this technique is that it enables capturing of the lip movements of the patient in real time; therefore, the lip movements are not simulated from a previously recorded video of the patient using animation software programs.

Four-Dimensional Superimposition Techniques to Compose Dental Dynamic Virtual Patients: A Systematic Review

“…One study [ 23 ] used a smartphone facial tracking app to track lip dynamics. Three studies acquired semi-dynamic faces using FS and image processing software.…”

“…One study [ 36 ] combined bones from CBCT with mandibular position from VA and VF and dentition in CRO/MICP from IOS to simulate a patient. Six studies [ 22 , 30 , 37 , 40 , 41 ] described methods to create models with faces from FS [ 22 , 23 , 37 , 40 ]/2D photograph [ 30 , 41 ], dentition models from IOS [ 22 , 23 , 30 , 41 ]/DS [ 37 ], and mandibular position using VF and VA. Kois et al [ 30 ] used the “Align Mesh” tool to align data. The Alignment of the casts, scan body, facial scan, or alignment of the facebow forks was based on points [ 22 , 41 ].…”

“…The Alignment of the casts, scan body, facial scan, or alignment of the facebow forks was based on points [ 22 , 41 ]. IOS and CBCT/FS were registered based on points and the ICP algorithm [ 36 , 37 ] or fiducial markers of the scan body [ 23 , 40 ].…”

“…The MP4 file can be transferred into TXT format using a direct linear transform (DLT) algorithm, which facilitates the integration [ 20 ], marking the reference points to align the models acquired from other CAD software programs using Python [ 19 ]. In this program, STL/PLY files can be transferred to the OBJ format to facilitate the fusion of different formats [ 23 ].…”

“…Traditional restoration processes focusing only on static occlusion may lead to poor occlusal function and TMJs disorder. However, for digital workflows, VF techniques locate the position of jaws and condyles [ 19 , 22 , 23 , 24 , 27 , 28 , 30 , 32 , 33 , 37 , 40 , 41 , 42 ], and VA [ 22 , 24 , 27 , 28 , 30 , 36 , 40 ] or JMA [ 20 , 31 , 35 ] helps simulate or record patient-specific mandibular and TMJ kinematics. These procedures obtain the correct MICP, CRO, and VDO for coordinated dental implants and restorations in a stable position [ 24 , 27 , 28 , 36 ].…”