3D Facial Plastic Surgery Simulation: Based on the Structured Light

The 3D quantitative analysis of facial morphology is of importance in plastic surgery (PS), which could help surgeons design appropriate procedures before conducting the surgery. We propose a system to simulate and guide the shaping effect analysis, which could produce a similar but more harmonious face simulation. To this end, first, the depth camera based on structured light coding is employed for facial 3D data acquisition, from which the point cloud data of multiple facial perspectives could be obtained. Next, the cascade regression tree algorithm is used to extract the esthetic key points of the face model and to calculate the facial features composed of the key points, such as the nose, chin, and eyes. Quantitative facial esthetic indexes are offered to doctors to simulate PS. Afterward, we exploit a face mesh metamorphosis based on finite elements. We design several morphing operators, including augmentation, cutting, and lacerating. Finally, the regional deformation is detected, and the operation effect is quantitatively evaluated by registering the 3D scanning model before and after the operation. The test of our proposed system and the simulation of PS operations find that the measurement error of facial geometric features is 0.458 mm, and the area is 0.65 mm2. The ratings of the simulation outcomes provided by panels of PS prove that the system is effective. The manipulated 3D faces are deemed more beautiful compared to the original faces respecting the beauty canons such as facial symmetry and the golden ratio. The proposed algorithm could generate realistic visual effects of PS simulation. It could thus assist the preoperative planning of facial PS.

[1]  Liang Gao,et al.  Compact light field photography towards versatile three-dimensional vision , 2022, Nature Communications.

[2]  Kang-Jie Cheng,et al.  3D-printed porous condylar prosthesis for temporomandibular joint replacement: Design and biomechanical analysis. , 2022, Technology and health care : official journal of the European Society for Engineering and Medicine.

[3]  Seok-Ki Jung,et al.  Three-Dimensional Reproducibility of the Soft Tissue Landmarks Taken by Structured-Light Facial Scanner in Accordance with the Head Position Change , 2021, Healthcare.

[4]  E. Frank,et al.  Implications of Applying New Technology in Cosmetic and Reconstructive Facial Plastic Surgery , 2020, Facial Plastic Surgery.

[5]  Zarghili Arsalane,et al.  3D facial attractiveness enhancement using free form deformation , 2020 .

[6]  C. Sforza,et al.  3D facial morphometry in Italian patients affected by Aicardi syndrome , 2020, American journal of medical genetics. Part A.

[7]  Mateus do Vale Voigt,et al.  DSDapp use for multidisciplinary esthetic planning. , 2020, Journal of esthetic and restorative dentistry : official publication of the American Academy of Esthetic Dentistry ... [et al.].

[8]  Federica Marcolin,et al.  Analysis of RGB-D camera technologies for supporting different facial usage scenarios , 2020, Multimedia Tools and Applications.

[9]  Christopher P. Saunders,et al.  Quantitative accuracy and 3D biometric matching of 388 statistically estimated facial approximations of live subjects , 2020, Forensic Imaging.

[10]  Zhan Song,et al.  SIAT-3DFE: A High-Resolution 3D Facial Expression Dataset , 2020, IEEE Access.

[11]  Elena Carlotta Olivetti,et al.  3D Soft-Tissue Prediction Methodologies for Orthognathic Surgery—A Literature Review , 2019, Applied Sciences.

[12]  Rashmi Gupta,et al.  Human identification after plastic surgery using region based score level fusion of local facial features , 2019, J. Inf. Secur. Appl..

[13]  Hui Zeng,et al.  Three-dimensional printing of facial contour based on preoperative computer simulation and its clinical application , 2019, Medicine.

[14]  Le Hoang Son,et al.  Recognition of surgically altered face images: an empirical analysis on recent advances , 2018, Artificial Intelligence Review.

[15]  Maya de Buhan,et al.  A facial reconstruction method based on new mesh deformation techniques , 2018, Forensic sciences research.

[16]  Wei Peng,et al.  Biomechanical investigation of orthodontic treatment planning based on orthodontic force measurement and finite element method before implementation: A case study , 2018, Technology and health care : official journal of the European Society for Engineering and Medicine.

[17]  Connie L. Parks,et al.  Biometric correspondence between reface computerized facial approximations and CT-derived ground truth skin surface models objectively examined using an automated facial recognition system. , 2018, Forensic science international.

[18]  Wei Tang,et al.  Virtual facial reconstruction based on accurate registration and fusion of 3D facial and MSCT scans , 2016, Journal of Orofacial Orthopedics / Fortschritte der Kieferorthopädie.

[19]  Qingfeng Li,et al.  A novel noninvasive three-dimensional volumetric analysis for fat-graft survival in facial recontouring using the 3L and 3M technique. , 2016, Journal of plastic, reconstructive & aesthetic surgery : JPRAS.

[20]  Yanqi Li,et al.  The Application of Three-Dimensional Surface Imaging System in Plastic and Reconstructive Surgery , 2016, Annals of plastic surgery.

[21]  Jia Li,et al.  A novel dynamical 3D smile measurement method to evaluate the effects of face-lifting surgery: Based on the optical structured light strategy , 2015 .

[22]  Jessica B. Chang,et al.  Three-Dimensional Surface Imaging in Plastic Surgery: Foundation, Practical Applications, and Beyond , 2015, Plastic and reconstructive surgery.

[23]  Chiarella Sforza,et al.  A New 3-D Tool for Planning Plastic Surgery , 2012, IEEE Transactions on Biomedical Engineering.

[24]  Jia-Kai Chou,et al.  Face-off: automatic alteration of facial features , 2012, Multimedia Tools and Applications.

[25]  Yimin Zhao,et al.  Three-dimensional anthropometric analysis of chinese faces and its application in evaluating facial deformity. , 2011, Journal of oral and maxillofacial surgery : official journal of the American Association of Oral and Maxillofacial Surgeons.

[26]  Kevin Montgomery,et al.  A Web-Based, Integrated Simulation System for Craniofacial Surgical Planning , 2009, Plastic and reconstructive surgery.

[27]  B. Sruthy,et al.  Recognizing Surgically Altered Face Images and 3D Facial Expression Recognition , 2016 .