Estimating Reference Bony Shape Model for Personalized Surgical Reconstruction of Posttraumatic Facial Defects

In this paper, we introduce a method for estimating patient-specific reference bony shape models for planning of reconstructive surgery for patients with acquired craniomaxillofacial (CMF) trauma. We propose an automatic bony shape estimation framework using pre-traumatic portrait photographs and post-traumatic head computed tomography (CT) scans. A 3D facial surface is first reconstructed from the patient's pre-traumatic photographs. An initial estimation of the patient's normal bony shape is then obtained with the reconstructed facial surface via sparse representation using a dictionary of paired facial and bony surfaces of normal subjects. We further refine the bony shape model by deforming the initial bony shape model to the post-traumatic 3D CT bony model, regularized by a statistical shape model built from a database of normal subjects. Experimental results show that our method is capable of effectively recovering the patient's normal facial bony shape in regions with defects, allowing CMF surgical planning to be performed precisely for a wider range of defects caused by trauma.

[1]  Thomas Vetter,et al.  Face Recognition Based on Fitting a 3D Morphable Model , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Wee Kheng Leow,et al.  Laplacian Deformation with Symmetry Constraints for Reconstruction of Defective Skulls , 2017, CAIP.

[3]  Stefan Schlager,et al.  Virtual reconstruction of bilateral midfacial defects by using statistical shape modeling , 2019 .

[4]  YU De-don Three-dimensional CT measurement for the craniomaxillofacial structure of normal occlusion adults in Jiangsu,Zhejiang and Shanghai Area , 2010 .

[5]  D. Donoho For most large underdetermined systems of linear equations the minimal 𝓁1‐norm solution is also the sparsest solution , 2006 .

[6]  Volker Blanz,et al.  Automated 3D Face Reconstruction from Multiple Images Using Quality Measures , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  Dinggang Shen,et al.  An Adaptive-Focus Deformable Model Using Statistical and Geometric Information , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Yaozong Gao,et al.  Estimating patient-specific and anatomically correct reference model for craniomaxillofacial deformity via sparse representation. , 2015, Medical physics.

[9]  J Li,et al.  Algorithm for planning a double-jaw orthognathic surgery using a computer-aided surgical simulation (CASS) protocol. Part 2: three-dimensional cephalometry. , 2015, International journal of oral and maxillofacial surgery.

[10]  Georgios Tzimiropoulos,et al.  How Far are We from Solving the 2D & 3D Face Alignment Problem? (and a Dataset of 230,000 3D Facial Landmarks) , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[11]  Christian Rössl,et al.  Laplacian surface editing , 2004, SGP '04.

[12]  Hans-Peter Meinzer,et al.  Statistical shape models for 3D medical image segmentation: A review , 2009, Medical Image Anal..

[13]  Yaozong Gao,et al.  Automatic Craniomaxillofacial Landmark Digitization via Segmentation-Guided Partially-Joint Regression Forest Model and Multiscale Statistical Features , 2016, IEEE Transactions on Biomedical Engineering.

[14]  Alexander Schramm,et al.  Computer Assisted Oral and Maxillofacial Reconstruction , 2006, J. Comput. Inf. Technol..