Estimating Reference Shape Model for Personalized Surgical Reconstruction of Craniomaxillofacial Defects

Objective: To estimate a patient-specific reference bone shape model for a patient with craniomaxillofacial (CMF) defects due to facial trauma. Methods: We proposed an automatic facial bone shape estimation framework using pre-traumatic conventional portrait photos and post-traumatic head computed tomography (CT) scans via a 3D face reconstruction and a deformable shape model. Specifically, a three-dimensional (3D) face was first reconstructed from the patient's pre-traumatic portrait photos. Second, a correlation model between the skin and bone surfaces was constructed using a sparse representation based on the CT images of training normal subjects. Third, by feeding the reconstructed 3D face into the correlation model, an initial reference shape model was generated. In addition, we refined the initial estimation by applying non-rigid surface matching between the initially estimated shape and the patient's post-traumatic bone based on the adaptive-focus deformable shape model (AFDSM). Furthermore, a statistical shape model, built from the training normal subjects, was utilized to constrain the deformation process to avoid overfitting. Results and Conclusion: The proposed method was evaluated using both synthetic and real patient data. Experimental results show that the patient's abnormal facial bony structure can be recovered using our method, and the estimated reference shape model is considered clinically acceptable by an experienced CMF surgeon. Significance: The proposed method is more suitable to the complex CMF defects for CMF reconstructive surgical planning.

[1]  H. Zou,et al.  Regularization and variable selection via the elastic net , 2005 .

[2]  Jaime Gateno,et al.  Accuracy of a computer-aided surgical simulation protocol for orthognathic surgery: a prospective multicenter study. , 2013, Journal of oral and maxillofacial surgery : official journal of the American Association of Oral and Maxillofacial Surgeons.

[3]  Yaozong Gao,et al.  Automatic Craniomaxillofacial Landmark Digitization via Segmentation-Guided Partially-Joint Regression Forest Model and Multiscale Statistical Features , 2016, IEEE Transactions on Biomedical Engineering.

[4]  Jaime Gateno,et al.  A new paradigm for complex midface reconstruction: a reversed approach. , 2009, Journal of oral and maxillofacial surgery : official journal of the American Association of Oral and Maxillofacial Surgeons.

[5]  Yaozong Gao,et al.  Estimating patient-specific and anatomically correct reference model for craniomaxillofacial deformity via sparse representation. , 2015, Medical physics.

[6]  Heng Tao Shen,et al.  Principal Component Analysis , 2009, Encyclopedia of Biometrics.

[7]  Jaime Gateno,et al.  Outcome study of computer-aided surgical simulation in the treatment of patients with craniomaxillofacial deformities. , 2011, Journal of oral and maxillofacial surgery : official journal of the American Association of Oral and Maxillofacial Surgeons.

[8]  Christian Rössl,et al.  Laplacian surface editing , 2004, SGP '04.

[9]  Yaozong Gao,et al.  Automated segmentation of dental CBCT image with prior-guided sequential random forests. , 2015, Medical physics.

[10]  Stefan Schlager,et al.  Virtual reconstruction of midface defects using statistical shape models. , 2017, Journal of cranio-maxillo-facial surgery : official publication of the European Association for Cranio-Maxillo-Facial Surgery.

[11]  Stefan Zachow,et al.  Reconstruction of mandibular dysplasia using a statistical 3D shape model , 2005 .

[12]  Andriy Myronenko,et al.  Point Set Registration: Coherent Point Drift , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Volker Blanz,et al.  Automated 3D Face Reconstruction from Multiple Images Using Quality Measures , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  R. Bell,et al.  Computer planning and intraoperative navigation in cranio-maxillofacial surgery. , 2010, Oral and maxillofacial surgery clinics of North America.

[15]  Mubarak Shah,et al.  A Fast algorithm for active contours and curvature estimation , 1992, CVGIP Image Underst..

[16]  Fred L. Bookstein,et al.  Principal Warps: Thin-Plate Splines and the Decomposition of Deformations , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Alexander Schramm,et al.  Computer Assisted Oral and Maxillofacial Reconstruction , 2006, J. Comput. Inf. Technol..

[18]  Dinggang Shen,et al.  An Adaptive-Focus Deformable Model Using Statistical and Geometric Information , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  Jaime Gateno,et al.  Cost-effectiveness analysis for computer-aided surgical simulation in complex cranio-maxillofacial surgery. , 2006, Journal of oral and maxillofacial surgery : official journal of the American Association of Oral and Maxillofacial Surgeons.

[20]  Fuessinger Marc Anton,et al.  Virtual reconstruction of bilateral midfacial defects by using statistical shape modeling. , 2019, Journal of cranio-maxillo-facial surgery : official publication of the European Association for Cranio-Maxillo-Facial Surgery.

[21]  Hans-Peter Meinzer,et al.  Statistical shape models for 3D medical image segmentation: A review , 2009, Medical Image Anal..

[22]  YU De-don Three-dimensional CT measurement for the craniomaxillofacial structure of normal occlusion adults in Jiangsu,Zhejiang and Shanghai Area , 2010 .

[23]  Jaime Gateno,et al.  New 3-dimensional cephalometric analysis for orthognathic surgery. , 2011, Journal of oral and maxillofacial surgery : official journal of the American Association of Oral and Maxillofacial Surgeons.

[24]  D. Donoho For most large underdetermined systems of linear equations the minimal 𝓁1‐norm solution is also the sparsest solution , 2006 .

[25]  William E. Lorensen,et al.  Marching cubes: A high resolution 3D surface construction algorithm , 1987, SIGGRAPH.

[26]  Wee Kheng Leow,et al.  Laplacian Deformation with Symmetry Constraints for Reconstruction of Defective Skulls , 2017, CAIP.

[27]  Li Wang,et al.  Estimating Reference Bony Shape Model for Personalized Surgical Reconstruction of Posttraumatic Facial Defects , 2019, MICCAI.

[28]  Jaime Gateno,et al.  Three-dimensional computer-aided surgical simulation for maxillofacial surgery. , 2005, Atlas of the oral and maxillofacial surgery clinics of North America.

[29]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[30]  Shu Liao,et al.  Automated bone segmentation from dental CBCT images using patch-based sparse representation and convex optimization. , 2014, Medical physics.

[31]  J Li,et al.  Algorithm for planning a double-jaw orthognathic surgery using a computer-aided surgical simulation (CASS) protocol. Part 1: planning sequence. , 2015, International journal of oral and maxillofacial surgery.

[32]  Peng Yuan,et al.  Design, development and clinical validation of computer-aided surgical simulation system for streamlined orthognathic surgical planning , 2017, International Journal of Computer Assisted Radiology and Surgery.

[33]  Li Wang,et al.  Segmentation of Craniomaxillofacial Bony Structures from MRI with a 3D Deep-Learning Based Cascade Framework , 2017, MLMI@MICCAI.

[34]  J Li,et al.  Algorithm for planning a double-jaw orthognathic surgery using a computer-aided surgical simulation (CASS) protocol. Part 2: three-dimensional cephalometry. , 2015, International journal of oral and maxillofacial surgery.

[35]  Georgios Tzimiropoulos,et al.  How Far are We from Solving the 2D & 3D Face Alignment Problem? (and a Dataset of 230,000 3D Facial Landmarks) , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[36]  Jaime Gateno,et al.  New clinical protocol to evaluate craniomaxillofacial deformity and plan surgical correction. , 2009, Journal of oral and maxillofacial surgery : official journal of the American Association of Oral and Maxillofacial Surgeons.

[37]  Sami Romdhani,et al.  A 3D Face Model for Pose and Illumination Invariant Face Recognition , 2009, 2009 Sixth IEEE International Conference on Advanced Video and Signal Based Surveillance.

[38]  Dinggang Shen,et al.  Craniomaxillofacial Deformity Correction via Sparse Representation in Coherent Space , 2015, MLMI.

[39]  Alexander Schramm,et al.  Navigation-aided reconstruction of medial orbital wall and floor contour in cranio-maxillofacial reconstruction. , 2004, Injury.

[40]  Jaime Gateno,et al.  Accuracy of the computer-aided surgical simulation (CASS) system in the treatment of patients with complex craniomaxillofacial deformity: A pilot study. , 2007, Journal of oral and maxillofacial surgery : official journal of the American Association of Oral and Maxillofacial Surgeons.