Automatic Registration between Cone-Beam CT and Scanned Surface via Deep-Pose Regression Neural Networks and Clustered Similarities

Computerized registration between maxillofacial cone-beam computed tomography (CT) images and a scanned dental model is an essential prerequisite for surgical planning for dental implants or orthognathic surgery. We propose a novel method that performs fully automatic registration between a cone-beam CT image and an optically scanned model. To build a robust and automatic initial registration method, deep pose regression neural networks are applied in a reduced domain (i.e., two-dimensional image). Subsequently, fine registration is performed using optimal clusters. A majority voting system achieves globally optimal transformations while each cluster attempts to optimize local transformation parameters. The coherency of clusters determines their candidacy for the optimal cluster set. The outlying regions in the iso-surface are effectively removed based on the consensus among the optimal clusters. The accuracy of registration is evaluated based on the Euclidean distance of 10 landmarks on a scanned model, which have been annotated by experts in the field. The experiments show that the registration accuracy of the proposed method, measured based on the landmark distance, outperforms the best performing existing method by 33.09%. In addition to achieving high accuracy, our proposed method neither requires human interactions nor priors (e.g., iso-surface extraction). The primary significance of our study is twofold: 1) the employment of lightweight neural networks, which indicates the applicability of neural networks in extracting pose cues that can be easily obtained and 2) the introduction of an optimal cluster-based registration method that can avoid metal artifacts during the matching procedures.

[1]  Andrea Tagliasacchi,et al.  Eurographics Symposium on Geometry Processing 2013 Sparse Iterative Closest Point , 2022 .

[2]  Gary K. L. Tam,et al.  Registration of 3D Point Clouds and Meshes: A Survey from Rigid to Nonrigid , 2013, IEEE Transactions on Visualization and Computer Graphics.

[3]  Federico Hernández-Alfaro,et al.  3D planning in orthognathic surgery: CAD/CAM surgical splints and prediction of the soft and hard tissues results - our experience in 16 cases. , 2012, Journal of cranio-maxillo-facial surgery : official publication of the European Association for Cranio-Maxillo-Facial Surgery.

[4]  Jiaolong Yang,et al.  Go-ICP: A Globally Optimal Solution to 3D ICP Point-Set Registration , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Niloy J. Mitra,et al.  Super4PCS: Fast Global Pointcloud Registration via Smart Indexing , 2019 .

[6]  Jaime Gateno,et al.  Clinical feasibility of computer-aided surgical simulation (CASS) in the treatment of complex cranio-maxillofacial deformities. , 2007, Journal of oral and maxillofacial surgery : official journal of the American Association of Oral and Maxillofacial Surgeons.

[7]  K Stokbro,et al.  Surgical accuracy of three-dimensional virtual planning: a pilot study of bimaxillary orthognathic procedures including maxillary segmentation. , 2016, International journal of oral and maxillofacial surgery.

[8]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[9]  Lars Petersson,et al.  GOGMA: Globally-Optimal Gaussian Mixture Alignment , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Nico Blodow,et al.  Fast Point Feature Histograms (FPFH) for 3D registration , 2009, 2009 IEEE International Conference on Robotics and Automation.

[11]  Yeong-Gil Shin,et al.  Pose-Aware Instance Segmentation Framework from Cone Beam CT Images for Tooth Segmentation , 2020, Comput. Biol. Medicine.

[12]  Yoshua Bengio,et al.  Understanding the difficulty of training deep feedforward neural networks , 2010, AISTATS.

[13]  Ju Wan Kim,et al.  Development of Three-Dimensional Dental Scanning Apparatus Using Structured Illumination , 2017, Sensors.

[14]  Heng Tao Shen,et al.  Principal Component Analysis , 2009, Encyclopedia of Biometrics.

[15]  R. Marmulla,et al.  Image-to-patient registration techniques in head surgery. , 2006, International journal of oral and maxillofacial surgery.

[16]  W R Proffit,et al.  Superimposition of 3D cone-beam CT models of orthognathic surgery patients. , 2005, Dento maxillo facial radiology.

[17]  J Jiang,et al.  Medical image analysis with artificial neural networks , 2010, Comput. Medical Imaging Graph..

[18]  Nikos Komodakis,et al.  A Deep Metric for Multimodal Registration , 2016, MICCAI.

[19]  Anne Marie Kuijpers-Jagtman,et al.  Digital three-dimensional image fusion processes for planning and evaluating orthodontics and orthognathic surgery. A systematic review. , 2011, International journal of oral and maxillofacial surgery.

[20]  Zhijian Song,et al.  A new markerless patient-to-image registration method using a portable 3D scanner. , 2014, Medical physics.

[21]  M Tsuji,et al.  A new navigation system based on cephalograms and dental casts for oral and maxillofacial surgery. , 2006, International journal of oral and maxillofacial surgery.

[22]  Bassam Hassan,et al.  Registration of cone beam computed tomography data and intraoral surface scans – A prerequisite for guided implant surgery with CAD/CAM drilling guides , 2016, Clinical oral implants research.

[23]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[24]  Wen-Chung Chiang,et al.  A new method for the integration of digital dental models and cone-beam computed tomography images , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[25]  Fabio Gamboa Ritto,et al.  Comparison of the accuracy of maxillary position between conventional model surgery and virtual surgical planning. , 2018, International journal of oral and maxillofacial surgery.

[26]  Minho Chang,et al.  Registration of Dental Tomographic Volume Data and Scan Surface Data Using Dynamic Segmentation , 2018 .

[27]  J. L. Herring,et al.  Surface registration for use in interactive, image-guided liver surgery. , 2000 .

[28]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[29]  L. Lo,et al.  Automatic Superimposition of Palatal Fiducial Markers for Accurate Integration of Digital Dental Model and Cone Beam Computed Tomography. , 2015, Journal of oral and maxillofacial surgery : official journal of the American Association of Oral and Maxillofacial Surgeons.

[30]  R. D. de Oliveira,et al.  Computer-aided planning in orthognathic surgery-systematic review. , 2015, International journal of oral and maxillofacial surgery.

[31]  Sehat Ullah,et al.  Medical image registration in image guided surgery: Issues, challenges and research opportunities , 2017 .

[32]  Federico Tombari,et al.  Unique Signatures of Histograms for Local Surface Description , 2010, ECCV.

[33]  Mohammed Bennamoun,et al.  Rotational Projection Statistics for 3D Local Surface Description and Object Recognition , 2013, International Journal of Computer Vision.

[34]  Jeffrey C. Lagarias,et al.  Convergence Properties of the Nelder-Mead Simplex Method in Low Dimensions , 1998, SIAM J. Optim..

[35]  Min-Suk Heo,et al.  An overview of deep learning in the field of dentistry , 2019, Imaging science in dentistry.

[36]  Do-Gyoon Kim,et al.  Positional accuracy of a prosthetic treatment plan incorporated into a cone beam computed tomography scan using surface scan registration , 2018, The Journal of prosthetic dentistry.

[37]  Kyung-Min Lee,et al.  Registration area and accuracy when integrating laser‐scanned and maxillofacial cone‐beam computed tomography images , 2018, American Journal of Orthodontics and Dentofacial Orthopedics.

[38]  Long Quan,et al.  Fast Descriptors and Correspondence Propagation for Robust Global Point Cloud Registration , 2017, IEEE Transactions on Image Processing.

[39]  A. Kuijpers-Jagtman,et al.  Integration of Digital Dental Casts in Cone-Beam Computed Tomography Scans , 2012, Clinical Oral Investigations.

[40]  Jan Flusser,et al.  Image registration methods: a survey , 2003, Image Vis. Comput..

[41]  A. Kuijpers-Jagtman,et al.  Integration of digital dental casts in cone beam computed tomography scans—a clinical validation study , 2017, Clinical Oral Investigations.

[42]  Sébastien Ourselin,et al.  Weakly-supervised convolutional neural networks for multimodal image registration , 2018, Medical Image Anal..

[43]  Stephen Richmond,et al.  New Developments in: Three‐dimensional Planning for Orthognathic Surgery , 2010, Journal of orthodontics.

[44]  Marc Niethammer,et al.  Quicksilver: Fast predictive image registration – A deep learning approach , 2017, NeuroImage.

[45]  D. Drescher,et al.  Impact of manual control point selection accuracy on automated surface matching of digital dental models , 2018, Clinical Oral Investigations.

[46]  A. Kuijpers-Jagtman,et al.  A novel method for fusion of intra-oral scans and cone-beam computed tomography scans for orthognathic surgery planning. , 2016, Journal of cranio-maxillo-facial surgery : official publication of the European Association for Cranio-Maxillo-Facial Surgery.

[47]  Z. Jane Wang,et al.  A CNN Regression Approach for Real-Time 2D/3D Registration , 2016, IEEE Transactions on Medical Imaging.

[48]  Xiao Yang,et al.  Fast Predictive Image Registration , 2016, LABELS/DLMIA@MICCAI.

[49]  Jaime Gateno,et al.  A new technique for the creation of a computerized composite skull model. , 2003, Journal of oral and maxillofacial surgery : official journal of the American Association of Oral and Maxillofacial Surgeons.

[50]  C Flores-Mir,et al.  Multimodal registration of three-dimensional maxillodental cone beam CT and photogrammetry data over time. , 2013, Dento maxillo facial radiology.

[51]  Daniel Cohen-Or,et al.  4-points congruent sets for robust pairwise surface registration , 2008, ACM Trans. Graph..

[52]  Gene H. Golub,et al.  Singular value decomposition and least squares solutions , 1970, Milestones in Matrix Computation.

[53]  Marc Levoy,et al.  Efficient variants of the ICP algorithm , 2001, Proceedings Third International Conference on 3-D Digital Imaging and Modeling.

[54]  G. Strang Introduction to Linear Algebra , 1993 .

[55]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..