Assessment and application of the coherent point drift algorithm to augmented reality surgical navigation for laparoscopic partial nephrectomy

Purpose The surface-based registration approach to laparoscopic augmented reality (AR) has clear advantages. Nonrigid point-set registration paves the way for surface-based registration. Among current non-rigid point set registration methods, the coherent point drift (CPD) algorithm is rarely used because of two challenges: (1) volumetric deformation is difficult to predict, and (2) registration from intraoperative visible tissue surface to whole anatomical preoperative model is a “part-to-whole” registration that CPD cannot be applied directly to. We preliminarily applied CPD on surgical navigation for laparoscopic partial nephrectomy (LPN). However, it introduces normalization errors and lacks navigation robustness. This paper presents important advances for more effectively applying CPD to LPN surgical navigation while attempting to quantitatively evaluate the accuracy of CPD-based surgical navigation. Methods First, an optimized volumetric deformation (Op-VD) algorithm is proposed to achieve accurate prediction of volume deformation. Then, a projection-based partial selection method is presented to conveniently and robustly apply the CPD to LPN surgical navigation. Finally, kidneys with different deformations in vitro, phantom and in vivo experiments are performed to evaluate the accuracy and effectiveness of our approach. Results The average root-mean-square error of volume deformation was refined to 0.84 mm. The mean target registration error (TRE) of the surface and inside markers in the in vitro experiments decreased to 1.51 mm and 1.29 mm, respectively. The robustness and precision of CPD-based navigation were validated in phantom and in vivo experiments, and the mean navigation TRE of the phantom experiments was found to be $$1.69 \pm 0.31$$ 1.69 ± 0.31 mm. Conclusion Accurate volumetric deformation and robust navigation results can be achieved in AR navigation of LPN by using surface-based registration with CPD. Evaluation results demonstrate the effectiveness of our proposed methods while showing the clinical application potential of CPD. This work has important guiding significance for the application of the CPD in laparoscopic AR.

[1]  Daniel Pizarro-Perez,et al.  Computer-Assisted Laparoscopic myomectomy by augmenting the uterus with pre-operative MRI data , 2014, 2014 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[2]  H. Asbun,et al.  Laparoscopic vs open pancreaticoduodenectomy: overall outcomes and severity of complications using the Accordion Severity Grading System. , 2012, Journal of the American College of Surgeons.

[3]  Li Xie,et al.  Robust CPD Algorithm for Non-Rigid Point Set Registration Based on Structure Information , 2016, PloS one.

[4]  Nazim Haouchine,et al.  Using contours as boundary conditions for elastic registration during minimally invasive hepatic surgery , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[5]  Ghassan Hamarneh,et al.  Biomechanical kidney model for predicting tumor displacement in the presence of external pressure load , 2014, 2014 IEEE 11th International Symposium on Biomedical Imaging (ISBI).

[6]  Luc Soler,et al.  An Augmented Reality Framework for Soft Tissue Surgery , 2014, MICCAI.

[7]  Nazim Haouchine,et al.  Framework for augmented reality in Minimally Invasive laparoscopic surgery , 2015, 2015 17th International Conference on E-health Networking, Application & Services (HealthCom).

[8]  Luc Soler,et al.  Biomechanically Driven Registration of Pre- to Intra-Operative 3D Images for Laparoscopic Surgery , 2013, MICCAI.

[9]  Tianmiao Wang,et al.  A markerless automatic deformable registration framework for augmented reality navigation of laparoscopy partial nephrectomy , 2019, International Journal of Computer Assisted Radiology and Surgery.

[10]  Makoto Hashizume,et al.  An augmented reality navigation system for pediatric oncologic surgery based on preoperative CT and MRI images. , 2013, Journal of pediatric surgery.

[11]  Yuan Gao,et al.  A robust and outlier-adaptive method for non-rigid point registration , 2013, Pattern Analysis and Applications.

[12]  Alexandre Hostettler,et al.  Registration of Preoperative Liver Model for Laparoscopic Surgery from Intraoperative 3D Acquisition , 2013, AE-CAI.

[13]  Robert L. Galloway,et al.  Compensating for intraoperative soft-tissue deformations using incomplete surface data and finite elements , 2005, IEEE Transactions on Medical Imaging.

[14]  Andriy Myronenko,et al.  Point Set Registration: Coherent Point Drift , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Örjan Smedby,et al.  Non-rigid Deformation Pipeline for Compensation of Superficial Brain Shift , 2013, MICCAI.

[16]  Ghassan Hamarneh,et al.  Validation of non-rigid point-set registration methods using a porcine bladder pelvic phantom , 2016, Physics in medicine and biology.

[17]  Ghassan Hamarneh,et al.  Uncertainty-Encoded Augmented Reality for Robot-Assisted Partial Nephrectomy: A Phantom Study , 2013, AE-CAI.

[18]  R. Abugharbieh,et al.  Towards multi-modal image-guided tumour identification in robot-assisted partial nephrectomy , 2014, 2nd Middle East Conference on Biomedical Engineering.

[19]  J. L. Moyano-Cuevas,et al.  Anatomical changes due to pneumoperitoneum analyzed by MRI: an experimental study in pigs , 2011, Surgical and Radiologic Anatomy.

[20]  David J. Hawkes,et al.  Deformable Vessel-Based Registration Using Landmark-Guided Coherent Point Drift , 2010, MIAR.

[21]  Beat P. Müller-Stich,et al.  Computer-assisted abdominal surgery: new technologies , 2015, Langenbeck's Archives of Surgery.

[22]  Lena Maier-Hein,et al.  Optical techniques for 3D surface reconstruction in computer-assisted laparoscopic surgery , 2013, Medical Image Anal..

[23]  Gary K. L. Tam,et al.  Registration of 3D Point Clouds and Meshes: A Survey from Rigid to Nonrigid , 2013, IEEE Transactions on Visualization and Computer Graphics.

[24]  Charles Baur,et al.  Real-time update of 3D deformable models for computer aided liver surgery , 2008, 2008 19th International Conference on Pattern Recognition.