An in vivo porcine dataset and evaluation methodology to measure soft-body laparoscopic liver registration accuracy with an extended algorithm that handles collisions

AbstractPurposeThe registration of preoperative 3D images to intra-operative laparoscopic 2D images is one of the main concerns for augmented reality in computer-assisted surgery. For laparoscopic liver surgery, while several algorithms have been proposed, there is neither a public dataset nor a systematic evaluation methodology to quantitatively evaluate registration accuracy.MethodOur main contribution is to provide such a dataset with an in vivo porcine model. It is used to evaluate a state-of-the-art registration algorithm that is capable of simultaneous registration and soft-body collision reasoning. ResultsThe dataset consists of 13 deformed liver states, with corresponding exploration videos and interventional CT acquisitions with 60 small artificial fiducials located on the surface of the liver and distributed within the parenchyma, where a precise registration is crucial for augmented reality. This dataset will be made public. Using this dataset, we show that collision reasoning improves performance of registration for strong deformation and independent lobe motion. ConclusionThis dataset addresses the lack of public datasets in this field. As an example of use, we present and evaluate a state-of-the-art energy-based approach and a novel extension that handles self-collisions.

[1]  Dominik Spinczyk,et al.  Target registration error minimization for minimally invasive interventions involving deformable organs , 2017, Comput. Medical Imaging Graph..

[2]  Alexandre Hostettler,et al.  ORBSLAM-Based Endoscope Tracking and 3D Reconstruction , 2016, CARE@MICCAI.

[3]  Sami Romdhani,et al.  Optimal Step Nonrigid ICP Algorithms for Surface Registration , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Nazim Haouchine,et al.  Patient-Specific Biomechanical Modeling for Guidance During Minimally-Invasive Hepatic Surgery , 2015, Annals of Biomedical Engineering.

[5]  Nazim Haouchine,et al.  Image-guided simulation of heterogeneous tissue deformation for augmented reality during hepatic surgery , 2013, 2013 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[6]  Adrien Bartoli,et al.  Robust, Real-Time, Dense and Deformable 3D Organ Tracking in Laparoscopic Videos , 2016, MICCAI.

[7]  Stephane Cotin,et al.  EP4A: Software and Computer Based Simulator Research: Development and Outlook SOFA—An Open Source Framework for Medical Simulation , 2007, MMVR.

[8]  Sébastien Ourselin,et al.  Accuracy validation of an image guided laparoscopy system for liver resection , 2015, Medical Imaging.

[9]  Sébastien Ourselin,et al.  In vivo estimation of target registration errors during augmented reality laparoscopic surgery , 2018, International Journal of Computer Assisted Radiology and Surgery.

[10]  Adrien Bartoli,et al.  Deformable Registration of a Preoperative 3D Liver Volume to a Laparoscopy Image Using Contour and Shading Cues , 2017, MICCAI.

[11]  Michael I. Miga,et al.  Technical note: nonrigid registration for laparoscopic liver surgery using sparse intraoperative data , 2018, Medical Imaging.

[12]  Dave Eberly Testing for Intersection of Convex Objects: The Method of Separating Axes , 2001 .

[13]  Daniel Pizarro-Perez,et al.  A System for Augmented Reality Guided Laparoscopic Tumour Resection with Quantitative Ex-vivo User Evaluation , 2016, CARE@MICCAI.

[14]  Lena Maier-Hein,et al.  Physics-based shape matching for intraoperative image guidance. , 2014, Medical physics.

[15]  Nazim Haouchine,et al.  Silhouette-based pose estimation for deformable organs application to surgical augmented reality , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[16]  Logan W. Clements,et al.  Robust surface registration using salient anatomical features for image-guided liver surgery: algorithm and validation. , 2008, Medical physics.

[17]  Adrien Bartoli,et al.  [POSTER] Realtime Shape-from-Template: System and Applications , 2015, 2015 IEEE International Symposium on Mixed and Augmented Reality.

[18]  Dominique Bechmann,et al.  Collision detection for articulated deformable characters , 2015, MIG.

[19]  Erlend Fagertun Hofstad,et al.  Navigated laparoscopy – liver shift and deformation due to pneumoperitoneum in an animal model , 2012, Minimally invasive therapy & allied technologies : MITAT : official journal of the Society for Minimally Invasive Therapy.

[20]  J. Michael Fitzpatrick,et al.  Fiducial registration error and target registration error are uncorrelated , 2009, Medical Imaging.

[21]  Stephane Cotin,et al.  Truth cube: Establishing physical standards for soft tissue simulation , 2003, Medical Image Anal..

[22]  Nazim Haouchine,et al.  Using contours as boundary conditions for elastic registration during minimally invasive hepatic surgery , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[23]  Alexandre Hostettler,et al.  Soft-Body Registration of Pre-operative 3D Models to Intra-operative RGBD Partial Body Scans , 2018, MICCAI.

[24]  Michael I. Miga,et al.  Improving Registration Robustness for Image-Guided Liver Surgery in a Novel Human-to-Phantom Data Framework , 2017, IEEE Transactions on Medical Imaging.

[25]  Joseph S. B. Mitchell,et al.  Efficient Collision Detection Using Bounding Volume Hierarchies of k-DOPs , 1998, IEEE Trans. Vis. Comput. Graph..

[26]  Jianbo Shi,et al.  Balanced Graph Matching , 2006, NIPS.