Tracked “Pick-Up” Ultrasound for Robot-Assisted Minimally Invasive Surgery

Goal: We present a novel “pick-up” ultrasound transducer for intraabdominal robot-assisted minimally invasive surgery. Such a “pick-up” ultrasound transducer is inserted through an abdominal incision at the beginning of the procedure and remains in the abdominal cavity throughout, eliminating the need for a dedicated port or a patient bedside surgical assistant. The transducer has a handle that can be grasped in a repeatable manner using a da Vinci Prograsp tool, allowing the transducer to be accurately manipulated by the surgeon using the da Vinci Robot. This is one way to enable 3-D tracking of the transducer, and, thus, mapping of the vasculature. The 3-D vascular images can be used to register preoperative CT to intraoperative camera images. Methods: To demonstrate the feasibility of the approach, we use an ultrasound vessel phantom to register a CT surface model to extracted ultrasound vessel models. The 3-D vascular phantom images are generated by segmenting B-mode images and tracking the pick-up ultrasound transducer with the da Vinci kinematics, internal electromagnetic sensor, or visible fiducials suitable for camera tracking. Results: Reconstruction results using da Vinci kinematics for tracking give a target registration error of 5.4 ± 1.7 mm.

[1]  M. Meng,et al.  Intraoperative sonography for the evaluation and management of renal tumors: experience with 100 patients. , 1995, The Journal of urology.

[2]  Purang Abolmaesumi,et al.  A Generalized Correlation-Based Model for Out-of-Plane Motion Estimation in Freehand Ultrasound , 2014, IEEE Transactions on Medical Imaging.

[3]  Maxime Descoteaux,et al.  Validation of vessel-based registration for correction of brain shift , 2007, Medical Image Anal..

[4]  J. Liu,et al.  Improved staging of liver tumors using laparoscopic intraoperative ultrasound , 1997, Journal of surgical oncology.

[5]  Toril A. Nagelhus Laparoscopic ultrasound: a survey of its current and future use, requirements, and integration with navigation technology , 2010 .

[6]  S. Herrell Toward image-guided robotic surgery: Determining intrinsic accuracy of the da Vinci robot , 2007 .

[7]  Guang-Zhong Yang,et al.  Intraoperative Ultrasound Guidance for Transanal Endoscopic Microsurgery , 2012, MICCAI.

[8]  Benoit M. Dawant,et al.  Tracking of Vessels in Intra-Operative Microscope Video Sequences for Cortical Displacement Estimation , 2011, IEEE Transactions on Biomedical Engineering.

[9]  Andras Lasso,et al.  PLUS: Open-Source Toolkit for Ultrasound-Guided Intervention Systems , 2014, IEEE Transactions on Biomedical Engineering.

[10]  Russell H. Taylor,et al.  Robot-Assisted Laparoscopic Ultrasound , 2010, IPCAI.

[11]  Makoto Hashizume,et al.  A real-time navigation system for laparoscopic surgery based on three-dimensional ultrasound using magneto-optic hybrid tracking configuration , 2007, International Journal of Computer Assisted Radiology and Surgery.

[12]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  S. Hughes,et al.  Volume estimation from multiplanar 2D ultrasound images using a remote electromagnetic position and orientation sensor. , 1996, Ultrasound in medicine & biology.

[14]  N. Navab,et al.  Advanced Medical Displays: A Literature Review of Augmented Reality , 2008, Journal of Display Technology.

[15]  Jean-Yves Bouguet,et al.  Camera calibration toolbox for matlab , 2001 .

[16]  Andrew H. Gee,et al.  Regularised marching tetrahedra: improved iso-surface extraction , 1999, Comput. Graph..

[17]  R. Budde,et al.  Endoscopic localization and assessment of coronary arteries by 13 MHz epicardial ultrasound. , 2004, The Annals of thoracic surgery.

[18]  Guang-Zhong Yang,et al.  Pico Lantern: A Pick-up Projector for Augmented Reality in Laparoscopic Surgery , 2014, MICCAI.

[19]  David J. Hawkes,et al.  Registration of freehand 3D ultrasound and magnetic resonance liver images , 2004, Medical Image Anal..

[20]  L. Collins,et al.  A review of calibration techniques for freehand 3-D ultrasound systems. , 2005, Ultrasound in medicine & biology.

[21]  R W Prager,et al.  Rapid calibration for 3-D freehand ultrasound. , 1998, Ultrasound in medicine & biology.

[22]  Robert Rohling,et al.  Intra-operative "Pick-Up" Ultrasound for Robot Assisted Surgery with Vessel Extraction and Registration: A Feasibility Study , 2011, IPCAI.

[23]  Nassir Navab,et al.  Magneto-Optic Tracking of a Flexible Laparoscopic Ultrasound Transducer for Laparoscope Augmentation , 2007, MICCAI.

[24]  R. Budde,et al.  Robot-assisted 13 MHz epicardial ultrasound for endoscopic quality assessment of coronary anastomoses. , 2004, Interactive cardiovascular and thoracic surgery.

[25]  Julien Jomier,et al.  Rigid and Deformable Vasculature-to-Image Registration: A Hierarchical Approach , 2004, MICCAI.

[26]  Mili Shah,et al.  Solving the Robot-World/Hand-Eye Calibration Problem Using the Kronecker Product , 2013 .

[27]  Thomas Lange,et al.  Augmenting Intraoperative 3D Ultrasound with Preoperative Models for Navigation in Liver Surgery , 2004, MICCAI.

[28]  N. Rizk,et al.  A comparison of laparoscopic ultrasound versus cholangiography in the evaluation of the biliary tree during laparoscopic cholecystectomy. , 1999, European journal of ultrasound : official journal of the European Federation of Societies for Ultrasound in Medicine and Biology.

[29]  Darius Burschka,et al.  DaVinci Canvas: A Telerobotic Surgical System with Integrated, Robot-Assisted, Laparoscopic Ultrasound Capability , 2005, MICCAI.

[30]  Volodymyr V. Kindratenko,et al.  A survey of electromagnetic position tracker calibration techniques , 2005, Virtual Reality.

[31]  Piotr Wielopolski,et al.  Accurate CT∕MR vessel-guided nonrigid registration of largely deformed livers. , 2012, Medical physics.

[32]  Robert Rohling,et al.  Calibration and Stereo Tracking of a Laparoscopic Ultrasound Transducer for Augmented Reality in Surgery , 2013, AE-CAI.

[33]  P Munger,et al.  Comparison of relative accuracy between a mechanical and an optical position tracker for image-guided neurosurgery. , 1995, Journal of image guided surgery.

[34]  Jae Young Lee,et al.  Non-rigid registration between 3D ultrasound and CT images of the liver based on intensity and gradient information , 2011, Physics in medicine and biology.

[35]  Sung-Hyuk Cha Comprehensive Survey on Distance/Similarity Measures between Probability Density Functions , 2007 .

[36]  Thomas Lange,et al.  3D ultrasound-CT registration of the liver using combined landmark-intensity information , 2008, International Journal of Computer Assisted Radiology and Surgery.

[37]  Richard James Housden,et al.  Sensorless freehand 3D ultrasound in real tissue: Speckle decorrelation without fully developed speckle , 2006, Medical Image Anal..