Augmented Environments for Computer-Assisted Interventions

Image-guided surgery needs an effective and efficient registration between 2D video images of the surgical scene and a preoperative model of a patient from 3D MRI or CT scans. Such an alignment process is difficult due to the lack of robustly trackable features on the operative surface as well as tissue deformation and specularity. In this paper, we propose a novel approach to perform the registration using PTAM camera tracking and colour-consistency. PTAM provides a set of video images with the corresponding camera positions. Registration of the 3D model to the video images can then be achieved by maximization of colourconsistency between all 2D pixels corresponding to a given 3D surface point. An improved algorithm for calculation of visible surface points is provided. It is hoped that PTAM camera tracking using a reduced set of points can be combined with colour-consistency to provide a robust registration. A ground truth simulation test bed has been developed for validating the proposed algorithm and empirical studies have shown that the approach is feasible, with ground truth simulation data providing a capture range of ±9mm/◦ with a TRE less than 2mm. Our intended application is robot-assisted laparoscopic prostatectomy.

[1]  David Nistér,et al.  An efficient solution to the five-point relative pose problem , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[2]  Naoki Suzuki,et al.  Navigation system for a developed endoscopic surgical robot system , 2004, CARS.

[3]  Guang-Zhong Yang,et al.  Real-Time Stereo Reconstruction in Robotically Assisted Minimally Invasive Surgery , 2010, MICCAI.

[4]  Gregory D. Hager,et al.  Stereo-Based Endoscopic Tracking of Cardiac Surface Deformation , 2004, MICCAI.

[5]  Guang-Zhong Yang,et al.  Content-Based Surgical Workflow Representation Using Probabilistic Motion Modeling , 2010, MIAR.

[6]  Christian Laugier,et al.  Tissue Cutting Using Finite Elements and Force Feedback , 2003, IS4TH.

[7]  Daniel Mirota,et al.  Toward Video-Based Navigation for Endoscopic Endonasal Skull Base Surgery. , 2009, Medical image computing and computer-assisted intervention : MICCAI ... International Conference on Medical Image Computing and Computer-Assisted Intervention.

[8]  R A Robb,et al.  Patient-specific anatomic models. Geometric surface generation from three-dimensional medical images using a specified polygonal budget. , 1996, Studies in health technology and informatics.

[9]  Guang-Zhong Yang,et al.  Motion Compensated SLAM for Image Guided Surgery , 2010, MICCAI.

[10]  R A Robb,et al.  Dynamic volume texture mapping and model deformation for visually realistic surgical simulation. , 1999, Studies in health technology and informatics.

[11]  Naoki Suzuki,et al.  Sphere-filled organ model for virtual surgery system , 2004, IEEE Transactions on Medical Imaging.

[12]  Mark A. Ganter,et al.  Real-time finite element modeling for surgery simulation: an application to virtual suturing , 2004, IEEE Transactions on Visualization and Computer Graphics.

[13]  T Ortmaier,et al.  Experiments on robot‐assisted navigated drilling and milling of bones for pedicle screw placement , 2006, The international journal of medical robotics + computer assisted surgery : MRCAS.

[14]  Richard A. Robb,et al.  Efficient shape-based algorithms for modeling patient specific anatomy from 3D medical images: applications in virtual endoscopy and surgery , 1997, Proceedings of 1997 International Conference on Shape Modeling and Applications.

[15]  Paul Suetens,et al.  Tetrahedral Mass Spring Model for Fast Soft Tissue Deformation , 2003, IS4TH.

[16]  Y Barzilay,et al.  THE INTERNATIONAL JOURNAL OF MEDICAL ROBOTICS AND COMPUTER ASSISTED SURGERY Int J Med Robotics Comput Assist Surg 2006; 2: 146–153. Published online in Wiley InterScience (www.interscience.wiley.com). DOI: 10.1002/rcs.90 ORIGINAL ARTICLE , 2006 .

[17]  Philippe Poignet,et al.  Robust 3D Visual Tracking for Robotic-Assisted Cardiac Interventions , 2010, MICCAI.

[18]  Naoki Suzuki,et al.  Development of a navigation function for an endosocopic robot surgery system. , 2005, Studies in health technology and informatics.

[19]  Kirsten Schmieder,et al.  Percutaneous Placement of Pedicle Screws in the Lumbar Spine Using a Bone Mounted Miniature Robotic System: First Experiences and Accuracy of Screw Placement , 2009, Spine.

[20]  Herve Delingette,et al.  Real-Time Elastic Deformations of Soft Tissues for Surgery Simulation , 1999, IEEE Trans. Vis. Comput. Graph..

[21]  Naoki Suzuki,et al.  Surgery Simulation System with Haptic Sensation and Modeling of Elastic Organ That Re.ect the Patients' Anatomy , 2003, IS4TH.

[22]  Jihad H Kaouk,et al.  Robotic-assisted laparoendoscopic single-site surgery in gynecology: initial report and technique. , 2009, Journal of minimally invasive gynecology.

[23]  Michael Figl,et al.  Non-rigid Reconstruction of the Beating Heart Surface for Minimally Invasive Cardiac Surgery , 2009, MICCAI.

[24]  Georges-Pascal Haber,et al.  Transumbilical single-port surgery: evolution and current status. , 2008, European urology.

[25]  Guang-Zhong Yang,et al.  Affine-invariant anisotropic detector for soft tissue tracking in minimally invasive surgery , 2009, 2009 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[26]  Chia-Hsiang Wu,et al.  Three-Dimensional Modeling From Endoscopic Video Using Geometric Constraints Via Feature Positioning , 2007, IEEE Transactions on Biomedical Engineering.

[27]  Naoki Suzuki,et al.  Benefits of augmented reality function for laparoscopic and endoscopic surgical robot systems , 2008 .

[28]  Peter K. Allen,et al.  Design, simulation and evaluation of kinematic alternatives for Insertable Robotic Effectors Platforms in Single Port Access Surgery , 2010, 2010 IEEE International Conference on Robotics and Automation.