Enhanced markerless surgical robotic guidance system for keyhole neurosurgery

Image-based surgical techniques can support minimally invasive keyhole neurosurgery through the segmentation of computed tomography or magnetic resonance imaging, optimal surgical planning, and surgical guidance. Keyhole neurosurgery requires automatic surgical planning and accuracy guidance for a target of the non-invasive or minimally invasive treatment of an anatomical structure. For supporting these requirements, we propose a markerless surgical robotic guidance system for keyhole neurosurgery. Our proposed robotic system consists of a six-degree of freedom (DoF) robotic arm, a needle guidance device, a mobile cart, a control workstation, and a 3D surface scanner. A 3D surface scanner is used for markerless registration between a preoperative reference image and a patient’s face in the operating room. This system configuration has merits of minimally invasive surgery. Traditional frame-based registration requires a stereotactic frame onto the patient’s head. Also, it requires an additional CT/MRI scanning to identify the coordinate system of the frame. However, the proposed markerless system can register without an additional CT scan by using a surface scanner. First, we show the system configuration to perform robotic-assisted surgery precisely. Next, we analyze subcomponents and calibrations such as the repeatability of the robotic arm, hand-tool calibration error for the relationship between needle guidance device and flange of the robotic arm, 3D scanning accuracy of the surface scanner, and hand-eye calibration error for the relationship between the surface scanner and the flange of the robotic arm. After calibrating each component of proposed system, the system accuracy is affected by the propagation of small errors. We sampled 15 paths located in the working space to check and compensate the residual transformation. We also test the total system accuracy with a phantom model; the proposed system allows us to obtain translation error (0.75 ± 0.38 mm) and rotation error (0.85 ± 0.16°) as a residual median error, which satisfies a surgical requirement (< 1 mm). With placements of medical devices to the planned pathway, it is crucial to automatically calculate a surgical path for keyhole neurosurgery. Thus, we proposed a path-planning algorithm that can support surgical decision-making process for keyhole neurosurgery. In the proposed algorithm, a possible trajectory is defined by a pair of a possible entry point on skull surface and a target point inside of target region. Then, the surgical paths are evaluated to satisfy the surgical rules such as the avoidance of vital organs, the maximization of the coverage of the target volume, and orthogonal insertion into the scalp surface.

[1]  Abhilash Pandya,et al.  The application accuracy of the NeuroMate robot--A quantitative comparison with frameless and frame-based surgical localization systems. , 2002, Computer aided surgery : official journal of the International Society for Computer Aided Surgery.

[2]  David W. Roberts,et al.  Robotic placement of a CNS ventricular reservoir for administration of chemotherapy , 2009, British journal of neurosurgery.

[3]  Sandro Barone,et al.  Integration of 3D anatomical data obtained by CT imaging and 3D optical scanning for computer aided implant surgery , 2011, BMC Medical Imaging.

[4]  G. T. Reid,et al.  Interferogram Analysis: Digital Fringe Pattern Measurement Techniques , 1994 .

[5]  Giancarlo Ferrigno,et al.  Automatic Trajectory Planner for StereoElectroEncephaloGraphy Procedures: A Retrospective Study , 2013, IEEE Transactions on Biomedical Engineering.

[6]  Peisen Huang,et al.  Microscopic phase-shifting profilometry based on digital micromirror device technology. , 2002, Applied optics.

[7]  Benoit M. Dawant,et al.  A surgeon specific automatic path planning algorithm for deep brain stimulation , 2012, Medical Imaging.

[8]  Michael I. Miga,et al.  Techniques to correct for soft tissue deformations during image-guided brain surgery , 2005 .

[9]  S. Hayati,et al.  A robot with improved absolute positioning accuracy for CT guided stereotactic brain surgery , 1988, IEEE Transactions on Biomedical Engineering.

[10]  Lena Maier-Hein,et al.  Computer-assisted trajectory planning for percutaneous needle insertions. , 2011, Medical physics.

[11]  Paul S. Morgan,et al.  PathFinder image guided robot for neurosurgery , 2003, Ind. Robot.

[12]  Zhigang Deng,et al.  GPU-Accelerated Interactive Visualization and Planning of Neurosurgical Interventions , 2014, IEEE Computer Graphics and Applications.

[13]  Stephane Cotin,et al.  Preoperative trajectory planning for percutaneous procedures in deformable environments , 2016, Comput. Medical Imaging Graph..

[14]  Luc Soler,et al.  RF-Sim: a treatment planning tool for radiofrequency ablation of hepatic tumors , 2003, Proceedings on Seventh International Conference on Information Visualization, 2003. IV 2003..

[15]  Roger Y. Tsai,et al.  A new technique for fully autonomous and efficient 3D robotics hand/eye calibration , 1988, IEEE Trans. Robotics Autom..

[16]  Fabrice J. Bremand,et al.  Shadow moire by phase shifting method and applications , 1994, Other Conferences.

[17]  Jong-Mo Seo,et al.  Electromagnetic tracking of needle intervention for sacral nerve stimulation using the image-guided surgery toolkit (IGSTK) , 2013 .

[18]  H. Bjartmarz,et al.  Comparison of Accuracy and Precision between Frame-Based and Frameless Stereotactic Navigation for Deep Brain Stimulation Electrode Implantation , 2007, Stereotactic and Functional Neurosurgery.

[19]  Patrick Toussaint,et al.  The Impact of the Reference Imaging Modality, Registration Method and Intraoperative Flat-Panel Computed Tomography on the Accuracy of the ROSA® Stereotactic Robot , 2014, Stereotactic and Functional Neurosurgery.

[20]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  Caroline Essert,et al.  Automatic computation of electrode trajectories for Deep Brain Stimulation: a hybrid symbolic and numerical approach , 2012, International Journal of Computer Assisted Radiology and Surgery.

[22]  M. Takeda,et al.  Fourier transform profilometry for the automatic measurement of 3-D object shapes. , 1983, Applied optics.

[23]  Deukhee Lee,et al.  Markerless registration for intracerebral hemorrhage surgical system using weighted Iterative Closest Point (ICP) , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[24]  Abbas F. Sadikot,et al.  A multi-modal approach to computer-assisted deep brain stimulation trajectory planning , 2012, International Journal of Computer Assisted Radiology and Surgery.

[25]  L. Joskowicz,et al.  Surface-based facial scan registration in neuronavigation procedures: a clinical study. , 2009, Journal of neurosurgery.

[26]  G. Ferrigno,et al.  Review of Robotic Technology for Stereotactic Neurosurgery , 2015, IEEE Reviews in Biomedical Engineering.

[27]  David B. Camarillo,et al.  Robotic technology in surgery: past, present, and future. , 2004, American journal of surgery.

[28]  Thomas Luhmann,et al.  RECOMMENDATIONS FOR AN ACCEPTANCE AND VERIFICATION TEST OF OPTICAL 3-D MEASUREMENT SYSTEMS , 2000 .

[29]  Leo Joskowicz,et al.  Reduced risk trajectory planning in image-guided keyhole neurosurgery. , 2012, Medical physics.

[30]  Giancarlo Ferrigno,et al.  Accurate multi-robot targeting for keyhole neurosurgery based on external sensor monitoring , 2012, Proceedings of the Institution of Mechanical Engineers. Part H, Journal of engineering in medicine.

[31]  D. Louis Collins,et al.  Improving recorded volume in mesial temporal lobe by optimizing stereotactic intracranial electrode implantation planning , 2015, International Journal of Computer Assisted Radiology and Surgery.

[32]  Deukhee Lee,et al.  Automatic segmentation of leg bones by using active contours , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[33]  Deukhee Lee,et al.  Markerless surgical robotic system for intracerebral hemorrhage surgery , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[34]  Luc Soler,et al.  Trajectory optimization for the planning of percutaneous radiofrequency ablation of hepatic tumors , 2007, Computer aided surgery : official journal of the International Society for Computer Aided Surgery.

[35]  Heinz-Otto Peitgen,et al.  Fast automatic path proposal computation for hepatic needle placement , 2010, Medical Imaging.