Towards autonomous collision avoidance in surgical robots using image segmentation and genetic algorithms

Surgical robots provide various advantages, like improved precision and dexterity, over conventional surgical procedures and have been extensively studied in the last decade. However, safety is still a major concern mainly due to the unreliable or no haptic feedback to the surgeon and the shaky movements (tremors) in the surgeons hands. These issues may result in unwanted collisions between the robotic arm tips and the soft tissues of the human body or between the robotic arm tips inside the human body causing non-repairable damage. In this paper, we propose to overcome this problem by using image segmentation techniques, on the real-time video of the robotic surgery, along with genetic algorithms to avoid possible collisions. The main idea is to introduce an automatic collision avoidance mechanism upon detecting a threat for a possible collision. For illustration, some preliminary results on using image segmentation on a video of the cholecystectomy surgical procedure are presented.

[1]  Gerd Hirzinger,et al.  Optimal Design of a Medical Robot for Minimally Invasive Surgery , 2003 .

[2]  Du Xin,et al.  Neural network and genetic algorithm based global path planning in a static environment , 2005 .

[3]  Rodney A. Brooks,et al.  A Robust Layered Control Syste For A Mobile Robot , 2022 .

[4]  Andrius Usinskas,et al.  A SURVEY OF GENETIC ALGORITHMS APPLICATIONS FOR IMAGE ENHANCEMENT AND SEGMENTATION , 2007 .

[5]  Tobias Ortmaier,et al.  Design requirements for a new robot for minimally invasive surgery , 2004, Ind. Robot.

[6]  W. T. Ang,et al.  Estimation and filtering of physiological tremor for real‐time compensation in surgical robotics applications , 2010, The international journal of medical robotics + computer assisted surgery : MRCAS.

[7]  Gregory D. Hager,et al.  Vision-assisted control for manipulation using virtual fixtures , 2001, IEEE Transactions on Robotics.

[8]  Russell H. Taylor,et al.  Spatial motion constraints in medical robot using virtual fixtures generated by anatomy , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[9]  Alois Knoll,et al.  The Endo[PA]R system for minimally invasive robotic surgery , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[10]  El-Ghazali Talbi,et al.  Using Genetic Algorithms for Robot Motion Planning , 1991, Geometric Reasoning for Perception and Action.

[11]  Gregory D. Hager,et al.  Spatial motion constraints: theory and demonstrations for robot guidance using virtual fixtures , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[12]  W. Gharieb,et al.  Path planning for a mobile robot using genetic algorithms , 2004, International Conference on Electrical, Electronic and Computer Engineering, 2004. ICEEC '04..

[13]  Gregory D. Hager,et al.  Vision-assisted control for manipulation using virtual fixtures , 2004, IEEE Trans. Robotics.

[14]  Patrick Pérez,et al.  Poisson image editing , 2003, ACM Trans. Graph..

[15]  Sebti Foufou,et al.  A multiagent system approach for image segmentation using genetic algorithms and extremal optimization heuristics , 2006, Pattern Recognit. Lett..

[16]  J. Marescaux,et al.  Transcontinental Robot-Assisted Remote Telesurgery: Feasibility and Potential Applications , 2002, Annals of surgery.

[17]  van den,et al.  Realization of a demonstrator slave for robotic minimally invasive surgery , 2010 .

[18]  Ken Masamune,et al.  Advances in Haptics, Tactile Sensing, and Manipulation for Robot-Assisted Minimally Invasive Surgery, Noninvasive Surgery, and Diagnosis , 2012, J. Robotics.

[19]  David J. Evans,et al.  Volumetric segmentation of brain images using parallel genetic algorithms , 2002, IEEE Transactions on Medical Imaging.

[20]  Simon X. Yang,et al.  Genetic algorithm based path planning for a mobile robot , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[21]  Stefano Gidaro,et al.  The future of telesurgery: a universal system with haptic sensation. , 2012, Journal of the Turkish German Gynecological Association.

[22]  Ujjwal Maulik,et al.  Medical Image Segmentation Using Genetic Algorithms , 2009, IEEE Transactions on Information Technology in Biomedicine.

[23]  Wei Tech Ang,et al.  Multi-Step Prediction of Physiological Tremor With Random Quaternion Neurons for Surgical Robotics Applications , 2018, IEEE Access.

[24]  N. Singh,et al.  Robotics in plastic and reconstructive surgery: use of a telemanipulator slave robot to perform microvascular anastomoses. , 2006, Journal of reconstructive microsurgery.

[25]  Simon P. DiMaio,et al.  The da Vinci Surgical System , 2011 .

[26]  Amod Kumar,et al.  Tremor acquisition and reduction for robotic surgical applications , 2013, 2013 International Conference on Advanced Electronic Systems (ICAES).

[27]  John R. Koza,et al.  Evolution of Subsumption Using Genetic Programming , 1993 .

[28]  Riccardo Poli,et al.  Genetic algorithm-based interactive segmentation of 3D medical images , 1999, Image Vis. Comput..

[29]  Wenbing Tao,et al.  Image segmentation by three-level thresholding based on maximum fuzzy entropy and genetic algorithm , 2003, Pattern Recognit. Lett..

[30]  Heng-Ming Tai,et al.  Autonomous local path planning for a mobile robot using a genetic algorithm , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[31]  E. Hanly,et al.  Twenty-first century surgery using twenty-first century technology: surgical robotics. , 2004, Current surgery.

[32]  Michael D Klein,et al.  Totally minimally invasive robot-assisted unstented pyeloplasty using the Zeus Microwrist Surgical System: an animal study. , 2005, Journal of pediatric surgery.

[33]  Essam A. El-Kwae,et al.  Edge detection in medical images using a genetic algorithm , 1998, IEEE Transactions on Medical Imaging.

[34]  Blake Hannaford,et al.  Raven: Developing a Surgical Robot from a Concept to a Transatlantic Teleoperation Experiment , 2011 .