Nonlinear Force Feedback Enhancement for Cooperative Robotic Neurosurgery Enforces Virtual Boundaries on Cortex Surface

Surgeons can benefit from the cooperation with a robotic assistant during the repetitive execution of precise targeting tasks on soft tissues, such as brain cortex stimulation procedures in open-skull neurosurgery. Position-based force-to-motion control schemes may not be satisfactory solution to provide the manipulator with the high compliance desirable during guidance along wide trajectories. A new torque controller with nonlinear force feedback enhancement (FFE) is presented to provide augmented haptic perception to the operator from instrument-tissue interaction. Simulation tests were performed to evaluate the system stability according to different nonlinear force modulation functions (power, sigmoidal and arc tangent). The FFE controller with power modulation was experimentally validated with a pool of nonexpert users using brain-mimicking gelatin phantoms (8–16% concentration). Besides providing hand tremor rejection for a stable holding of the tool, the FFE controller was proven to allow for a safer tissue contact with respect to both robotic assistance without force feedback and freehand executions (50% and 75% reduction of the indentation depth, respectively). Future work will address the evaluation of the safety features of the FFE controller with expert surgeons on a realistic brain phantom, also accounting for unpredictable tissue motions as during seizures due to cortex stimulation.

[1]  Gregory D. Hager,et al.  Effect of Hand Dynamics on Virtual Fixtures for Compliant Human-Machine Interfaces , 2006, 2006 14th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[2]  Alois Knoll,et al.  Haptic Feedback in a Telepresence System for Endoscopic Heart Surgery , 2007, PRESENCE: Teleoperators and Virtual Environments.

[3]  K Miller,et al.  Mechanical properties of brain tissue in-vivo: experiment and computer simulation. , 2000, Journal of biomechanics.

[4]  Yohan Payan,et al.  In vivo measurement of human brain elasticity using a light aspiration device , 2009, Medical Image Anal..

[5]  Russell H. Taylor,et al.  New steady-hand Eye Robot with micro-force sensing for vitreoretinal surgery , 2010, 2010 3rd IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics.

[6]  Wei Tech Ang,et al.  Estimation of Physiological Tremor from Accelerometers for Real-Time Applications , 2011, Sensors.

[7]  Giancarlo Ferrigno,et al.  Adaptive Hands-On Control for Reaching and Targeting Tasks in Surgery , 2015 .

[8]  Rajni V. Patel,et al.  Needle insertion into soft tissue: a survey. , 2007, Medical engineering & physics.

[9]  Vincent Hayward,et al.  Discrete-time adaptive windowing for velocity estimation , 2000, IEEE Trans. Control. Syst. Technol..

[10]  Leo Joskowicz,et al.  Validation of a stereo camera system to quantify brain deformation due to breathing and pulsatility. , 2014, Medical physics.

[11]  Dale A. Lawrence,et al.  Impedance control stability properties in common implementations , 1988, Proceedings. 1988 IEEE International Conference on Robotics and Automation.

[12]  J. Raczkowsky,et al.  Visual servoing with an optical tracking system and a lightweight robot for laser osteotomy , 2009, 2009 IEEE International Conference on Control and Automation.

[13]  Christopher R. Wagner,et al.  Force Feedback Benefit Depends on Experience in Multiple Degree of Freedom Robotic Surgery Task , 2007, IEEE Transactions on Robotics.

[14]  David L. Akin,et al.  A Survey of Quantitative Team Performance Metrics for Human-Robot Collaboration , 2011 .

[15]  Russell H. Taylor,et al.  A multi-function force sensing instrument for variable admittance robot control in retinal microsurgery , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[16]  Fadi Dornaika,et al.  Hand-Eye Calibration , 1995, Int. J. Robotics Res..

[17]  Cameron N. Riviere,et al.  Micron: An Actively Stabilized Handheld Tool for Microsurgery , 2012, IEEE Transactions on Robotics.

[18]  Brian L. Davies,et al.  Active-Constraint Robotics for Surgery , 2006, Proceedings of the IEEE.

[19]  H. Duffau,et al.  Intraoperative electrical stimulation in awake craniotomy: methodological aspects of current practice. , 2010, Neurosurgical focus.

[20]  Russell H. Taylor,et al.  A Miniature Instrument Tip Force Sensor for Robot/Human Cooperative Microsurgical Manipulation with Enhanced Force Feedback , 2000, MICCAI.

[21]  P ? ? ? ? ? ? ? % ? ? ? ? , 1991 .

[22]  T. Ortmaier,et al.  The touch and feel in minimally invasive surgery , 2005, IEEE International Workshop on Haptic Audio Visual Environments and their Applications.

[23]  A. Okamura Haptic feedback in robot-assisted minimally invasive surgery , 2009, Current opinion in urology.

[24]  Allison M. Okamura,et al.  Methods for haptic feedback in teleoperated robot-assisted surgery , 2004 .

[25]  Guillaume Morel,et al.  How can human motion prediction increase transparency? , 2008, 2008 IEEE International Conference on Robotics and Automation.

[26]  Giancarlo Ferrigno,et al.  Intraoperative forces and moments analysis on patient head clamp during awake brain surgery , 2012, Medical & Biological Engineering & Computing.

[27]  Saeid Nahavandi,et al.  Effects of realistic force feedback in a robotic assisted minimally invasive surgery system , 2014, Minimally invasive therapy & allied technologies : MITAT : official journal of the Society for Minimally Invasive Therapy.

[28]  Russell H. Taylor,et al.  A novel dual force sensing instrument with cooperative robotic assistant for vitreoretinal surgery , 2013, 2013 IEEE International Conference on Robotics and Automation.

[29]  Friedrich M. Wahl,et al.  On-line rigid object recognition and pose estimation based on inertial parameters , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[30]  Elena De Momi,et al.  Coaxial Needle Insertion Assistant With Enhanced Force Feedback , 2013, IEEE Transactions on Biomedical Engineering.

[31]  Elena De Momi,et al.  Experimental evaluation of a coaxial needle insertion assistant with enhanced force feedback , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[32]  Christian Ott,et al.  Passivity Based Cartesian Impedance Control for Flexible Joint Manipulators , 2004 .

[33]  S. Holm A Simple Sequentially Rejective Multiple Test Procedure , 1979 .

[34]  Luc Soler,et al.  IN VIVO STUDY OF FORCES DURING NEEDLE INSERTIONS , 2004 .

[35]  Timothy N Judkins,et al.  Augmented reality and haptic interfaces for robot‐assisted surgery , 2012, The international journal of medical robotics + computer assisted surgery : MRCAS.