Ultrasound image guidance and robot impedance control for beating-heart surgery

Abstract A novel control method is proposed for master–slave telerobotic beating-heart surgery to solve the challenges of rapid heart motion and oscillatory haptic feedback. In this paper, the ultrasound imaging-based control algorithms are used to make the slave robot compensate for the heart motion automatically. Issues including slow sampling rate and time delay caused by ultrasound imaging are addressed by a cubic interpolation and an extended Kalman filter (EKF), respectively. Meanwhile, to provide the human operator (surgeon) a feeling of operating on an idle heart, an impedance model is designed for the master robot. The proposed method is validated through experiments.

[1]  T. Yau,et al.  Cardiopulmonary bypass induced inflammation: pathophysiology and treatment. An update. , 2002, European journal of cardio-thoracic surgery : official journal of the European Association for Cardio-thoracic Surgery.

[2]  Mahdi Tavakoli,et al.  Development of a Robotic System to Enable Beating-heart Surgery , 2014 .

[3]  Mahdi Tavakoli,et al.  High-Fidelity Bilateral Teleoperation Systems and the Effect of Multimodal Haptics , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[4]  Robert D. Howe,et al.  Robotic tissue tracking for beating heart mitral valve surgery , 2013, Medical Image Anal..

[5]  Mahdi Tavakoli,et al.  Beating-heart robotic surgery using bilateral impedance control: Theory and experiments , 2018, Biomed. Signal Process. Control..

[6]  Luc Soler,et al.  Active filtering of physiological motion in robotized surgery using predictive control , 2005, IEEE Transactions on Robotics.

[7]  Mahdi Tavakoli,et al.  Smith Predictor Based Robot Control for Ultrasound-guided Teleoperated Beating-heart Surgery Y Output Signal of a Control System Ci Cubic Interpolation Ekf Extended Kalman Filter Poi Point of Interest Sp Smith Predictor Zoh Zero Order Hold , 2022 .

[8]  Mahdi Tavakoli,et al.  Towards robot‐assisted anchor deployment in beating‐heart mitral valve surgery , 2018, The international journal of medical robotics + computer assisted surgery : MRCAS.

[9]  Luc Soler,et al.  Model predictive control for compensation of cyclic organ motions in teleoperated laparoscopic surgery , 2006, IEEE Transactions on Control Systems Technology.

[10]  Eduardo F. Camacho,et al.  Commercial Model Predictive Control Schemes , 2007 .

[11]  Robert D. Howe,et al.  An active motion compensation instrument for beating heart mitral valve surgery , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[12]  Rui Cortesão,et al.  Robot Force Control on a Beating Heart , 2017, IEEE/ASME Transactions on Mechatronics.

[13]  Mojtaba Sharifi,et al.  Tele-echography of moving organs using an Impedance-controlled telerobotic system , 2017 .

[14]  Raimondo Ascione,et al.  Early and midterm outcome after off-pump and on-pump surgery in Beating Heart Against Cardioplegic Arrest Studies (BHACAS 1 and 2): a pooled analysis of two randomised controlled trials , 2002, The Lancet.

[15]  Mahdi Tavakoli,et al.  Ultrasound-Based Image Guidance and Motion Compensating Control for Robot-Assisted Beating-Heart Surgery , 2016, J. Medical Robotics Res..

[16]  Shelten G. Yuen,et al.  Robotic motion compensation for 3D ultrasound-guided beating heart surgery , 2009 .

[17]  Ozkan Bebek,et al.  Intelligent control algorithms for robotic-assisted beating heart surgery , 2007, IEEE Transactions on Robotics.

[18]  David P Miller,et al.  Do Patients With Less Than 'Echo‐Perfect' Results From Mitral Valve Repair by Intraoperative Echocardiography Have a Different Outcome? , 1993, Circulation.

[19]  Mahdi Tavakoli,et al.  Physiological Organ Motion Prediction and Compensation Based on Multirate, Delayed, and Unregistered Measurements in Robot-Assisted Surgery and Therapy , 2016, IEEE/ASME Transactions on Mechatronics.

[20]  Allison M. Okamura,et al.  Analysis of Suture Manipulation Forces for Teleoperation with Force Feedback , 2002, MICCAI.

[21]  Shahin Sirouspour,et al.  Nonlinear and Filtered Force/Position Mappings in Bilateral Teleoperation With Application to Enhanced Stiffness Discrimination , 2009, IEEE Transactions on Robotics.

[22]  Cameron N. Riviere,et al.  Robotic Compensation of Biological Motion to Enhance Surgical Accuracy , 2006, Proceedings of the IEEE.

[23]  Meaghan L Bowthorpe,et al.  Control for Robot-assisted Image-guided Beating-heart Surgery , 2016 .

[24]  Chao Liu,et al.  Beating Heart Motion Compensation Using Active Observers and Disturbance Estimation , 2012, SyRoCo.

[25]  Cameron N. Riviere,et al.  Micron: An Actively Stabilized Handheld Tool for Microsurgery , 2012, IEEE Transactions on Robotics.

[26]  Takahiro Nozaki,et al.  Heartbeat Synchronization With Haptic Feedback for Telesurgical Robot , 2014, IEEE Transactions on Industrial Electronics.

[27]  Xiang Xiaoyong,et al.  Cardiopulmonary bypass induced inflammation: pathophysiology and treatment , 2005 .

[28]  Rui Pedro Duarte Cortesão,et al.  Cascade robot force control architecture for autonomous beating heart motion compensation with model predictive control and active observer , 2014, 5th IEEE RAS/EMBS International Conference on Biomedical Robotics and Biomechatronics.

[29]  Katherine J. Kuchenbecker,et al.  Induced Master Motion in Force-Reflecting Teleoperation , 2006 .

[30]  Robert D. Howe,et al.  Robotic Motion Compensation for Beating Heart Intracardiac Surgery , 2009, Int. J. Robotics Res..

[31]  Guillaume Morel,et al.  Physiological Motion Compensation in Robotized Surgery using Force Feedback Control , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[32]  A. Jazwinski.  Stochastic Processes and Filtering Theory , 1970 .

[33]  Robert D. Howe,et al.  Robotic catheter cardiac ablation combining ultrasound guidance and force control , 2014, Int. J. Robotics Res..

[34]  Chao Liu,et al.  Viscoelastic model based force control for soft tissue interaction and its application in physiological motion compensation , 2014, Comput. Methods Programs Biomed..

[35]  Mahdi Tavakoli,et al.  Generalized Predictive Control of a Surgical Robot for Beating-Heart Surgery Under Delayed and Slowly-Sampled Ultrasound Image Data , 2016, IEEE Robotics and Automation Letters.