Learning accurate kinematic control of cable-driven surgical robots using data cleaning and Gaussian Process Regression

Precise control of industrial automation systems with non-linear kinematics due to joint elasticity, variation in cable tensioning, or backlash is challenging; especially in systems that can only be controlled through an interface with an imprecise internal kinematic model. Cable-driven Robotic Surgical Assistants (RSAs) are one example of such an automation system, as they are designed for master-slave teleoperation. We consider the problem of learning a function to modify commands to the inaccurate control interface such that executing the modified command on the system results in a desired state. To achieve this, we must learn a mapping that accounts for the non-linearities in the kinematic chain that are not accounted for by the system's internal model. Gaussian Process Regression (GPR) is a data-driven technique that can estimate this non-linear correction in a task-specific region of state space, but it is sensitive to corruption of training examples due to partial occlusion or lighting changes. In this paper, we extend the use of GPR to learn a non-linear correction for cable-driven surgical robots by using (i) velocity as a feature in the regression and (ii) removing corrupted training observations based on rotation limits and the magnitude of velocity. We evaluate this approach on the Raven II Surgical Robot on the task of grasping foam “damaged tissue” fragments, using the PhaseSpace LED-based motion capture system to track the Raven end-effector. Our main result is a reduction in the norm of the mean position error from 2.6 cm to 0.2 cm and the norm of the mean angular error from 20.6 degrees to 2.8 degrees when correcting commands for a set of held-out trajectories. We also use the learned mapping to achieve a 3.8× speedup over past results on the task of autonomous surgical debridement.

[1]  Blake Hannaford,et al.  Raven-II: An Open Platform for Surgical Robotics Research , 2013, IEEE Transactions on Biomedical Engineering.

[2]  Erik Wernholt,et al.  On Multivariable and Nonlinear Identification of Industrial Robots , 2004 .

[3]  Andreas Pott,et al.  System identification and cable force control for a cable-driven parallel robot with industrial servo drives , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[4]  Austin Reiter,et al.  Appearance learning for 3D tracking of robotic surgical tools , 2014, Int. J. Robotics Res..

[5]  Dieter Fox,et al.  Learning GP-BayesFilters via Gaussian process latent variable models , 2009, Auton. Robots.

[6]  Sheng Chen,et al.  Model selection approaches for non-linear system identification: a review , 2008, Int. J. Syst. Sci..

[7]  Blake Hannaford,et al.  Robustness of the Unscented Kalman filter for state and parameter estimation in an elastic transmission , 2009, Robotics: Science and Systems.

[8]  Jan-Michael Frahm,et al.  RECON: Scale-adaptive robust estimation via Residual Consensus , 2011, 2011 International Conference on Computer Vision.

[9]  Tim Kraska,et al.  A sample-and-clean framework for fast and accurate query processing on dirty data , 2014, SIGMOD Conference.

[10]  A. Tornambe,et al.  A New Method for the Parameter Estimation of Elastic Robots , 1988, Proceedings of the 1988 IEEE International Conference on Systems, Man, and Cybernetics.

[11]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[12]  Pieter Abbeel,et al.  Finding Locally Optimal, Collision-Free Trajectories with Sequential Convex Optimization , 2013, Robotics: Science and Systems.

[13]  Bernard Delyon,et al.  Nonlinear black-box models in system identification: Mathematical foundations , 1995, Autom..

[14]  Jan-Michael Frahm,et al.  A Comparative Analysis of RANSAC Techniques Leading to Adaptive Real-Time Random Sample Consensus , 2008, ECCV.

[15]  Gaurav S. Sukhatme,et al.  Learning task error models for manipulation , 2013, 2013 IEEE International Conference on Robotics and Automation.

[16]  Weihai Chen,et al.  An Integrated Two-Level Self-Calibration Method for a Cable-Driven Humanoid Arm , 2013, IEEE Transactions on Automation Science and Engineering.

[17]  Carl E. Rasmussen,et al.  Gaussian Processes for Machine Learning (GPML) Toolbox , 2010, J. Mach. Learn. Res..

[18]  Blake Hannaford,et al.  Application of Unscented Kalman Filter to a cable driven surgical robot: A simulation study , 2012, 2012 IEEE International Conference on Robotics and Automation.

[19]  Pieter Abbeel,et al.  Autonomous multilateral debridement with the Raven surgical robot , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[20]  Blake Hannaford,et al.  Dynamically evaluated gravity compensation for the RAVEN surgical robot , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[21]  Micky Rakotondrabe,et al.  Robust Feedforward-Feedback Control of a Nonlinear and Oscillating 2-DOF Piezocantilever , 2011, IEEE Transactions on Automation Science and Engineering.

[22]  Alkis Gotovos,et al.  Active Learning for Level Set Estimation , 2022 .

[23]  David J. Fleet,et al.  Gaussian Process Dynamical Models , 2005, NIPS.

[24]  Dieter Fox,et al.  GP-UKF: Unscented kalman filters with Gaussian process prediction and observation models , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[25]  Heidar Ali Talebi,et al.  A stable neural network-based observer with application to flexible-joint manipulators , 2006, IEEE Transactions on Neural Networks.

[26]  Wisama Khalil,et al.  Model Identification , 2019, Springer Handbook of Robotics, 2nd Ed..

[27]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[28]  Paolo Gallina,et al.  Planar Translational Cable-Direct-Driven Robots , 2003, J. Field Robotics.

[29]  Azriel Rosenfeld,et al.  Analysis of the least median of squares estimator for computer vision applications , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[30]  Malte Kuss,et al.  Approximate inference for robust Gaussian process regression , 2005 .

[31]  Ronald K. Pearson,et al.  Outliers in process modeling and identification , 2002, IEEE Trans. Control. Syst. Technol..

[32]  Stig Moberg,et al.  Nonlinear gray-box identification using local models applied to industrial robots , 2011, Autom..

[33]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.