Constrained visual predictive control of tendon-driven continuum robots

Abstract Due to their compliance, continuum robots (CRs) hold great potential for many applications. However, despite intensive recent research, their control poses significant challenges. The nonlinear kinematic behavior, limited actuation channels, and physical and environmental constraints typically associated with CRs hinder the development of effective control strategies. In this paper, a visual predictive position control method for tendon-driven continuum robots is proposed. The developed control approach integrates the advantages of image-based visual servoing and model predictive control techniques to enable direct end-point control in the presence of constraints and improve the control robustness to system uncertainties, sensing noise, and modeling errors. Both simulation and experimental results demonstrate the effectiveness of the method.

[1]  W. Wilson,et al.  Comparison of Basic Visual Servoing Methods , 2011, IEEE/ASME Transactions on Mechatronics.

[2]  Ilya V. Kolmanovsky,et al.  Model Predictive Control for Spacecraft Rendezvous and Docking: Strategies for Handling Constraints and Case Studies , 2015, IEEE Transactions on Control Systems Technology.

[3]  Farrokh Janabi-Sharifi,et al.  A Fuzzy Reinforcement Learning Approach for Continuum Robot Control , 2020, Journal of Intelligent & Robotic Systems.

[4]  Yacine Amirat,et al.  Modeling and Control of a Hybrid Continuum Active Catheter for Aortic Aneurysm Treatment , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[5]  Farrokh Janabi-Sharifi,et al.  Jacobian Formulation for Two Classes of Cooperative Continuum Robots , 2020 .

[6]  Frank Dellaert,et al.  On-Manifold Preintegration for Real-Time Visual--Inertial Odometry , 2015, IEEE Transactions on Robotics.

[7]  François Chaumette,et al.  Predictive Control for Constrained Image-Based Visual Servoing , 2010, IEEE Transactions on Robotics.

[8]  Farrokh Janabi-Sharifi,et al.  Depth-based Visual Predictive Control of Tendon-Driven Continuum Robots , 2020, 2020 IEEE/ASME International Conference on Advanced Intelligent Mechatronics (AIM).

[9]  C. David Remy,et al.  Modeling and Control of Soft Robots Using the Koopman Operator and Model Predictive Control , 2019, Robotics: Science and Systems.

[10]  Hui Shao,et al.  Design, Verification, and Application of New Discrete-Time Recurrent Neural Network for Dynamic Nonlinear Equations Solving , 2018, IEEE Transactions on Industrial Informatics.

[11]  Peter I. Corke,et al.  Choice of image features for depth-axis control in image based visual servo control , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[12]  Xinwu Liang,et al.  Model Predictive Control for Constrained Image‐Based Visual Servoing in Uncalibrated Environments , 2018 .

[13]  Li Yu,et al.  Gaussian process-based nonlinear predictive control for visual servoing of constrained mobile robots with unknown dynamics , 2021, Robotics Auton. Syst..

[14]  François Chaumette,et al.  Visual servo control. I. Basic approaches , 2006, IEEE Robotics & Automation Magazine.

[15]  William J. Wilson,et al.  Hybrid motion control and planning strategies for visual servoing , 2005, IEEE Transactions on Industrial Electronics.

[16]  Cecilia Laschi,et al.  Control Strategies for Soft Robotic Manipulators: A Survey. , 2018, Soft robotics.

[17]  Yunhui Liu,et al.  Robust Model-Predictive Deformation Control of a Soft Object by Using a Flexible Continuum Robot , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[18]  Manfred Morari,et al.  Model predictive control: Theory and practice , 1988 .

[19]  Éric Marchand,et al.  Eye-in-hand/eye-to-hand cooperation for visual servoing , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[20]  M. Pavella,et al.  Direct methods for studying dynamics of large-scale electric power systems - A survey , 1985, Autom..

[21]  Christian Duriez,et al.  Motion Control of Cable-Driven Continuum Catheter Robot Through Contacts , 2019, IEEE Robotics and Automation Letters.

[22]  Ian D. Walker,et al.  Continuous Backbone “Continuum” Robot Manipulators , 2013 .

[23]  Farrokh Janabi-Sharifi,et al.  Cooperative Continuum Robots: Concept, Modeling, and Workspace Analysis , 2018, IEEE Robotics and Automation Letters.

[24]  Li Yu,et al.  Vision-based neural predictive tracking control for multi-manipulator systems with parametric uncertainty. , 2020, ISA transactions.

[25]  Estelle Courtial,et al.  Visual predictive control for manipulators with catadioptric camera , 2008, 2008 IEEE International Conference on Robotics and Automation.

[26]  Stefano Di Cairano,et al.  Reference and command governors for systems with constraints: A survey on theory and applications , 2017, Autom..

[27]  Farrokh Janabi-Sharifi,et al.  Design and Experimental Evaluation of an Automated Catheter Operating System. , 2020, Artificial organs.

[28]  Éric Marchand,et al.  ViSP for visual servoing: a generic software platform with a wide class of robot control skills , 2005, IEEE Robotics & Automation Magazine.

[29]  Muhammad Ashfaq,et al.  Scientific Study of Balance ( al-Mīzān ) in the Light of Sūrah Al-Rahmān , 2016 .

[30]  Robert J. Webster,et al.  Design and Kinematic Modeling of Constant Curvature Continuum Robots: A Review , 2010, Int. J. Robotics Res..

[31]  Jinwoo Jung,et al.  A modeling approach for robotic catheters: effects of nonlinear internal device friction , 2014, Adv. Robotics.

[32]  Basil Kouvaritakis,et al.  Reference governors and predictive control , 1998, Proceedings of the 1998 American Control Conference. ACC (IEEE Cat. No.98CH36207).

[33]  François Chaumette,et al.  Visual servo control. II. Advanced approaches [Tutorial] , 2007, IEEE Robotics & Automation Magazine.

[34]  Patrick Rives,et al.  A new approach to visual servoing in robotics , 1992, IEEE Trans. Robotics Autom..

[35]  Ian D. Walker,et al.  Kinematics and the Implementation of an Elephant's Trunk Manipulator and Other Continuum Style Robots , 2003, J. Field Robotics.

[36]  Sarthak Misra,et al.  Model predictive control of a robotically actuated delivery sheath for beating heart compensation , 2017, Int. J. Robotics Res..

[37]  Puneet Kumar Singh,et al.  Continuum Arm Robotic Manipulator: A Review , 2014 .

[38]  Graziano Chesi,et al.  Visual Servoing Path Planning via Homogeneous Forms and LMI Optimizations , 2009, IEEE Transactions on Robotics.

[40]  Ian D. Walker,et al.  Kinematics for multisection continuum robots , 2006, IEEE Transactions on Robotics.

[41]  Ian D. Walker,et al.  A New Approach to Jacobian Formulation for a Class of Multi-Section Continuum Robots , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[42]  Robert D. Howe,et al.  Algorithms for Automatically Pointing Ultrasound Imaging Catheters , 2017, IEEE Transactions on Robotics.

[43]  Farrokh Janabi-Sharifi,et al.  Catheter Kinematics for Intracardiac Navigation , 2009, IEEE Transactions on Biomedical Engineering.

[44]  Jing Sun,et al.  Incremental step reference governor for load conditioning of hybrid Fuel Cell and Gas Turbine power plants , 2008, 2008 American Control Conference.

[45]  P. Poignet,et al.  Image Based Visual Servoing through Nonlinear Model Predictive Control , 2006, Proceedings of the 45th IEEE Conference on Decision and Control.

[46]  Farrokh Janabi-Sharifi,et al.  Dynamic modeling and system identification of internally actuated, small-sized continuum robots , 2020 .

[47]  Spring Berman,et al.  Nonlinear MPC for collision-free and deadlock-free navigation of multiple nonholonomic mobile robots , 2021, Robotics Auton. Syst..

[48]  Nirvana Popescu,et al.  Position and force control of the grasping function for a hyperredundant arm , 2008, 2008 IEEE International Conference on Robotics and Automation.

[49]  Farrokh Janabi-Sharifi,et al.  Kinematic characterization of a cardiac ablation catheter , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[50]  W. Sardha Wijesoma,et al.  Eye-to-Hand Coordination for Vision-Guided Robot Control Applications , 1993, Int. J. Robotics Res..

[51]  Marc D. Killpack,et al.  Real-Time Nonlinear Model Predictive Control of Robots Using a Graphics Processing Unit , 2020, IEEE Robotics and Automation Letters.

[52]  Robert J. Webster,et al.  Toward Active Cannulas: Miniature Snake-Like Surgical Robots , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[53]  Nicolas Andreff,et al.  Eye-in-Hand Visual Servoing of Concentric Tube Robots , 2018, IEEE Robotics and Automation Letters.

[54]  Alberto Bemporad,et al.  Constrained Model Predictive Control of spacecraft attitude with reaction wheels desaturation , 2015, 2015 European Control Conference (ECC).

[55]  Xinwu Liang,et al.  Visual Servoing of Soft Robot Manipulator in Constrained Environments With an Adaptive Controller , 2017, IEEE/ASME Transactions on Mechatronics.