Stitching Dynamic Movement Primitives and Image-based Visual Servo Control

Utilizing perception for feedback control in combination with Dynamic Movement Primitive (DMP)-based motion generation for a robot’s end-effector control is a useful solution for many robotic manufacturing tasks. For instance, while performing an insertion task when the hole or the recipient part is not visible in the eye-in-hand camera, a learning-based movement primitive method can be used to generate the endeffector path. Once the recipient part is in the field of view (FOV), Image-based Visual Servo (IBVS) can be used to control the motion of the robot. Inspired by such applications, this paper presents a generalized control scheme that switches between motion generation using DMPs and IBVS control. To facilitate the design, a common state space representation for the DMP and the IBVS systems is first established. Stability analysis of the switched system using multiple Lyapunov functions shows that the state trajectories converge to a bound asymptotically. The developed method is validated by two real world experiments using the eye-in-hand configuration on a Baxter research robot.

[1]  Kin Huat Low,et al.  Linear Velocity-Free Visual Servoing Control for Unmanned Helicopter Landing on a Ship With Visibility Constraint , 2021 .

[2]  Thomas A. Fuhlbrigge,et al.  Robotic Wire Pinning for Wire Harness Assembly Automation , 2020, 2020 IEEE/ASME International Conference on Advanced Intelligent Mechatronics (AIM).

[3]  Guoqiang Hu,et al.  Keeping Multiple Moving Targets in the Field of View of a Mobile Camera , 2011, IEEE Transactions on Robotics.

[4]  Anup Parikh,et al.  A Switched Systems Approach to Image-Based Localization of Targets That Temporarily Leave the Camera Field of View , 2018, IEEE Transactions on Control Systems Technology.

[5]  Zhijun Li,et al.  Visual Servoing of Constrained Mobile Robots Based on Model Predictive Control , 2017, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[6]  Daniele Astolfi,et al.  Uniting Observers , 2020, IEEE Transactions on Automatic Control.

[7]  Debasish Chatterjee,et al.  Input-to-state stability of switched systems and switching adaptive control , 2007, Autom..

[8]  Jamal Daafouz,et al.  Stability analysis and control synthesis for switched systems: a switched Lyapunov function approach , 2002, IEEE Trans. Autom. Control..

[9]  Daniel Liberzon,et al.  Switching in Systems and Control , 2003, Systems & Control: Foundations & Applications.

[10]  Ashwin P. Dani,et al.  Combining Motion Primitives and Image-Based Visual Servo Control , 2020 .

[11]  Jun Morimoto,et al.  Orientation in Cartesian space dynamic movement primitives , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[12]  Ashwin P. Dani,et al.  Full- and Reduced-Order Observers for Image-Based Depth Estimation Using Concurrent Learning , 2020, IEEE Transactions on Control Systems Technology.

[13]  João Pedro Hespanha,et al.  Uniform stability of switched linear systems: extensions of LaSalle's Invariance Principle , 2004, IEEE Transactions on Automatic Control.

[14]  Zachary I. Bell,et al.  A Switched Systems Framework for Path Following With Intermittent State Feedback , 2018, IEEE Control Systems Letters.

[15]  Nicholas R. Gans,et al.  Homography-Based Control Scheme for Mobile Robots With Nonholonomic and Field-of-View Constraints , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[16]  François Chaumette,et al.  Potential problems of stability and convergence in image-based and position-based visual servoing , 1997 .

[17]  A. Morse,et al.  Basic problems in stability and design of switched systems , 1999 .

[18]  Jun Nakanishi,et al.  Learning Attractor Landscapes for Learning Motor Primitives , 2002, NIPS.

[19]  Sushant Veer,et al.  Switched Systems With Multiple Equilibria Under Disturbances: Boundedness and Practical Stability , 2020, IEEE Transactions on Automatic Control.

[20]  M. Branicky Multiple Lyapunov functions and other analysis tools for switched and hybrid systems , 1998, IEEE Trans. Autom. Control..

[21]  Hai Lin,et al.  Stability and Stabilizability of Switched Linear Systems: A Survey of Recent Results , 2009, IEEE Transactions on Automatic Control.

[22]  Yongchun Fang,et al.  Virtual-Goal-Guided RRT for Visual Servoing of Mobile Robots With FOV Constraint , 2021, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[23]  Zachary I. Bell,et al.  A Switched Systems Approach to Path Following With Intermittent State Feedback , 2018, IEEE Transactions on Robotics.

[24]  Andrew R. Teel,et al.  Uniting Local and Global Output Feedback Controllers , 2011, IEEE Transactions on Automatic Control.

[25]  Anup Parikh,et al.  Invariance-Like Results for Nonautonomous Switched Systems , 2016, IEEE Transactions on Automatic Control.

[26]  Nicholas R. Gans,et al.  Stable Visual Servoing Through Hybrid Switched-System Control , 2007, IEEE Transactions on Robotics.

[27]  A. Morse,et al.  Stability of switched systems with average dwell-time , 1999, Proceedings of the 38th IEEE Conference on Decision and Control (Cat. No.99CH36304).

[28]  M. Spong,et al.  Robot Modeling and Control , 2005 .

[29]  Jun Ye,et al.  A Switching Control Perspective on the Offshore Construction Scenario of Heavy-Lift Vessels , 2021, IEEE Transactions on Control Systems Technology.

[30]  François Chaumette,et al.  Visual servo control. I. Basic approaches , 2006, IEEE Robotics & Automation Magazine.

[31]  Qing Wei,et al.  Control of Oriented Mechanical systems: A Method Based on Dual Quaternion , 2008 .

[32]  Anup Parikh,et al.  Decentralized Synchronization of Uncertain Nonlinear Systems With a Reputation Algorithm , 2018, IEEE Transactions on Control of Network Systems.