A Dynamical System Approach for Softly Catching a Flying Object: Theory and Experiment

Catching a fast flying object is particularly challenging as it consists of two tasks: extremely precise estimation of the object's motion and control of the robot's motion. Any small imprecision may lead the fingers to close too abruptly and let the object fly away from the hand before closing. We present a strategy to overcome for sensorimotor imprecision by introducing softness in the catching approach. Soft catching consists of having the robot moves with the object for a short period of time, so as to leave more time for the fingers to close on the object. We use a dynamic system-based control law to generate the appropriate reach and follow motion, which is expressed as a linear parameter varying (LPV) system. We propose a method to approximate the parameters of LPV systems using Gaussian mixture models, based on a set of kinematically feasible demonstrations generated by an offline optimal control framework. We show theoretically that the resulting DS will intercept the object at the intercept point, at the right time with the desired velocity direction. Stability and convergence of the approach are assessed through Lyapunov stability theory. The proposed method is validated systematically to catch three objects that generate elastic contacts and demonstrate important improvement over a hard catching approach.

[1]  Mokhtar S. Bazaraa,et al.  Nonlinear Programming: Theory and Algorithms , 1993 .

[2]  M. Powell A Direct Search Optimization Method That Models the Objective and Constraint Functions by Linear Interpolation , 1994 .

[3]  Jean-Jacques E. Slotine,et al.  Experiments in Hand-Eye Coordination Using Active Vision , 1995, ISER.

[4]  Bassam Bamieh,et al.  Identification of linear parameter varying models , 2002 .

[5]  Fumio Miyazaki,et al.  Tracking and catching of 3d flying target based on gag strategy , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[6]  Fumio Miyazaki,et al.  A learning approach to robotic table tennis , 2005, IEEE Transactions on Robotics.

[7]  Jun Nakanishi,et al.  Comparative experiments on task space control with redundancy resolution , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[8]  Masatoshi Ishikawa,et al.  Ball control in high-speed batting motion using hybrid trajectory generator , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[9]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.

[10]  Koichiro Deguchi,et al.  A goal oriented just-in-time visual servoing for ball catching robot arm , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[11]  Masatoshi Ishikawa,et al.  Skillful manipulation based on high-speed sensory-motor fusion , 2009, 2009 IEEE International Conference on Robotics and Automation.

[12]  ChangHwan Kim,et al.  Human-like catching motion of humanoid using Evolutionary Algorithm(EA)-based imitation learning , 2009, RO-MAN 2009 - The 18th IEEE International Symposium on Robot and Human Interactive Communication.

[13]  Berthold Bäuml,et al.  Kinematically optimal catching a flying ball with a hand-arm-system , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[14]  Aude Billard,et al.  Learning Stable Nonlinear Dynamical Systems With Gaussian Mixture Models , 2011, IEEE Transactions on Robotics.

[15]  Gerd Hirzinger,et al.  Trajectory planning for optimal robot catching in real-time , 2011, 2011 IEEE International Conference on Robotics and Automation.

[16]  Aude Billard,et al.  Coupled dynamical system based arm-hand grasping model for learning fast adaptation strategies , 2012, Robotics Auton. Syst..

[17]  Aude Billard,et al.  Estimating the non-linear dynamics of free-flying objects , 2012, Robotics Auton. Syst..

[18]  Matthew Glisson,et al.  Playing catch and juggling with a humanoid robot , 2012, 2012 12th IEEE-RAS International Conference on Humanoid Robots (Humanoids 2012).

[19]  Jan Peters,et al.  Learning throwing and catching skills , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[20]  Hod Lipson,et al.  Learning symbolic representations of hybrid dynamical systems , 2012, J. Mach. Learn. Res..

[21]  Vincenzo Lippiello,et al.  3D monocular robotic ball catching , 2013, Robotics Auton. Syst..

[22]  Aude Billard,et al.  Catching Objects in Flight , 2014, IEEE Transactions on Robotics.

[23]  Christian Hoffmann,et al.  A Survey of Linear Parameter-Varying Control Applications Validated by Experiments or High-Fidelity Simulations , 2015, IEEE Transactions on Control Systems Technology.

[24]  Alireza Karimi,et al.  Fixed-structure LPV discrete-time controller design with induced l2-norm and performance , 2016, Int. J. Control.