Catching Objects in Flight

We address the difficult problem of catching in-flight objects with uneven shapes. This requires the solution of three complex problems: accurate prediction of the trajectory of fastmoving objects, predicting the feasible catching configuration, and planning the arm motion, and all within milliseconds. We follow a programming-by-demonstration approach in order to learn, from throwing examples, models of the object dynamics and arm movement. We propose a new methodology to find a feasible catching configuration in a probabilistic manner. We use the dynamical systems approach to encode motion from several demonstrations. This enables a rapid and reactive adaptation of the arm motion in the presence of sensor uncertainty. We validate the approach in simulation with the iCub humanoid robot and in real-world experiments with the KUKA LWR 4+ (7-degree-of-freedom arm robot) to catch a hammer, a tennis racket, an empty bottle, a partially filled bottle, and a cardboard box.

[1]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[2]  G. Schwarz Estimating the Dimension of a Model , 1978 .

[3]  Kostas J. Kyriakopoulos,et al.  Minimum jerk path generation , 1988, Proceedings. 1988 IEEE International Conference on Robotics and Automation.

[4]  Youngil Youm,et al.  General algorithm for automatic generation of the workspace for n-link redundant manipulators , 1991, Fifth International Conference on Advanced Robotics 'Robots in Unstructured Environments.

[5]  Hong Zhang Efficient evaluation of the feasibility of robot displacement trajectories , 1993, IEEE Trans. Syst. Man Cybern..

[6]  Daniel E. Koditschek,et al.  Further progress in robot juggling: solvable mirror laws , 1994, Proceedings of the 1994 IEEE International Conference on Robotics and Automation.

[7]  Daniel E. Koditschek,et al.  Planning and Control of Robotic Juggling and Catching Tasks , 1994, Int. J. Robotics Res..

[8]  M. Buehler,et al.  Sensor-based online trajectory generation for smoothly grasping moving objects , 1994, Proceedings of 1994 9th IEEE International Symposium on Intelligent Control.

[9]  Wan Kyun Chung,et al.  General Algorithm for Automatic Generation of the Workspace for n-link Planar Redundant Manipulators , 1994 .

[10]  A. L. Barker,et al.  Bayesian Estimation and the Kalman Filter , 1994 .

[11]  Jean-Jacques E. Slotine,et al.  Experiments in Hand-Eye Coordination Using Active Vision , 1995, ISER.

[12]  S. Schaal,et al.  One-Handed Juggling: A Dynamical Approach to a Rhythmic Movement Task. , 1996, Journal of motor behavior.

[13]  Gregory S. Chirikjian,et al.  Numerical convolution on the Euclidean group with applications to workspace generation , 1998, IEEE Trans. Robotics Autom..

[14]  Clément Gosselin,et al.  Workspaces of Planar Parallel Manipulators , 1998 .

[15]  S. Schaal,et al.  Programmable Pattern Generators , 1998 .

[16]  Günter Schreiber,et al.  Off-the-shelf vision for a robotic ball catcher , 2001, Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180).

[17]  Steven M. Seitz,et al.  Computing the Physical Parameters of Rigid-Body Motion from Video , 2002, ECCV.

[18]  Gregory S. Chirikjian,et al.  A diffusion-based algorithm for workspace generation of highly articulated manipulators , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[19]  Christopher G. Atkeson,et al.  Robot Catching: Towards Engaging Human-Humanoid Interaction , 2002, Auton. Robots.

[20]  Dong-Soo Kwon,et al.  Mobile robots at your fingertip: Bezier curve on-line trajectory generation for supervisory control , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[21]  Masatoshi Ishikawa,et al.  Robotic catching using a direct mapping from visual information to motor command , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[22]  Satoshi Kagami,et al.  Efficient prioritized inverse kinematic solutions for redundant manipulators , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[23]  Kazuhito Yokoi,et al.  Reachable boundary of a humanoid robot with two feet fixed on the ground , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[24]  Kazuhito Yokoi,et al.  Reachable Space Generation of A Humanoid Robot Using The Monte Carlo Method , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[25]  Stefano Caselli,et al.  Robust trajectory learning and approximation for robot programming by demonstration , 2006, Robotics Auton. Syst..

[26]  Masatoshi Ishikawa,et al.  Ball control in high-speed batting motion using hybrid trajectory generator , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[27]  Gerd Hirzinger,et al.  Capturing robot workspace structure: representing robot capabilities , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[28]  Aude Billard,et al.  On Learning, Representing, and Generalizing a Task in a Humanoid Robot , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[29]  Siddhartha S. Srinivasa,et al.  BiSpace Planning: Concurrent Multi-Space Exploration , 2008, Robotics: Science and Systems.

[30]  Angelo Cangelosi,et al.  An open-source simulator for cognitive robotics research: the prototype of the iCub humanoid robot simulator , 2008, PerMIS.

[31]  A. Billard,et al.  Learning the Nonlinear Multivariate Dynamics of Motion of Robotic Manipulators , 2009 .

[32]  Franziska Zacharias,et al.  Object-Specific Grasp Maps for Use in Planning Manipulation Actions , 2009 .

[33]  ChangHwan Kim,et al.  Human-like catching motion of humanoid using Evolutionary Algorithm(EA)-based imitation learning , 2009, RO-MAN 2009 - The 18th IEEE International Symposium on Robot and Human Interactive Communication.

[34]  Christoph H. Lampert,et al.  Movement templates for learning of hitting and batting , 2010, 2010 IEEE International Conference on Robotics and Automation.

[35]  Aude Billard,et al.  Learning motion dynamics to catch a moving object , 2010, 2010 10th IEEE-RAS International Conference on Humanoid Robots.

[36]  A. Billard,et al.  Learning Stable Nonlinear Dynamical Systems With Gaussian Mixture Models , 2011, IEEE Transactions on Robotics.

[37]  Berthold Bäuml,et al.  Kinematically optimal catching a flying ball with a hand-arm-system , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[38]  Aude Billard,et al.  Learning Stable Nonlinear Dynamical Systems With Gaussian Mixture Models , 2011, IEEE Transactions on Robotics.

[39]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[40]  Aude Billard,et al.  Learning Non-linear Multivariate Dynamics of Motion in Robotic Manipulators , 2011, Int. J. Robotics Res..

[41]  Oliver Kroemer,et al.  Learning grasp affordance densities , 2011, Paladyn J. Behav. Robotics.

[42]  Gerd Hirzinger,et al.  Trajectory planning for optimal robot catching in real-time , 2011, 2011 IEEE International Conference on Robotics and Automation.

[43]  Aude Billard,et al.  Coupled dynamical system based arm-hand grasping model for learning fast adaptation strategies , 2012, Robotics Auton. Syst..

[44]  Aude Billard,et al.  Estimating the non-linear dynamics of free-flying objects , 2012, Robotics Auton. Syst..

[45]  Aude Billard,et al.  A dynamical system approach to realtime obstacle avoidance , 2012, Autonomous Robots.

[46]  Matthew Glisson,et al.  Playing catch and juggling with a humanoid robot , 2012, 2012 12th IEEE-RAS International Conference on Humanoid Robots (Humanoids 2012).

[47]  Moonhong Baeg,et al.  Development of a low cost anthropomorphic robot hand with high capability , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.