Rapid and reactive robot control framework for catching objects in flight

Keywords: Robot Catching ; Imitation Learning ; Reachable-space ; Graspable-space These Ecole polytechnique federale de Lausanne EPFL, n° 6094 (2014)Programme doctoral Systemes de production et RobotiqueFaculte des sciences et techniques de l'ingenieurInstitut de microtechniqueLaboratoire d'algorithmes et systemes d'apprentissageJury: Prof. H. Bleuler (president); Prof. A. Billard (directrice); Prof. A. Ijspeert, Prof. C. Jenkins, Prof. J. Steil (rapporteurs) Public defense: 2014-2-13 Reference doi:10.5075/epfl-thesis-6094Print copy in library catalog Record created on 2014-02-05, modified on 2017-05-10

[1]  R. L. Valois,et al.  Vernier acuity with stationary moving Gabors , 1991, Vision Research.

[2]  Hong Zhang.  Efficient evaluation of the feasibility of robot displacement trajectories , 1993, IEEE Trans. Syst. Man Cybern..

[3]  Daniel E. Koditschek,et al.  Planning and Control of Robotic Juggling and Catching Tasks , 1994, Int. J. Robotics Res..

[4]  Yoshihiko Nakamura,et al.  Acquiring Motion Elements for Bidirectional Computation of Motion Recognition and Generation , 2002, ISER.

[5]  Stefan Schaal,et al.  A Library for Locally Weighted Projection Regression , 2008, J. Mach. Learn. Res..

[6]  Benjamin Schrauwen,et al.  Supervised learning of internal models for autonomous goal-oriented robot navigation using Reservoir Computing , 2010, 2010 IEEE International Conference on Robotics and Automation.

[7]  A. Billard,et al.  Learning Stable Nonlinear Dynamical Systems With Gaussian Mixture Models , 2011, IEEE Transactions on Robotics.

[8]  Thomas B. Schön,et al.  System identification of nonlinear state-space models , 2011, Autom..

[9]  Andrew Blake,et al.  Learning dynamical models using expectation-maximisation , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[10]  F. Lacquaniti,et al.  Internal models of target motion: expected dynamics overrides measured kinematics in timing manual interceptions. , 2004, Journal of neurophysiology.

[11]  Jean-Jacques E. Slotine,et al.  Experiments in Hand-Eye Coordination Using Active Vision , 1995, ISER.

[12]  Gilles Montagne,et al.  Reorganization of catching coordination under varying temporal constraints. , 2006, Motor control.

[13]  Matei T. Ciocarlie,et al.  Hand Posture Subspaces for Dexterous Robotic Grasping , 2009, Int. J. Robotics Res..

[14]  ChangHwan Kim,et al.  Adaptation of human motion capture data to humanoid robots for motion imitation using optimization , 2006, Integr. Comput. Aided Eng..

[15]  David Finkleman,et al.  A critical assessment of satellite drag and atmospheric density modeling , 2008 .

[16]  A. L. Barker,et al.  Bayesian Estimation and the Kalman Filter , 1994 .

[17]  Peter K. Allen,et al.  An SVM learning approach to robotic grasping , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[18]  Aude Billard,et al.  Learning motion dynamics to catch a moving object , 2010, 2010 10th IEEE-RAS International Conference on Humanoid Robots.

[19]  T. Yoshikawa,et al.  Task-Priority Based Redundancy Control of Robot Manipulators , 1987 .

[20]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[21]  J. F. Soechting,et al.  Predicting curvilinear target motion through an occlusion , 2007, Experimental Brain Research.

[22]  Geir Hovland,et al.  Skill acquisition from human demonstration using a hidden Markov model , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[23]  ChangHwan Kim,et al.  Stable whole-body motion generation for humanoid robots to imitate human motions , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[24]  Stefano Caselli,et al.  Robust trajectory learning and approximation for robot programming by demonstration , 2006, Robotics Auton. Syst..

[25]  Clément Gosselin,et al.  Workspaces of Planar Parallel Manipulators , 1998 .

[26]  Kazuhito Yokoi,et al.  Reachable Space Generation of A Humanoid Robot Using The Monte Carlo Method , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[27]  Dinesh K. Pai,et al.  Eyecatch: simulating visuomotor coordination for object interception , 2012, ACM Trans. Graph..

[28]  Stefano Chiaverini,et al.  Singularity-robust task-priority redundancy resolution for real-time kinematic control of robot manipulators , 1997, IEEE Trans. Robotics Autom..

[29]  Bassam Bamieh,et al.  Identification of linear parameter varying models , 2002 .

[30]  Miomir Vukobratovic,et al.  Zero-Moment Point - Thirty Five Years of its Life , 2004, Int. J. Humanoid Robotics.

[31]  Erik D. Goodman,et al.  Genetic Programming-Based Automatic Gait Generation in Joint Space for a Quadruped Robot , 2010, Adv. Robotics.

[32]  Aude Billard,et al.  Coupled dynamical system based arm-hand grasping model for learning fast adaptation strategies , 2012, Robotics Auton. Syst..

[33]  Dana Kulic,et al.  Incremental Learning, Clustering and Hierarchy Formation of Whole Body Motion Patterns using Adaptive Hidden Markov Chains , 2008, Int. J. Robotics Res..

[34]  Christopher G. Atkeson,et al.  Adapting human motion for the control of a humanoid robot , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[35]  Peter K. Allen,et al.  Data-driven grasping , 2011, Auton. Robots.

[36]  Aude Billard,et al.  Learning Non-linear Multivariate Dynamics of Motion in Robotic Manipulators , 2011, Int. J. Robotics Res..

[37]  Andrew Blake,et al.  Learning Dynamics of Complex Motions from Image Sequences , 1996, ECCV.

[38]  Stefan Schaal,et al.  Incremental Online Learning in High Dimensions , 2005, Neural Computation.

[39]  S. Schaal,et al.  Programmable Pattern Generators , 1998 .

[40]  Bruno Siciliano,et al.  Review of the damped least-squares inverse kinematics with experiments on an industrial robot manipulator , 1994, IEEE Trans. Control. Syst. Technol..

[41]  J. F. Soechting,et al.  Sensorimotor representations for pointing to targets in three-dimensional space. , 1989, Journal of neurophysiology.

[42]  Seville Chapman.  Catching a Baseball , 1968 .

[43]  Jan Peters,et al.  Using model knowledge for learning inverse dynamics , 2010, 2010 IEEE International Conference on Robotics and Automation.

[44]  Steven M. Seitz,et al.  Computing the Physical Parameters of Rigid-Body Motion from Video , 2002, ECCV.

[45]  Herbert Jaeger,et al.  Optimization and applications of echo state networks with leaky- integrator neurons , 2007, Neural Networks.

[46]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[47]  Aude Billard,et al.  Learning Stable Nonlinear Dynamical Systems With Gaussian Mixture Models , 2011, IEEE Transactions on Robotics.

[48]  Thorsten Joachims,et al.  Learning to classify text using support vector machines - methods, theory and algorithms , 2002, The Kluwer international series in engineering and computer science.

[49]  Ian Jenkinson,et al.  Application of genetic programming to the calibration of industrial robots , 2007, Comput. Ind..

[50]  Franziska Zacharias,et al.  Object-Specific Grasp Maps for Use in Planning Manipulation Actions , 2009 .

[51]  A. Liegeois,et al.  Automatic supervisory control of the configuration and behavior of multi-body mechanisms , 1977 .

[52]  Dong-Soo Kwon,et al.  Mobile robots at your fingertip: Bezier curve on-line trajectory generation for supervisory control , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[53]  F. Lacquaniti,et al.  Representation of Visual Gravitational Motion in the Human Vestibular Cortex , 2005, Science.

[54]  Stefan Schaal,et al.  Locally Weighted Projection Regression : An O(n) Algorithm for Incremental Real Time Learning in High Dimensional Space , 2000 .

[55]  Kazuhito Yokoi,et al.  Reachable boundary of a humanoid robot with two feet fixed on the ground , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[56]  E. Brenner,et al.  Fast Responses of the Human Hand to Changes in Target Position. , 1997, Journal of motor behavior.

[57]  S. Schaal,et al.  One-Handed Juggling: A Dynamical Approach to a Rhythmic Movement Task. , 1996, Journal of motor behavior.

[58]  H. Akaike,et al.  Information Theory and an Extension of the Maximum Likelihood Principle , 1973 .

[59]  G. Schwarz.  Estimating the Dimension of a Model , 1978 .

[60]  Kostas J. Kyriakopoulos,et al.  Minimum jerk path generation , 1988, Proceedings. 1988 IEEE International Conference on Robotics and Automation.

[61]  Lawton H. Lee,et al.  Identification of Linear Parameter-Varying Systems Using Nonlinear Programming , 1999 .

[62]  Joan López-Moliner,et al.  Determining whether a ball will land behind or in front of you: Not just a combination of expansion and angular velocity , 2006, Vision Research.

[63]  R. Ravikanth,et al.  Identification of linear parametrically varying systems , 1995, Proceedings of 1995 34th IEEE Conference on Decision and Control.

[64]  Youngjin Choi,et al.  Posture/Walking Control for Humanoid Robot Based on Kinematic Resolution of CoM Jacobian With Embedded Motion , 2007, IEEE Transactions on Robotics.

[65]  Gregory S. Chirikjian,et al.  Numerical convolution on the Euclidean group with applications to workspace generation , 1998, IEEE Trans. Robotics Autom..

[66]  Thomas Yunck,et al.  GPS-Based Satellite Tracking System for Precise Positioning , 1985, IEEE Transactions on Geoscience and Remote Sensing.

[67]  Dominic P. Searson,et al.  GPTIPS: An Open Source Genetic Programming Toolbox For Multigene Symbolic Regression , 2010 .

[68]  Masatoshi Ishikawa,et al.  Ball control in high-speed batting motion using hybrid trajectory generator , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[69]  Matthew Glisson,et al.  Playing catch and juggling with a humanoid robot , 2012, 2012 12th IEEE-RAS International Conference on Humanoid Robots (Humanoids 2012).

[70]  Oliver Montenbruck,et al.  Reduced dynamic orbit determination using GPS code and carrier measurements , 2005 .

[71]  Masatoshi Ishikawa,et al.  Dynamic regrasping using a high-speed multifingered hand and a high-speed vision system , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[72]  Gregory S. Chirikjian,et al.  A diffusion-based algorithm for workspace generation of highly articulated manipulators , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[73]  J. F. Soechting,et al.  Errors in pointing are due to approximations in sensorimotor transformations. , 1989, Journal of neurophysiology.

[74]  Satoshi Kagami,et al.  Efficient prioritized inverse kinematic solutions for redundant manipulators , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[75]  Rajiv V. Dubey,et al.  A weighted least-norm solution based scheme for avoiding joint limits for redundant joint manipulators , 1993, IEEE Trans. Robotics Autom..

[76]  Serdar Iplikci,et al.  Support Vector Machines Based Generalized Predictive Control of Chaotic Systems , 2006, IEICE Trans. Fundam. Electron. Commun. Comput. Sci..

[77]  Francesco Lacquaniti,et al.  Internal model of gravity for hand interception: parametric adaptation to zero-gravity visual targets on Earth. , 2005, Journal of neurophysiology.

[78]  Michael Isard,et al.  Learning and Classification of Complex Dynamics , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[79]  Masatoshi Ishikawa,et al.  Robotic Catching Using a Direct Mapping from Visual Information to Motor Command , 2003 .

[80]  Daniel E. Whitney,et al.  Resolved Motion Rate Control of Manipulators and Human Prostheses , 1969 .

[81]  Angelo Cangelosi,et al.  An open-source simulator for cognitive robotics research: the prototype of the iCub humanoid robot simulator , 2008, PerMIS.

[82]  Geoffrey J. McLachlan,et al.  Finite Mixture Models , 2019, Annual Review of Statistics and Its Application.

[83]  P. McLeod,et al.  The generalized optic acceleration cancellation theory of catching. , 2006, Journal of experimental psychology. Human perception and performance.

[84]  F. Sansò,et al.  First GOCE gravity field models derived by three different approaches , 2011 .

[85]  Vladimir Pavlovic,et al.  Time-series classification using mixed-state dynamic Bayesian networks , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[86]  Jun Nakanishi,et al.  Trajectory formation for imitation with nonlinear dynamical systems , 2001, Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180).

[87]  Oliver Kroemer,et al.  Learning grasp affordance densities , 2011, Paladyn J. Behav. Robotics.

[88]  D. E. Whitney,et al.  The mathematics of coordinated control of prosthetic arms and manipulators. , 1972 .

[89]  Oliver Brock,et al.  BiSpace Planning: Concurrent Multi-Space Exploration , 2009 .

[90]  Gerd Hirzinger,et al.  Capturing robot workspace structure: representing robot capabilities , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[91]  F. C. Bakker,et al.  The effects of baseball experience on movement initiation in catching fly balls. , 1997, Journal of sports sciences.

[92]  Youngil Youm,et al.  General algorithm for automatic generation of the workspace for n-link redundant manipulators , 1991, Fifth International Conference on Advanced Robotics 'Robots in Unstructured Environments.

[93]  Felix R. Hoots,et al.  An analytic satellite theory using gravity and a dynamic atmosphere , 1987 .

[94]  Paul Zarchan,et al.  Fundamentals of Kalman Filtering: A Practical Approach , 2001 .

[95]  Daniel H. Grollman,et al.  Dogged Learning for Robots , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[96]  Yoshihiko Nakamura,et al.  Advanced robotics - redundancy and optimization , 1990 .

[97]  Tamim Asfour,et al.  Human-like motion of a humanoid robot arm based on a closed-form solution of the inverse kinematics problem , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[98]  Aude Billard,et al.  Statistical Learning by Imitation of Competing Constraints in Joint Space and Task Space , 2009, Adv. Robotics.

[99]  Günter Schreiber,et al.  Off-the-shelf vision for a robotic ball catcher , 2001, Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180).

[100]  Aude Billard,et al.  A dynamical system approach to realtime obstacle avoidance , 2012, Autonomous Robots.

[101]  O. V. Stryk,et al.  Optimal control of the industrial robot Manutec r3 , 1994 .

[102]  ChangHwan Kim,et al.  Human-like Arm Motion Generation for Humanoid Robots Using Motion Capture Database , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[103]  Kumpati S. Narendra,et al.  Identification and control of dynamical systems using neural networks , 1990, IEEE Trans. Neural Networks.

[104]  Danica Kragic,et al.  Data-Driven Grasp Synthesis—A Survey , 2013, IEEE Transactions on Robotics.

[105]  B. Abernethy,et al.  The relationship between expertise and visual search strategy in a racquet sport , 1987 .

[106]  M. Buehler,et al.  Sensor-based online trajectory generation for smoothly grasping moving objects , 1994, Proceedings of 1994 9th IEEE International Symposium on Intelligent Control.

[107]  Francesco Lacquaniti,et al.  Catching a Ball at the Right Time and Place: Individual Factors Matter , 2012, PloS one.

[108]  Jan Peters,et al.  Model Learning with Local Gaussian Process Regression , 2009, Adv. Robotics.

[109]  Martin Faint,et al.  Does the brain model newton’s laws? , 2001 .

[110]  Christopher G. Atkeson,et al.  Robot Catching: Towards Engaging Human-Humanoid Interaction , 2002, Auton. Robots.

[111]  Berthold Bäuml,et al.  Kinematically optimal catching a flying ball with a hand-arm-system , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[112]  Pascal Willis,et al.  First assessment of GPS-based reduced dynamic orbit determination on TOPEX/Poseidon , 1994 .

[113]  Herbert Jaeger,et al.  Adaptive Nonlinear System Identification with Echo State Networks , 2002, NIPS.

[114]  Duy Nguyen-Tuong,et al.  Computed torque control with nonparametric regression models , 2008, 2008 American Control Conference.