Walking to Grasp: Modeling of Human Movements as Invariants and an Application to Humanoid Robotics

Concurrent advancements in mechanical design and motion planning algorithms allow state-of-the-art humanoid robots to exhibit complex and realistic behavior. In face of this added complexity and the need for humanlike behavior, research has begun to look toward studies in human neuroscience to better organize and guide humanoid robot motion. In this paper, we present one such method of generating anthropomorphic motion by building the “invariants” of human movements and applying them as kinematic tasks. Whole-body motion of 14 healthy participants was recorded during a walking and grasping task. The recorded data were statistically analyzed to extract invariants which best described the observed motion. These invariants were expressed as a set of rules that were used to synthesize the stereotypy in human motion. We propose an algorithm that reproduces the key parameters of motion, taking into account the knowledge from human movement and the limitations of the target anthropomorph. The results are then generalized such that we can generate motion for targets which were not originally recorded. The algorithmic output is applied in a task-based prioritized inverse kinematics solver to generate dynamically stable and realistic anthropomorphic motion. We illustrate our results on the humanoid HRP-2 by making it walk to and grasp objects at various positions. Our approach complements classical optimization or motion-planning-based methods and provides interesting perspectives toward the use of human movements for deducing effective cost functions in optimization techniques or heuristics for planning algorithms.

[1]  F. J. McGuigan Experimental Psychology Methods of Research , 1983 .

[2]  Behzad Dariush,et al.  Online and markerless motion retargeting with kinematic constraints , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[3]  Claude Samson,et al.  Robot Control: The Task Function Approach , 1991 .

[4]  Dana Kulic,et al.  Online Segmentation and Clustering From Continuous Observation of Whole Body Motions , 2009, IEEE Transactions on Robotics.

[5]  Shuuji Kajita,et al.  Toward human-like walking pattern generator , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[6]  H. Hicheur,et al.  Head motion in humans alternating between straight and curved walking path: Combination of stabilizing and anticipatory orienting mechanisms , 2005, Neuroscience Letters.

[7]  A. E. Patla,et al.  Online steering: coordination and control of body center of mass, head and body reorientation , 1999, Experimental Brain Research.

[8]  Philippe Souères,et al.  Dynamical sequence of multi-sensor based tasks for mobile robots navigation , 2003 .

[9]  Katsu Yamane,et al.  Capture Database through Symbolization, Recognition and Generation of Motion Patterns , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[10]  Florent Lamiraux,et al.  Reactive path deformation for nonholonomic mobile robots , 2004, IEEE Transactions on Robotics.

[11]  Jean-Claude Latombe,et al.  Robot motion planning , 1970, The Kluwer international series in engineering and computer science.

[12]  A. Berthoz,et al.  Reaching beyond reach , 1999, Experimental Brain Research.

[13]  Olivier Stasse,et al.  Fast foot prints re-planning and motion generation during walking in physical human-humanoid interaction , 2009, 2009 9th IEEE-RAS International Conference on Humanoid Robots.

[14]  Masayuki Inaba,et al.  Footstep planning among obstacles for biped robots , 2001, Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180).

[15]  N. Coffey,et al.  Common functional principal components analysis: a new approach to analyzing human movement data. , 2011, Human movement science.

[16]  Dana Kulic,et al.  Incremental learning of human behaviors using hierarchical hidden Markov models , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[17]  Jessica K. Hodgins,et al.  Interactive control of avatars animated with human motion data , 2002, SIGGRAPH.

[18]  N. A. Bernshteĭn The co-ordination and regulation of movements , 1967 .

[19]  Olivier Stasse,et al.  Visually-Guided Grasping while Walking on a Humanoid Robot , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[20]  B. Cohen,et al.  Interaction of the body, head, and eyes during walking and turning , 2000, Experimental Brain Research.

[21]  John E. R. Staddon,et al.  Optima for animals , 1982 .

[22]  Marc O. Ernst,et al.  Walking along curved paths of different angles: the relationship between head and trunk turning , 2008, Experimental Brain Research.

[23]  Steven M. LaValle,et al.  Planning algorithms , 2006 .

[24]  Jean-Jacques E. Slotine,et al.  A general framework for managing multiple tasks in highly redundant robotic systems , 1991, Fifth International Conference on Advanced Robotics 'Robots in Unstructured Environments.

[25]  James Park,et al.  The Brain's Sense of Movement , 2003, The Yale Journal of Biology and Medicine.

[26]  N Sekiya,et al.  The invariant relationship between step length and step rate during free walking , 1996 .

[27]  Shuuji Kajita,et al.  A Biped Pattern Generation Allowing Immediate Modification of Foot Placement in Real-time , 2006, 2006 6th IEEE-RAS International Conference on Humanoid Robots.

[28]  J. Laumond,et al.  The formation of trajectories during goal‐oriented locomotion in humans. I. A stereotyped behaviour , 2007, The European journal of neuroscience.

[29]  Olivier Stasse,et al.  “Give me the purple ball” - he said to HRP-2 N.14 , 2007, 2007 7th IEEE-RAS International Conference on Humanoid Robots.

[30]  Pascal Prévost,et al.  Spatial invariance in anticipatory orienting behaviour during human navigation , 2003, Neuroscience Letters.

[31]  Jean-Paul Laumond,et al.  A motion capture‐based control‐space approach for walking mannequins , 2006, Comput. Animat. Virtual Worlds.

[32]  Daniel Thalmann,et al.  A global human walking model with real-time kinematic personification , 1990, The Visual Computer.

[33]  M. A. Arbib,et al.  Models of Trajectory Formation and Temporal Interaction of Reach and Grasp. , 1993, Journal of motor behavior.

[34]  François Keith,et al.  Generation of dynamic motion for anthropomorphic systems under prioritized equality and inequality constraints , 2011, 2011 IEEE International Conference on Robotics and Automation.

[35]  Jean-Paul Laumond,et al.  From human to humanoid locomotion—an inverse optimal control approach , 2010, Auton. Robots.

[36]  Eiichi Yoshida,et al.  Planning foot placements for a humanoid robot: A problem of inverse kinematics , 2011, Int. J. Robotics Res..

[37]  Jean-Paul Laumond,et al.  Robot Motion Planning and Control , 1998 .

[38]  T. Flash,et al.  The coordination of arm movements: an experimentally confirmed mathematical model , 1985, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[39]  Miomir Vukobratović,et al.  Biped Locomotion: Dynamics, Stability, Control and Application , 1990 .

[40]  Jean-Paul Laumond,et al.  Steering a humanoid robot by its head , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[41]  R. Johansson,et al.  Eye–Hand Coordination in Object Manipulation , 2001, The Journal of Neuroscience.

[42]  Yoshihiko Nakamura,et al.  Advanced robotics - redundancy and optimization , 1990 .

[43]  Oussama Khatib,et al.  Whole-Body Dynamic Behavior and Control of Human-like Robots , 2004, Int. J. Humanoid Robotics.

[44]  Howie Choset,et al.  Principles of Robot Motion: Theory, Algorithms, and Implementation ERRATA!!!! 1 , 2007 .

[45]  Behzad Dariush,et al.  Whole body humanoid control from human motion descriptors , 2008, 2008 IEEE International Conference on Robotics and Automation.

[46]  S. LaValle,et al.  Randomized Kinodynamic Planning , 2001 .

[47]  A. Liegeois,et al.  Automatic supervisory control of the configuration and behavior of multi-body mechanisms , 1977 .

[48]  Jean-Paul Laumond,et al.  On Real-time Whole-body Human to Humanoid Motion Transfer , 2010, ICINCO.

[49]  Jean-Paul Laumond,et al.  On the nonholonomic nature of human locomotion , 2008, Auton. Robots.

[50]  Kazuhito Yokoi,et al.  Biped walking pattern generation by using preview control of zero-moment point , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).