Incremental Learning of Full Body Motion Primitives

This paper describes an approach for autonomous and incremental learning of motion pattern primitives by observation of human motion. Human motion patterns are abstracted into a dynamic stochastic model, which can be used for both subsequent motion recognition and generation. As new motion patterns are observed, they are incrementally grouped together using local clustering based on their relative distance in the model space. The clustering algorithm forms a tree structure, with specialized motions at the tree leaves, and generalized motions closer to the root. The generated tree structure will depend on the type of training data provided, so that the most specialized motions will be those for which the most training has been received. A complete system for online acquisition and visualization of motion primitives from continuous observation of human motion will also be described, allowing interactive training.

[1]  Kevin P. Murphy,et al.  Bayesian Map Learning in Dynamic Environments , 1999, NIPS.

[2]  Robert A. Jacobs,et al.  Factorial Hidden Markov Models and the Generalized Backfitting Algorithm , 2002, Neural Computation.

[3]  Dana Kulic,et al.  Incremental on-line hierarchical clustering of whole body motion patterns , 2007, RO-MAN 2007 - The 16th IEEE International Symposium on Robot and Human Interactive Communication.

[4]  Katsu Yamane,et al.  Mimetic Communication Theory for Humanoid Robots Interacting with Humans , 2005, ISRR.

[5]  Maja J. Mataric,et al.  A spatio-temporal extension to Isomap nonlinear dimension reduction , 2004, ICML.

[6]  Yoshihiko Nakamura,et al.  Incremental Learning and Memory Consolidation of Whole Body Motion Patterns , 2008 .

[7]  Yoshihiko Nakamura,et al.  Acquisition and embodiment of motion elements in closed mimesis loop , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[8]  Yoshihiko Nakamura,et al.  Dimensionality reduction and reproduction with hierarchical NLPCA neural networks - extracting common space of multiple humanoid motion patterns , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[9]  Yoshihiko Nakamura,et al.  Embodied Symbol Emergence Based on Mimesis Theory , 2004, Int. J. Robotics Res..

[10]  Michael I. Jordan,et al.  Factorial Hidden Markov Models , 1995, Machine Learning.

[11]  Yoshihiko Nakamura,et al.  A Statistic Model of Embodied Symbol Emergence , 2003, ISRR.

[12]  S. Furui,et al.  FHMM for Robust Speech Recognition in Home Environment , 2006 .

[13]  Dana Kulic,et al.  Incremental Learning, Clustering and Hierarchy Formation of Whole Body Motion Patterns using Adaptive Hidden Markov Chains , 2008, Int. J. Robotics Res..

[14]  Dana Kulic,et al.  Online acquisition and visualization of motion primitives for humanoid robots , 2009, RO-MAN 2009 - The 18th IEEE International Symposium on Robot and Human Interactive Communication.

[15]  Dana Kulic,et al.  Scaffolding on-line segmentation of full body human motion patterns , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[16]  Wataru Takano,et al.  Incremental learning of full body motions via adaptive Factorial Hidden Markov Models , 2007 .

[17]  Yangsheng Xu,et al.  Human action learning via hidden Markov model , 1997, IEEE Trans. Syst. Man Cybern. Part A.

[18]  Thad Starner,et al.  Visual Recognition of American Sign Language Using Hidden Markov Models. , 1995 .

[19]  Yoshihiko Nakamura,et al.  Mimesis from partial observations , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[20]  C. Breazeal,et al.  Robots that imitate humans , 2002, Trends in Cognitive Sciences.

[21]  Marc Toussaint,et al.  Modelling motion primitives and their timing in biologically executed movements , 2007, NIPS.

[22]  Anil K. Jain,et al.  Data clustering: a review , 1999, CSUR.

[23]  Estela Bicho,et al.  Goal-directed imitation for robots: A bio-inspired approach to action understanding and skill learning , 2006, Robotics Auton. Syst..

[24]  Y. Nakamura,et al.  Unsupervised probabilistic segmentation of motion data for mimesis modeling , 2005, ICAR '05. Proceedings., 12th International Conference on Advanced Robotics, 2005..

[25]  Y. Nakamura,et al.  Symbolic memory for humanoid robots using hierarchical bifurcations of attractors in nonmonotonic neural networks , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[26]  Christopher W. Geib,et al.  The meaning of action: a review on action recognition and mapping , 2007, Adv. Robotics.

[27]  M. Matarić,et al.  Task Learning Through Imitation and Human-Robot Interaction , 2004 .

[28]  Katsu Yamane,et al.  Natural Motion Animation through Constraining and Deconstraining at Will , 2003, IEEE Trans. Vis. Comput. Graph..

[29]  Monica N. Nicolescu,et al.  Task Learning through Imitation and Human-robot Interaction , 2005 .

[30]  José Santos-Victor,et al.  Abstraction Levels for Robotic Imitation: Overview and Computational Approaches , 2010, From Motor Learning to Interaction Learning in Robots.

[31]  Christiaan J. J. Paredis,et al.  Interactive multi-modal robot programming , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[32]  Dana Kulic,et al.  Incremental learning of full body motion primitives for humanoid robots , 2008, Humanoids 2008 - 8th IEEE-RAS International Conference on Humanoid Robots.

[33]  Yoshihiko Nakamura,et al.  Polynomial design of the nonlinear dynamics for the brain-like information processing of whole body motion , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[34]  Steven Lemm,et al.  A Dynamic HMM for On-line Segmentation of Sequential Data , 2001, NIPS.

[35]  Maja J. Mataric,et al.  Performance-Derived Behavior Vocabularies: Data-Driven Acquisition of Skills from Motion , 2004, Int. J. Humanoid Robotics.

[36]  Pradeep K. Khosla,et al.  Predictive Robot Programming: Theoretical and Experimental Analysis , 2004, Int. J. Robotics Res..

[37]  Gordon Cheng,et al.  Learning Similar Tasks From Observation and Practice , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[38]  Rüdiger Dillmann,et al.  Learning Robot Behaviour and Skills Based on Human Demonstration and Advice: The Machine Learning Paradigm , 2000 .

[39]  Danica Kragic,et al.  Online task recognition and real-time adaptive assistance for computer-aided machine control , 2006, IEEE Transactions on Robotics.

[40]  Rajesh P. N. Rao,et al.  Learning to Imitate Human Actions through Eigenposes , 2010, From Motor Learning to Interaction Learning in Robots.

[41]  H. Harry Asada,et al.  Transferring Manipulative Skills to Robots-Representation and Acquisition of Tool Manipulative Skill , 1992 .

[42]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[43]  Andrew Y. Ng,et al.  Pharmacokinetics of a novel formulation of ivermectin after administration to goats , 2000, ICML.

[44]  Dana Kulic,et al.  Representability of human motions by factorial hidden Markov models , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[45]  Pieter Abbeel,et al.  Apprenticeship learning via inverse reinforcement learning , 2004, ICML.

[46]  Rüdiger Dillmann,et al.  Teaching and learning of robot tasks via observation of human performance , 2004, Robotics Auton. Syst..

[47]  David Silver,et al.  Learning to search: Functional gradient techniques for imitation learning , 2009, Auton. Robots.

[48]  Gregory D. Hager,et al.  Human-Machine Collaborative Systems for Microsurgical Applications , 2005, Int. J. Robotics Res..

[49]  Wolfram Burgard,et al.  Learning Motion Patterns of People for Compliant Robot Motion , 2005, Int. J. Robotics Res..

[50]  Stefan Schaal,et al.  Computational approaches to motor learning by imitation. , 2003, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[51]  Yoshihiko Nakamura,et al.  Humanoid Robot's Autonomous Acquisition of Proto-Symbols through Motion Segmentation , 2006, 2006 6th IEEE-RAS International Conference on Humanoid Robots.

[52]  高野 渉.  Stochastic segmentation, proto-symbol coding and clustering of motion patterns and their application to signifiant communication between man and humanoid robot , 2006 .

[53]  Yoshihiko Nakamura,et al.  Imitation and primitive symbol acquisition of humanoids by the integrated mimesis loop , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[54]  Christiaan J. J. Paredis,et al.  Interactive Multimodal Robot Programming , 2005, Int. J. Robotics Res..

[55]  Andrea Lockerd Thomaz,et al.  Tutelage and socially guided robot learning , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[56]  D. Perrett,et al.  Opinion TRENDS in Cognitive Sciences Vol.8 No.11 November 2004 Demystifying social cognition: a Hebbian perspective , 2022 .

[57]  Yoji Yamada,et al.  An adaptive visual attentive tracker for human communicational behaviors using HMM-based TD learning with new State distinction capability , 2005, IEEE Transactions on Robotics.

[58]  Yoshihiko Nakamura,et al.  Mimesis Scheme using a Monocular Vision System on a Humanoid Robot , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[59]  Olivier Sigaud,et al.  From Motor Learning to Interaction Learning in Robots , 2010, From Motor Learning to Interaction Learning in Robots.

[60]  Masayuki Inaba,et al.  Learning by watching: extracting reusable task knowledge from visual observation of human performance , 1994, IEEE Trans. Robotics Autom..

[61]  Shigeki Sugano,et al.  Open-End Human Robot Interaction from the Dynamical Systems Perspective: Mutual Adaptation and Incremental Learning , 2004, International Conference on Industrial, Engineering and Other Applications of Applied Intelligent Systems.

[62]  Peter Ford Dominey,et al.  Anticipation and initiative in human-humanoid interaction , 2008, Humanoids 2008 - 8th IEEE-RAS International Conference on Humanoid Robots.

[63]  Katsushi Ikeuchi,et al.  A sensor fusion approach for recognizing continuous human grasping sequences using hidden Markov models , 2005, IEEE Transactions on Robotics.

[64]  Stefan Schaal,et al.  2008 Special Issue: Reinforcement learning of motor skills with policy gradients , 2008 .

[65]  Aude Billard,et al.  Discriminative and adaptive imitation in uni-manual and bi-manual tasks , 2006, Robotics Auton. Syst..

[66]  Jun Morimoto,et al.  Learning from demonstration and adaptation of biped locomotion , 2004, Robotics Auton. Syst..