Automated Derivation of Primitives for Movement Classification

We describe a new method for representing human movement compactly, in terms of a linear super-imposition of simpler movements termed primitives. This method is a part of a larger research project aimed at modeling motor control and imitation using the notion of perceptuo-motor primitives, a basis set of coupled perceptual and motor routines. In our model, the perceptual system is biased by the set of motor behaviors the agent can execute. Thus, an agent can automatically classify observed movements into its executable repertoire. In this paper, we describe a method for automatically deriving a set of primitives directly from human movement data.We used movement data gathered from a psychophysical experiment on human imitation to derive the primitives. The data were first filtered, then segmented, and principal component analysis was applied to the segments. The eigenvectors corresponding to a few of the highest eigenvalues provide us with a basis set of primitives. These are used, through superposition and sequencing, to reconstruct the training movements as well as novel ones. The validation of the method was performed on a humanoid simulation with physical dynamics. The effectiveness of the motion reconstruction was measured through an error metric. We also explored and evaluated a technique of clustering in the space of primitives for generating controllers for executing frequently used movements.

[1]  C. L. M. The Psychology of Attention , 1890, Nature.

[2]  J. William Ahwood,et al.  CLASSIFICATION , 1931, Foundations of Familiar Language.

[3]  E. Kreighbaum,et al.  Biomechanics: A Qualitative Approach for Studying Human Movement , 1981 .

[4]  P. Viviani,et al.  Trajectory determines movement dynamics , 1982, Neuroscience.

[5]  N. Hogan An organizing principle for a class of voluntary movements , 1984, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[6]  Neville Hogan,et al.  Impedance Control: An Approach to Manipulation , 1984, 1984 American Control Conference.

[7]  T. Flash,et al.  The coordination of arm movements: an experimentally confirmed mathematical model , 1985, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[8]  Ronald C. Arkin,et al.  Motor schema based navigation for a mobile robot: An approach to programming by behavior , 1987, Proceedings. 1987 IEEE International Conference on Robotics and Automation.

[9]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[10]  S. Easter,et al.  Axonogenesis and morphogenesis in the embryonic zebrafish brain , 1992, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[11]  F. A. Mussa-lvaldi,et al.  Convergent force fields organized in the frog's spinal cord , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[12]  Maja J. Matarić,et al.  Learning Motor Skills by Imitation , 1994, AAAI 1994.

[13]  Emilio Bizzi,et al.  Modular organization of motor behavior in the frog's spinal cord , 1995, Trends in Neurosciences.

[14]  P. Katz Neurons, Networks, and Motor Behavior , 1996, Neuron.

[15]  G. Gottlieb,et al.  Coordinating movement at two joints: a principle of linear covariance. , 1996, Journal of neurophysiology.

[16]  Matthew Brand,et al.  Understanding manipulation in video , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[17]  Alex Pentland,et al.  Coupled hidden Markov models for complex action recognition , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[18]  Benjamin Kuipers,et al.  Map Learning with Uninterpreted Sensors and Effectors , 1995, Artif. Intell..

[19]  Ferdinando A. Mussa-Ivaldi,et al.  Nonlinear force fields: a distributed system of control primitives for representing and learning movements , 1997, Proceedings 1997 IEEE International Symposium on Computational Intelligence in Robotics and Automation CIRA'97. 'Towards New Computational Principles for Robotics and Automation'.

[20]  Maja J. Matari,et al.  Behavior-based Control: Examples from Navigation, Learning, and Group Behavior , 1997 .

[21]  Maja J. Mataric,et al.  Behaviour-based control: examples from navigation, learning, and group behaviour , 1997, J. Exp. Theor. Artif. Intell..

[22]  Ronald C. Arkin,et al.  An Behavior-based Robotics , 1998 .

[23]  S. Schaal,et al.  Programmable Pattern Generators , 1998 .

[24]  Maja J. Mataric,et al.  Movement control methods for complex, dynamically simulated agents: Adonis dances the Macarena , 1998, AGENTS '98.

[25]  J. Mazziotta,et al.  Cortical mechanisms of human imitation. , 1999, Science.

[26]  Maja J. Matarić,et al.  Making Complex Articulated Agents Dance - An analysis of control methods drawn from robotics, animat , 1999 .

[27]  Perry Y. Li,et al.  Passive velocity field control of mechanical manipulators , 1995, IEEE Trans. Robotics Autom..

[28]  Stefan Schaal,et al.  Is imitation learning the route to humanoid robots? , 1999, Trends in Cognitive Sciences.

[29]  Fredrik Rehnmark,et al.  Robonaut: NASA's Space Humanoid , 2000, IEEE Intell. Syst..

[30]  Reza Shadmehr,et al.  Learning of action through adaptive combination of motor primitives , 2000, Nature.

[31]  T D Sanger,et al.  Human Arm Movements Described by a Low-Dimensional Superposition of Principal Components , 2000, The Journal of Neuroscience.

[32]  M. Matarić,et al.  Evaluation Metrics and Results of Human Arm Movement Imitation , 2000 .

[33]  Maja J. Matarić,et al.  Visuo-Motor Primitives as a Basis for Learning by Imitation , 2000 .

[34]  H. Pashler,et al.  The Psychology of Attention , 2000 .

[35]  Maja J. Mataric,et al.  Getting Humanoids to Move and Imitate , 2000, IEEE Intell. Syst..

[36]  Hirochika Inoue,et al.  HRP: Humanoid Robotics Project of MITI , 2000 .

[37]  Maja J. Matarić,et al.  Primitive-Based Movement Classification for Humanoid Imitation , 2000 .

[38]  Aude Billard,et al.  A biologically inspired robotic model for learning by imitation , 2000, AGENTS '00.

[39]  Maja J. Matarić,et al.  Sensory-motor primitives as a basis for imitation: linking perception to action and biology to robotics , 2002 .

[40]  Chrystopher L. Nehaniv,et al.  Sensory-Motor Primitives as a Basis for Imitation: Linking Perception to Action and Biology to Robotics , 2002 .

[41]  Keiichiro Hoashi,et al.  Humanoid Robots in Waseda University—Hadaly-2 and WABIAN , 2002, Auton. Robots.

[42]  M. Kawato,et al.  Formation and control of optimal trajectory in human multijoint arm movement , 1989, Biological Cybernetics.

[43]  Yasuharu Koike,et al.  A computational theory for movement pattern recognition based on optimal movement pattern generation , 1995, Biological Cybernetics.

[44]  Maja J. Mataric,et al.  Making Complex Articulated Agents Dance , 1999, Autonomous Agents and Multi-Agent Systems.