Automatic extraction of abstract actions from humanoid motion data

Developing a humanoid robot that can learn to perform complex tasks by itself has become a major goal of robotics research. This paper proposes a new algorithm for the automatic segmentation of humanoid motion data. We use a simplified soccer game, RoboCup, as a prototype task. Motion data from a 20 degree-of-freedom humanoid soccer playing robot are reduced to their intrinsic dimensionality by nonlinear principal component analysis. The proposed algorithm operates in of two phases. The first phase automatically segments the motion data in the reduced sensorimotor space by incrementally generating nonlinear principal component analysis with a circular constraint networks and assigning data points based on their temporal order to these networks in a conquer-and-divide fashion. Then, the second phase of the algorithm removes repeated patterns based on the distance between redundant motion patterns in the reduced sensorimotor space. The networks abstracted five motion patterns without any prior information about the number or type of motion patterns. The learned networks can be used to recognize and generate humanoid actions.

[1]  E. C. Malthouse,et al.  Limitations of nonlinear PCA as performed with generic neural networks , 1998, IEEE Trans. Neural Networks.

[2]  K. MacDorman.  Feature learning, multiresolution analysis, and symbol grounding , 1998, Behavioral and Brain Sciences.

[3]  Yoshihiko Nakamura,et al.  Acquiring Motion Elements for Bidirectional Computation of Motion Recognition and Generation , 2002, ISER.

[4]  Andrew W. Moore,et al.  An Introduction to Reinforcement Learning , 1995 .

[5]  Richard S. Sutton,et al.  Introduction to Reinforcement Learning , 1998 .

[6]  R. Miranda,et al.  Circular Nodes in Neural Networks , 1996, Neural Computation.

[7]  V. M. Zat︠s︡iorskiĭ.  Kinematics of human motion , 1998 .

[8]  M. Kramer.  Nonlinear principal component analysis using autoassociative neural networks , 1991 .

[9]  Yoshihiko Nakamura,et al.  Polynomial design of the nonlinear dynamics for the brain-like information processing of whole body motion , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[10]  Leslie Pack Kaelbling,et al.  Practical Reinforcement Learning in Continuous Spaces , 2000, ICML.

[11]  K. MacDorman,et al.  Grounding Symbols through Sensorimotor Integration , 1999 .

[12]  Minoru Asada,et al.  Incremental purposive behavior acquisition based on self-interpretation of instructions by coach , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[13]  Vladimir M. Zatsiorsky.  Kinematics of human motion , 1998 .

[14]  Minoru Asada,et al.  Vision-guided behavior acquisition of a mobile robot by multi-layered reinforcement learning , 2000, Proceedings. 2000 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2000) (Cat. No.00CH37113).

[15]  Jun Nakanishi,et al.  Trajectory formation for imitation with nonlinear dynamical systems , 2001, Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180).

[16]  Maja J. Mataric,et al.  Automated derivation of behavior vocabularies for autonomous humanoid motion , 2003, AAMAS '03.