Understanding visuo‐motor primitives for motion synthesis and analysis

The problem addressed in this paper concerns the representation of human movement in terms of atomic visuo‐motor primitives considering both generation and perception of movement. We introduce the concept of kinetology, the phonology of human movement, and five principles on which such a system should be based: compactness, view‐invariance, reproducibility, selectivity, and reconstructivity. We propose visuo‐motor primitives and demonstrate their kinetological properties. Further evaluation is accomplished with experiments on compression and decompression. Our long‐term goal is to demonstrate that action has a space characterized by a visuo‐motor language. Copyright © 2006 John Wiley & Sons, Ltd.

[1]  Stefan Schaal,et al.  Is imitation learning the route to humanoid robots? , 1999, Trends in Cognitive Sciences.

[2]  V. Mcgee.  Multidimensional Scaling Of N Sets Of Similarity Measures: A Nonmetric Individual Differences Approach. , 1968, Multivariate behavioral research.

[3]  Maja J. Matarić,et al.  Visuo-Motor Primitives as a Basis for Learning by Imitation , 2000 .

[4]  Longin Jan Latecki,et al.  Convexity Rule for Shape Decomposition Based on Discrete Contour Evolution , 1999, Comput. Vis. Image Underst..

[5]  Kalyanmoy Deb,et al.  Optimal path and gait generations simultaneously of a six-legged robot using a GA-fuzzy approach , 2002, Robotics Auton. Syst..

[6]  Yoshihiro Okada,et al.  Feature preserving motion compression based on hierarchical curve simplification , 2004, 2004 IEEE International Conference on Multimedia and Expo (ICME) (IEEE Cat. No.04TH8763).

[7]  G. Rizzolatti,et al.  Action recognition in the premotor cortex. , 1996, Brain : a journal of neurology.

[8]  Jernej Barbic,et al.  Segmenting Motion Capture Data into Distinct Behaviors , 2004, Graphics Interface.

[9]  K. Amunts,et al.  Broca's region: from action to language. , 2005, Physiology.

[10]  Samia Boukir,et al.  Deformable model based data compression for gesture recognition , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[11]  Sethuraman Panchanathan,et al.  Automated gesture segmentation from dance sequences , 2004, Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings..

[12]  Y. Aloimonos,et al.  Discovering a Language for Human Activity 1 , 2005 .

[13]  Martin A. Giese,et al.  On the Representation, Learning and Transfer of Spatio-Temporal Movement Characteristics , 2003, Int. J. Humanoid Robotics.

[14]  Mubarak Shah,et al.  View-invariance in action recognition , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[15]  Patrick Brézillon,et al.  Lecture Notes in Artificial Intelligence , 1999 .

[16]  Aude Billard,et al.  Learning human arm movements by imitation: : Evaluation of a biologically inspired connectionist architecture , 2000, Robotics Auton. Syst..

[17]  Donald H. House,et al.  Motion Capture Data Manipulation and Reuse via B-splines , 1998, CAPTECH.

[18]  K. Uehara,et al.  Extraction of primitive motion and discovery of association rules from motion data , 2001, Proceedings 10th IEEE International Workshop on Robot and Human Interactive Communication. ROMAN 2001 (Cat. No.01TH8591).

[19]  Masahiro Okuda,et al.  Position-Based Keyframe Selection for Human Motion Animation , 2005, 11th International Conference on Parallel and Distributed Systems (ICPADS'05).

[20]  Daniel Thalmann,et al.  Key-posture extraction out of human motion data , 2001, 2001 Conference Proceedings of the 23rd Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[21]  Nanning Zheng,et al.  Unsupervised Analysis of Human Gestures , 2001, IEEE Pacific Rim Conference on Multimedia.

[22]  Adrian Hilton,et al.  Adaptive Compression of Human Animation Data , 2002, Eurographics.

[23]  Kazuhito Yokoi,et al.  Imitating human dance motions through motion structure analysis , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[24]  Daniel Cohen-Or,et al.  Action synopsis: pose selection and illustration , 2005, ACM Trans. Graph..

[25]  Martin A. Giese,et al.  Trajectory synthesis by hierarchical spatio-temporal correspondence: comparison of different methods , 2005, APGV '05.

[26]  Maja J. Mataric,et al.  Automated Derivation of Primitives for Movement Classification , 2000, Auton. Robots.

[27]  Shigeo Asahara,et al.  A compression/decompression method for streaming based humanoid animation , 1999, VRML '99.

[28]  Terry Caelli,et al.  On Learning the Shape of Complex Actions , 2001, IWVF.

[29]  Michael P. Kaschak,et al.  Grounding language in action , 2002, Psychonomic bulletin & review.

[30]  Eric Saux,et al.  Data reduction of polygonal curves using B-splines , 1999, Comput. Aided Des..