Motion trajectory reproduction from generalized signature description

Free form motion trajectories prove to be an informative and compact motion clue in sketching long-term, spatiotemporal motions. Hence, motion trajectories have been used for characterizing human behaviors/activities, robot actions and other objects' movements. However, it is observed that most of the previous studies merely use motion trajectories straightforwardly in the raw data form, which is inflexible as they rely largely on the absolute positions. To solve this problem, we propose to achieve effective motion trajectory descriptions by developing a systematic trajectory description mechanism. To this end, a flexible motion trajectory signature descriptor has been proposed in our previous work, which can offer generalized descriptions to the raw trajectory data thanks to its rich description invariants. Moreover, for an effective descriptor, it is sometimes desired to have mutual description functions, i.e. describing and un-describing capability to support some applications like robot learning. Hence, opposite to describing a motion trajectory using the signature, this paper focuses on the un-describing problem, that is, reproducing a trajectory instance from a given signature description. The moving frame technique is used in formulating the trajectory reproduction method. A nonlinear signature matching-based metric is also developed to measure the quality of the reproductions. Experiments are conducted to verify the effectiveness of the trajectory reproduction. It is shown that the trajectory signature is flexible and easy to implement in both the description and reproduction of trajectory instances.

[1]  Shandong Wu,et al.  On Signature Invariants for Effective Motion Trajectory Recognition , 2008, Int. J. Robotics Res..

[2]  Baihua Li,et al.  Articulated motion reconstruction from feature points , 2008, Pattern Recognit..

[3]  Guojun Lu,et al.  Review of shape representation and description techniques , 2004, Pattern Recognit..

[4]  Nicholas Roy,et al.  Trajectory Optimization using Reinforcement Learning for Map Exploration , 2008, Int. J. Robotics Res..

[5]  Dmitry B. Goldgof,et al.  Gesture recognition using Bezier curves for visualization navigation from registered 3-D data , 2004, Pattern Recognit..

[6]  Mubarak Shah,et al.  Shape matching and modeling using skeletal context , 2008, Pattern Recognit..

[7]  W. Wong,et al.  On ψ-Learning , 2003 .

[8]  C.-C. Jay Kuo,et al.  Wavelet descriptor of planar curves: theory and applications , 1996, IEEE Trans. Image Process..

[9]  Jan Flusser,et al.  Projective moment invariants , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Alan S. Morris,et al.  Fuzzy-GA-based trajectory planner for robot manipulators sharing a common workspace , 2006, IEEE Transactions on Robotics.

[11]  Katsushi Ikeuchi,et al.  Task analysis based on observing hands and objects by vision , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[12]  Jianwei Zhang,et al.  A hierarchical motion trajectory signature descriptor , 2008, 2008 IEEE International Conference on Robotics and Automation.

[13]  Huosheng Hu,et al.  Imitation towards service robotics , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[14]  Yoichi Sato,et al.  Learning motion patterns and anomaly detection by Human trajectory analysis , 2007, 2007 IEEE International Conference on Systems, Man and Cybernetics.

[15]  Ronald Poppe,et al.  Vision-based human motion analysis: An overview , 2007, Comput. Vis. Image Underst..

[16]  Rangachar Kasturi,et al.  Activity recognition based on multiple motion trajectories , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[17]  Tim J. Ellis,et al.  Recognizing hand gesture using Fourier descriptors , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[18]  Jake K. Aggarwal,et al.  Human motion: modeling and recognition of actions and interactions , 2004, Proceedings. 2nd International Symposium on 3D Data Processing, Visualization and Transmission, 2004. 3DPVT 2004..

[19]  Jianjiang Feng,et al.  Combining minutiae descriptors for fingerprint matching , 2008, Pattern Recognit..

[20]  Taesoo Kwon,et al.  Two-Character Motion Analysis and Synthesis , 2008, IEEE Transactions on Visualization and Computer Graphics.

[21]  Ivan Bratko,et al.  Skill modeling through symbolic reconstruction of operator's trajectories , 2000, IEEE Trans. Syst. Man Cybern. Part A.

[22]  Pradeep K. Khosla,et al.  Learning by observation with mobile robots: a computational approach , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[23]  Josef Kittler,et al.  Robust and Efficient Shape Indexing through Curvature Scale Space , 1996, BMVC.

[24]  Mohammad Reza Daliri,et al.  Robust symbolic representation for shape recognition and retrieval , 2008, Pattern Recognit..

[25]  Ales Ude,et al.  Programming full-body movements for humanoid robots by observation , 2004, Robotics Auton. Syst..

[26]  Mubarak Shah,et al.  View-Invariant Representation and Recognition of Actions , 2002, International Journal of Computer Vision.

[27]  Rangachar Kasturi,et al.  Extraction and Temporal Segmentation of Multiple Motion Trajectories in Human Motion , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[28]  David A. Forsyth,et al.  Motion synthesis from annotations , 2003, ACM Trans. Graph..

[29]  Rama Chellappa,et al.  View Invariance for Human Action Recognition , 2005, International Journal of Computer Vision.

[30]  Volodymyr V. Kindratenko,et al.  On Using Functions to Describe the Shape , 2003, Journal of Mathematical Imaging and Vision.

[31]  Shih-Fu Chang,et al.  Motion trajectory matching of video objects , 1999, Electronic Imaging.

[32]  Atsushi Nakazawa,et al.  Analysis and synthesis of human dance motions , 2003, Proceedings of IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems, MFI2003..

[33]  Yangsheng Xu,et al.  Modeling of human walking trajectories for surveillance , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[34]  Stefano Caselli,et al.  Robust trajectory learning and approximation for robot programming by demonstration , 2006, Robotics Auton. Syst..

[35]  Asif Masood,et al.  Optimized polygonal approximation by dominant point deletion , 2008, Pattern Recognit..

[36]  Zhengwei Yang,et al.  Invariant matching and identification of curves using B-splines curve representation , 1995, IEEE Trans. Image Process..

[37]  Laurent Wendling,et al.  A new shape descriptor defined on the Radon transform , 2006, Comput. Vis. Image Underst..

[38]  Thomas B. Moeslund,et al.  A Survey of Computer Vision-Based Human Motion Capture , 2001, Comput. Vis. Image Underst..

[39]  Masayuki Inaba,et al.  Learning by watching: extracting reusable task knowledge from visual observation of human performance , 1994, IEEE Trans. Robotics Autom..

[40]  Wolfram Burgard,et al.  Learning Motion Patterns of People for Compliant Robot Motion , 2005, Int. J. Robotics Res..

[41]  Ernesto Bribiesca A chain code for representing 3D curves , 2000, Pattern Recognit..

[42]  Michael E. Taylor,et al.  Differential Geometry I , 1994 .

[43]  S. Bocionek,et al.  Robot programming by Demonstration (RPD): Supporting the induction by human interaction , 1996, Machine Learning.

[44]  Aude Billard,et al.  On Learning, Representing, and Generalizing a Task in a Humanoid Robot , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[45]  Michael J. Black,et al.  A Probabilistic Framework for Matching Temporal Trajectories: CONDENSATION-Based Recognition of Gestures and Expressions , 1998, ECCV.

[46]  Ulrich Kressel,et al.  Tracking non-rigid, moving objects based on color cluster flow , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[47]  Shaogang Gong,et al.  Activity based surveillance video content modelling , 2008, Pattern Recognit..

[48]  Katsushi Ikeuchi,et al.  Recognizing Assembly Tasks Through Human Demonstration , 2007, Int. J. Robotics Res..

[49]  Zoran Popovic,et al.  Editing dynamic properties of captured human motion , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[50]  Shandong Wu,et al.  Flexible signature descriptions for adaptive motion trajectory representation, perception and recognition , 2009, Pattern Recognit..

[51]  Heinrich Niemann,et al.  Gait Classification with HMMs for Trajectories of Body Parts Extracted by Mixture Densities , 1998, BMVC.