Kernel-based representation for 2D/3D motion trajectory retrieval and classification

This paper proposes a novel kernel-space representation for motion trajectories. Contrasted to most trajectory representation methods in the literature, our method is more generic in the sense that it can be applied to either 2D or 3D trajectories. In the proposed method, a trajectory is firstly projected by the Kernel Principal Component Analysis (KPCA) which can be considered as an implicit mapping to a much higher-dimensional feature space. The high dimensionality can effectively improve the accuracy in recognizing motion trajectories. Then, Nonparametric Discriminant Analysis (NDA) is used to extract the most discriminative features from the KPCA feature space. The synergistic effect of KPCA and NDA leads to better class separability and makes the proposed trajectory representation a more powerful discriminator. The experimental validation of the proposed method is conducted on the Australian Sign Language (ASL) data set. The results show that our method performs significantly better, in both trajectory classification and retrieval, than the state-of-the-art techniques.

[1]  David G. Stork,et al.  Pattern Classification , 1973 .

[2]  Shehzad Khalid,et al.  Motion Trajectory Learning in the DFT-Coefficient Feature Space , 2006, Fourth IEEE International Conference on Computer Vision Systems (ICVS'06).

[3]  Sukhendu Das,et al.  Trajectory representation using Gabor features for motion-based video retrieval , 2009, Pattern Recognit. Lett..

[4]  Shehzad Khalid,et al.  Motion-based behaviour learning, profiling and classification in the presence of anomalies , 2010, Pattern Recognit..

[5]  Stephen J. Maybank,et al.  Vehicle Trajectory Approximation and Classification , 1998, BMVC.

[6]  Dahua Lin,et al.  Nonparametric Discriminant Analysis for Face Recognition , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Shehzad Khalid,et al.  Frameworks for multivariate m-mediods based modeling and classification in Euclidean and general feature spaces , 2012, Pattern Recognit..

[8]  Andrea Cavallaro,et al.  Multifeature Object Trajectory Clustering for Video Analysis , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[9]  Jean-Philippe Thiran,et al.  Counting Pedestrians in Video Sequences Using Trajectory Clustering , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[10]  Ho-Sub Yoon,et al.  Hand gesture recognition using combined features of location, angle and velocity , 2001, Pattern Recognit..

[11]  Shandong Wu,et al.  Flexible signature descriptions for adaptive motion trajectory representation, perception and recognition , 2009, Pattern Recognit..

[12]  Wei-Yang Lin,et al.  Trajectory-based sign language recognition using Discriminant Analysis in higher-dimensional feature space , 2011, 2011 IEEE International Conference on Multimedia and Expo.

[13]  Bernhard Schölkopf,et al.  Nonlinear Component Analysis as a Kernel Eigenvalue Problem , 1998, Neural Computation.

[14]  Mubarak Shah,et al.  View-Invariant Representation and Recognition of Actions , 2002, International Journal of Computer Vision.

[15]  Dan Schonfeld,et al.  Automatic Object Trajectory-Based Motion Recognition Using Gaussian Mixture Models , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[16]  L. Davis,et al.  M2Tracker: A Multi-View Approach to Segmenting and Tracking People in a Cluttered Scene , 2003, International Journal of Computer Vision.

[17]  Nasser M. Nasrabadi,et al.  Pattern Recognition and Machine Learning , 2006, Technometrics.

[18]  Shehzad Khalid,et al.  Classifying spatiotemporal object trajectories using unsupervised learning in the coefficient feature space , 2006, Multimedia Systems.

[19]  Keinosuke Fukunaga,et al.  Introduction to statistical pattern recognition (2nd ed.) , 1990 .

[20]  Narendra Ahuja,et al.  Extraction of 2D Motion Trajectories and Its Application to Hand Gesture Recognition , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  Dan Schonfeld,et al.  Event Analysis Based on Multiple Interactive Motion Trajectories , 2009, IEEE Transactions on Circuits and Systems for Video Technology.

[22]  Tieniu Tan,et al.  Learning activity patterns using fuzzy self-organizing neural network , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[23]  Ja-Chen Lin,et al.  A new LDA-based face recognition system which can solve the small sample size problem , 1998, Pattern Recognit..

[24]  Xu Chen,et al.  Null-Space representation for view-invariant motion trajectory classification-recognition and indexing-retrieval , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[25]  Jin-Hyung Kim,et al.  An HMM-Based Threshold Model Approach for Gesture Recognition , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  Jun-Wei Hsieh,et al.  Motion-based video retrieval by trajectory matching , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[27]  Dan Schonfeld,et al.  Object Trajectory-Based Activity Classification and Recognition Using Hidden Markov Models , 2007, IEEE Transactions on Image Processing.

[28]  K. Fukunaga,et al.  Nonparametric Discriminant Analysis , 1983, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  Arun Ross,et al.  Score normalization in multimodal biometric systems , 2005, Pattern Recognit..

[30]  Dan Schonfeld,et al.  Segmented trajectory based indexing and retrieval of video data , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[31]  Surendra Ranganath,et al.  Signing Exact English (SEE): Modeling and recognition , 2008, Pattern Recognit..

[32]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[33]  J KriegmanDavid,et al.  Eigenfaces vs. Fisherfaces , 1997 .

[34]  RanganathSurendra,et al.  Signing Exact English (SEE) , 2008 .

[35]  Keinosuke Fukunaga,et al.  Introduction to Statistical Pattern Recognition , 1972 .

[36]  Hua Yu,et al.  A direct LDA algorithm for high-dimensional data - with application to face recognition , 2001, Pattern Recognit..

[37]  Dan Schonfeld,et al.  Real-Time Motion Trajectory-Based Indexing and Retrieval of Video Sequences , 2007, IEEE Transactions on Multimedia.

[38]  Mário A. T. Figueiredo,et al.  Trajectory Classification Using Switched Dynamical Hidden Markov Models , 2010, IEEE Transactions on Image Processing.

[39]  Dimitrios Gunopulos,et al.  Discovering similar multidimensional trajectories , 2002, Proceedings 18th International Conference on Data Engineering.

[40]  Sargur N. Srihari,et al.  On-Line and Off-Line Handwriting Recognition: A Comprehensive Survey , 2000, IEEE Trans. Pattern Anal. Mach. Intell..