A novel point-line duality feature for trajectory classification

Trajectory classification is important for understanding object movements within the surveillance area. Raw trajectories are represented by object location in form of (x, y) coordinates. The length of trajectories varies in terms of number of points; thus, it is difficult to classify them into correct classes. The raw features extracted from trajectory do not yield satisfactory results in classification. Thus, robust features are needed that can efficiently represent trajectory sequences and help to improve the classification performance. In this paper, we present a new feature vector that is based on the concept of point-line duality (PLD) transformation, i.e., transformation of a trajectory point from its primal plane into a straight line in dual plane. Classification has been done using hidden Markov model (HMM) framework. We also propose a fusion approach combining classification results obtained from raw feature and PLD feature to improve the performance. Experiments have been carried out on raw trajectories with reduced lengths as well as adding Gaussian noise. Proposed approach has been tested on three publicly available datasets, namely T15, MIT, and CROSS. It has been found that the PLD feature outperforms existing features as well as raw feature when used in HHM-based classification. We have obtained encouraging results by feature combination at the decision level with 97, 96.75 and 99.80% accuracy, respectively, on T15, MIT, and CROSS datasets.

[1]  Jae-Gil Lee,et al.  TraClass: trajectory classification using hierarchical region-based and trajectory-based clustering , 2008, Proc. VLDB Endow..

[2]  Ahmad Lotfi,et al.  Human behavioural analysis with self-organizing map for ambient assisted living , 2014, 2014 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE).

[3]  W. Eric L. Grimson,et al.  Trajectory analysis and semantic region modeling using a nonparametric Bayesian model , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Fen Wang,et al.  Modeling Drivers' Dynamic Decision-Making Behavior During the Phase Transition Period: An Analytical Approach Based on Hidden Markov Model Theory , 2016, IEEE Transactions on Intelligent Transportation Systems.

[5]  Hongyuan Zha,et al.  Unsupervised Trajectory Clustering via Adaptive Multi-kernel-Based Shrinkage , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[6]  Alexandre Bernardino,et al.  Detection and classification of highway lanes using vehicle motion trajectories , 2006, IEEE Transactions on Intelligent Transportation Systems.

[7]  Mikhail G. Mozerov,et al.  Trajectory occlusion handling with multiple-view distance-minimization clustering , 2008 .

[8]  Kyuchang Kang,et al.  Hierarchically linked infinite hidden Markov model based trajectory analysis and semantic region retrieval in a trajectory dataset , 2017, Expert Syst. Appl..

[9]  Zhongfei Zhang,et al.  An Incremental DPMM-Based Method for Trajectory Clustering, Modeling, and Retrieval , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  吴新宇,et al.  Hierarchical Activity Discovery within Spatio-temporal Context for Video Anomaly Detection , 2013 .

[11]  Alessia Saggese,et al.  Dynamic Scene Understanding for Behavior Analysis Based on String Kernels , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[12]  Haipeng Wang,et al.  Online classification of frequent behaviours based on multidimensional trajectories , 2017 .

[13]  Takashi Fuse,et al.  Statistical Anomaly Detection in Human Dynamics Monitoring Using a Hierarchical Dirichlet Process Hidden Markov Model , 2017, IEEE Transactions on Intelligent Transportation Systems.

[14]  T. Jan,et al.  Neural network based threat assessment for automated visual surveillance , 2004, 2004 IEEE International Joint Conference on Neural Networks (IEEE Cat. No.04CH37541).

[15]  Debi Prosad Dogra,et al.  A segmental HMM based trajectory classification using genetic algorithm , 2018, Expert Syst. Appl..

[16]  Jaime S. Cardoso,et al.  Social Signaling Descriptor for Group Behaviour Analysis , 2015, IbPRIA.

[17]  Wentong Cai,et al.  Learning Behavior Patterns from Video: A Data-driven Framework for Agent-based Crowd Modeling , 2015, AAMAS.

[18]  Gérard G. Medioni,et al.  Context tracker: Exploring supporters and distracters in unconstrained environments , 2011, CVPR 2011.

[19]  Diane J. Cook,et al.  Human Activity Recognition and Pattern Discovery , 2010, IEEE Pervasive Computing.

[20]  Debi Prosad Dogra,et al.  A multimodal framework for sensor based sign language recognition , 2017, Neurocomputing.

[21]  Umapada Pal,et al.  Local Behavior Analysis for Trajectory Classification Using Graph Embedding , 2017, 2017 4th IAPR Asian Conference on Pattern Recognition (ACPR).

[22]  Siak Wang Khor,et al.  Path clustering using Dynamic Time Warping technique , 2012, 2012 8th International Conference on Computing Technology and Information Management (NCM and ICNIT).

[23]  Mário A. T. Figueiredo,et al.  Trajectory Classification Using Switched Dynamical Hidden Markov Models , 2010, IEEE Transactions on Image Processing.

[24]  Yoichi Sato,et al.  Learning motion patterns and anomaly detection by Human trajectory analysis , 2007, 2007 IEEE International Conference on Systems, Man and Cybernetics.

[25]  David M. J. Tax,et al.  Multivariate Time-Series Classification Using the Hidden-Unit Logistic Model , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[26]  Anthony J. T. Lee,et al.  Mining frequent trajectory patterns in spatial-temporal databases , 2009, Inf. Sci..

[27]  Gian Luca Foresti,et al.  Trajectory-Based Anomalous Event Detection , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[28]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[29]  Yingfeng Cai,et al.  Trajectory-based anomalous behaviour detection for intelligent traffic surveillance , 2015 .

[30]  Yunsick Sung,et al.  3D UAV Flying Path Optimization Method Based on the Douglas-Peucker Algorithm , 2017, MUE/FutureTech.

[31]  David H. Douglas,et al.  ALGORITHMS FOR THE REDUCTION OF THE NUMBER OF POINTS REQUIRED TO REPRESENT A DIGITIZED LINE OR ITS CARICATURE , 1973 .

[32]  J. O´Rourke,et al.  Computational Geometry in C: Arrangements , 1998 .

[33]  Carlos González,et al.  LIDAR based perception solution for autonomous vehicles , 2011, 2011 11th International Conference on Intelligent Systems Design and Applications.

[34]  Mohan M. Trivedi,et al.  Trajectory Learning for Activity Understanding: Unsupervised, Multilevel, and Long-Term Adaptive Approach , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[35]  Joseph O'Rourke,et al.  Computational geometry in C (2nd ed.) , 1998 .

[36]  Debi Prosad Dogra,et al.  Scene Representation and Anomalous Activity Detection using Weighted Region Association Graph , 2015, VISAPP.

[37]  Parth Mehta,et al.  Survey of unsupervised machine learning algorithms on precision agricultural data , 2015, 2015 International Conference on Innovations in Information, Embedded and Communication Systems (ICIIECS).

[38]  Irfan A. Essa,et al.  Gaussian process regression flow for analysis of motion trajectories , 2011, 2011 International Conference on Computer Vision.

[39]  J T LeeAnthony,et al.  Mining frequent trajectory patterns in spatial-temporal databases , 2009 .

[40]  Jean Meunier,et al.  Real-time video surveillance with self-organizing maps , 2005, The 2nd Canadian Conference on Computer and Robot Vision (CRV'05).