A segmental HMM based trajectory classification using genetic algorithm

Abstract Trajectory classification techniques face various challenges due to varying length and lack of the presence of clear boundaries among the trajectory classes. To overcome such challenges, a trajectory shrinking framework using Adaptive Multi-Kernel based Shrinkage (AMKS) can be used. However, such a strategy often results in over-shrinking of trajectories leading to poor classification. To improve classification performance, we introduce two additional kernels that are based on convex hull and Ramer–Douglas–Peucker (RDP) algorithm. Next, we propose a supervised trajectory classification approach using a combination of global and Segmental Hidden Markov Model (HMM) based classifiers. In the first stage, HMM is used globally for classification of trajectory to provide state-wise distribution of trajectory segments. In the second stage, state-wise trajectory segments are classified and combined with global recognition performance to improve the classification results. Combination of Global HMM and Segmental HMM is performed using a genetic algorithm (GA) based framework in the final stage. We have conducted experiments over two publicly available datasets, popularly known as T15 and MIT. We have achieved 94.80% and 96.75% of accuracies on T15 and MIT datasets, respectively. We also analyzed the robustness of the proposed framework by adding Gaussian noise. To show the effectiveness of the system, we have performed recognition of on-line signature using proposed Segmental HMM based combination model. In SVC2004 signature dataset, it outperforms traditional HMM-based systems.

[1]  Zhongfei Zhang,et al.  An Incremental DPMM-Based Method for Trajectory Clustering, Modeling, and Retrieval , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Vladimir Pavlovic,et al.  Time-series classification using mixed-state dynamic Bayesian networks , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[3]  W. Eric L. Grimson,et al.  Learning Patterns of Activity Using Real-Time Tracking , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Debi Prosad Dogra,et al.  An efficient approach for trajectory classification using FCM and SVM , 2017, 2017 IEEE Region 10 Symposium (TENSYMP).

[5]  David H. Douglas,et al.  ALGORITHMS FOR THE REDUCTION OF THE NUMBER OF POINTS REQUIRED TO REPRESENT A DIGITIZED LINE OR ITS CARICATURE , 1973 .

[6]  M.J. Russell,et al.  Linear trajectory segmental HMMs , 1997, IEEE Signal Processing Letters.

[7]  W. Eric L. Grimson,et al.  Trajectory Analysis and Semantic Region Modeling Using Nonparametric Hierarchical Bayesian Models , 2011, International Journal of Computer Vision.

[8]  H. Zha,et al.  Local smoothing for manifold learning , 2004, CVPR 2004.

[9]  Hong Chang,et al.  SVC2004: First International Signature Verification Competition , 2004, ICBA.

[10]  Subhadip Basu,et al.  Design of a novel convex hull based feature set for recognition of isolated handwritten Roman numerals , 2015, ArXiv.

[11]  W. Eric L. Grimson,et al.  Learning Semantic Scene Models by Trajectory Analysis , 2006, ECCV.

[12]  Qixiang Ye,et al.  Visual abnormal behavior detection based on trajectory sparse reconstruction analysis , 2013, Neurocomputing.

[13]  Debi Prosad Dogra,et al.  Scene Representation and Anomalous Activity Detection using Weighted Region Association Graph , 2015, VISAPP.

[14]  Alessia Saggese,et al.  Dynamic Scene Understanding for Behavior Analysis Based on String Kernels , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[15]  Parth Mehta,et al.  Survey of unsupervised machine learning algorithms on precision agricultural data , 2015, 2015 International Conference on Innovations in Information, Embedded and Communication Systems (ICIIECS).

[16]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[17]  Witold Pedrycz,et al.  Multivariate time series anomaly detection: A framework of Hidden Markov Models , 2017, Appl. Soft Comput..

[18]  Wentong Cai,et al.  Learning Behavior Patterns from Video: A Data-driven Framework for Agent-based Crowd Modeling , 2015, AAMAS.

[19]  Milan Tuba,et al.  An ant colony optimization algorithm for partitioning graphs with supply and demand , 2015, Appl. Soft Comput..

[20]  Bernhard Rinner,et al.  Trajectory clustering for motion pattern extraction in aerial videos , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[21]  Jianbo Shi,et al.  Detecting unusual activity in video , 2004, CVPR 2004.

[22]  Mário A. T. Figueiredo,et al.  Trajectory Classification Using Switched Dynamical Hidden Markov Models , 2010, IEEE Transactions on Image Processing.

[23]  Yoichi Sato,et al.  Learning motion patterns and anomaly detection by Human trajectory analysis , 2007, 2007 IEEE International Conference on Systems, Man and Cybernetics.

[24]  Lei Chen,et al.  On The Marriage of Lp-norms and Edit Distance , 2004, VLDB.

[25]  Diane J. Cook,et al.  Human Activity Recognition and Pattern Discovery , 2010, IEEE Pervasive Computing.

[26]  Pascal Vincent,et al.  Unsupervised Feature Learning and Deep Learning: A Review and New Perspectives , 2012, ArXiv.

[27]  Mehmet Cem Catalbas,et al.  Online signature recognition , 2014, 2014 22nd Signal Processing and Communications Applications Conference (SIU).

[28]  Thomas Stützle,et al.  Ant colony optimization: artificial ants as a computational intelligence technique , 2006 .

[29]  Eamonn J. Keogh,et al.  Scaling up dynamic time warping for datamining applications , 2000, KDD '00.

[30]  Andrew Hunter,et al.  Application of the self-organising map to trajectory classification , 2000, Proceedings Third IEEE International Workshop on Visual Surveillance.

[31]  Debi Prosad Dogra,et al.  Coupled HMM-based multi-sensor data fusion for sign language recognition , 2017, Pattern Recognit. Lett..

[32]  René Vidal,et al.  Segmenting Motions of Different Types by Unsupervised Manifold Clustering , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[33]  Xiaogang Wang,et al.  Understanding collective crowd behaviors: Learning a Mixture model of Dynamic pedestrian-Agents , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[34]  Debi Prosad Dogra,et al.  Study of Text Segmentation and Recognition Using Leap Motion Sensor , 2017, IEEE Sensors Journal.

[35]  Dan Schonfeld,et al.  Object Trajectory-Based Activity Classification and Recognition Using Hidden Markov Models , 2007, IEEE Transactions on Image Processing.

[36]  W. Eric L. Grimson,et al.  Trajectory analysis and semantic region modeling using a nonparametric Bayesian model , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[37]  Mohan M. Trivedi,et al.  Learning and Classification of Trajectories in Dynamic Scenes: A General Framework for Live Video Analysis , 2008, 2008 IEEE Fifth International Conference on Advanced Video and Signal Based Surveillance.

[38]  T. Jan,et al.  Neural network based threat assessment for automated visual surveillance , 2004, 2004 IEEE International Joint Conference on Neural Networks (IEEE Cat. No.04CH37541).

[39]  S. Satoh,et al.  Human action recognition in crowded surveillance video sequences by using features taken from key-point trajectories , 2011, CVPR 2011 WORKSHOPS.

[40]  Nannan Li,et al.  Hierarchical activity discovery within spatio-temporal context for video anomaly detection , 2013, 2013 IEEE International Conference on Image Processing.

[41]  Anthony J. T. Lee,et al.  Mining frequent trajectory patterns in spatial-temporal databases , 2009, Inf. Sci..

[42]  Gian Luca Foresti,et al.  Trajectory-Based Anomalous Event Detection , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[43]  Miguel Á. Carreira-Perpiñán,et al.  Manifold blurring mean shift algorithms for manifold denoising , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[44]  David P. Dobkin,et al.  The quickhull algorithm for convex hulls , 1996, TOMS.

[45]  Padhraic Smyth,et al.  Segmental Hidden Markov Models with Random Effects for Waveform Modeling , 2006, J. Mach. Learn. Res..

[46]  L. Bergroth,et al.  A survey of longest common subsequence algorithms , 2000, Proceedings Seventh International Symposium on String Processing and Information Retrieval. SPIRE 2000.

[47]  Thomas Stützle,et al.  Ant Colony Optimization , 2009, EMO.

[48]  Irfan A. Essa,et al.  Gaussian process regression flow for analysis of motion trajectories , 2011, 2011 International Conference on Computer Vision.

[49]  Bailing Zhang,et al.  Off-line signature verification and identification by pyramid histogram of oriented gradients , 2010, Int. J. Intell. Comput. Cybern..

[50]  Francesco Villecco,et al.  Multi-Scale Permutation Entropy Based on Improved LMD and HMM for Rolling Bearing Diagnosis , 2017, Entropy.

[51]  Serge J. Belongie,et al.  Learning to Traverse Image Manifolds , 2006, NIPS.

[52]  Subhadip Basu,et al.  Recognition of Handwritten Bangla Basic Characters and Digits using Convex Hull based Feature Set , 2014, ArXiv.

[53]  Debi Prosad Dogra,et al.  A bio-signal based framework to secure mobile devices , 2017, J. Netw. Comput. Appl..

[54]  Hongyuan Zha,et al.  Unsupervised Trajectory Clustering via Adaptive Multi-kernel-Based Shrinkage , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[55]  Alexandre Bernardino,et al.  Detection and classification of highway lanes using vehicle motion trajectories , 2006, IEEE Transactions on Intelligent Transportation Systems.

[56]  Debi Prosad Dogra,et al.  A multimodal framework for sensor based sign language recognition , 2017, Neurocomputing.

[57]  Debi Prosad Dogra,et al.  Surveillance Scene Segmentation Based on Trajectory Classification Using Supervised Learning , 2016, CVIP.

[58]  Lili Huang,et al.  Real-time multi-vehicle tracking based on feature detection and color probability model , 2010, 2010 IEEE Intelligent Vehicles Symposium.

[59]  Umapada Pal,et al.  Local Behavior Analysis for Trajectory Classification Using Graph Embedding , 2017, 2017 4th IAPR Asian Conference on Pattern Recognition (ACPR).

[60]  Svetha Venkatesh,et al.  AdaBoost.MRF: Boosted Markov Random Forests and Application to Multilevel Activity Recognition , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[61]  Gérard G. Medioni,et al.  Context tracker: Exploring supporters and distracters in unconstrained environments , 2011, CVPR 2011.

[62]  Dimitrios Gunopulos,et al.  Discovering similar multidimensional trajectories , 2002, Proceedings 18th International Conference on Data Engineering.

[63]  Gian Luca Foresti,et al.  Generalized neural trees for outdoor scene understanding , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[64]  Yingfeng Cai,et al.  Trajectory-based anomalous behaviour detection for intelligent traffic surveillance , 2015 .

[65]  Ahmad Lotfi,et al.  Human behavioural analysis with self-organizing map for ambient assisted living , 2014, 2014 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE).

[66]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[67]  David C. Hogg,et al.  Learning the distribution of object trajectories for event recognition , 1996, Image Vis. Comput..

[68]  Bingbing Ni,et al.  Crowded Scene Analysis: A Survey , 2015, IEEE Transactions on Circuits and Systems for Video Technology.

[69]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[70]  P. A. Taylor,et al.  Synchronization of batch trajectories using dynamic time warping , 1998 .

[71]  Hao Li,et al.  Unsupervised feature-based abnormality detection , 2010 .

[72]  Debi Prosad Dogra,et al.  Classification of Object Trajectories Represented by High-Level Features Using Unsupervised Learning , 2016, CVIP.

[73]  Mari Ostendorf,et al.  From HMM's to segment models: a unified view of stochastic modeling for speech recognition , 1996, IEEE Trans. Speech Audio Process..

[74]  Shaogang Gong,et al.  Video behaviour profiling and abnormality detection without manual labelling , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[75]  Shaogang Gong,et al.  Beyond Tracking: Modelling Activity and Understanding Behaviour , 2006, International Journal of Computer Vision.