Modeling local and global behavior for trajectory classification using graph based algorithm

Abstract Understanding motion patterns is of great importance to analyze the behavior of objects in the vigilance area. Grouping the motion patterns into clusters in such a way that similar motion patterns lie in same cluster and the inter-cluster variance is maximized in a challenging work. Variation in the duration of trajectory patterns in terms of time or number of points in them (even in the trajectories from same cluster) makes it more difficult to correctly classify in respective clusters while using full length trajectories, local clue can be used along with the global information. Trajectories can be segmented into distinctive parts and local contribution of these parts can be used to improve the performance of the system. In this work, we have formulated the trajectory classification problem into graph based similarity problem using Douglas–Peucker (DP) algorithm, Complete Bipartite Graphs (CBG), and Minimum Spanning Tree (MST). Local behavior of objects has been analyzed using their motion segments and Dynamic Time Warping (DTW) has been used for finding similarity among motion trajectories. Class-wise global and local costs have been computed using DTW, CBG, and MST and their fusion has been done using Particle Swarm Optimization (PSO) to improve the classification rate. Trajectory datasets, namely T15, LabOmni, and CROSS have been used in experiments. The proposed method yields encouraging results and outperforms the state of the art techniques.

[1]  David González,et al.  A Review of Motion Planning Techniques for Automated Vehicles , 2016, IEEE Transactions on Intelligent Transportation Systems.

[2]  Ramakant Nevatia,et al.  Hierarchical abnormal event detection by real time and semi-real time multi-tasking video surveillance system , 2013, Machine Vision and Applications.

[3]  Rui Zhou,et al.  Particle swarm optimization applied to hypersonic reentry trajectories , 2015 .

[4]  Jae-Gil Lee,et al.  Mining Discriminative Patterns for Classifying Trajectories on Road Networks , 2011, IEEE Transactions on Knowledge and Data Engineering.

[5]  Siak Wang Khor,et al.  Path clustering using Dynamic Time Warping technique , 2012, 2012 8th International Conference on Computing Technology and Information Management (NCM and ICNIT).

[6]  Sraban Kumar Mohanty,et al.  Fast approximate minimum spanning tree based clustering algorithm , 2018, Neurocomputing.

[7]  Jianxin Wu,et al.  A Heat-Map-Based Algorithm for Recognizing Group Activities in Videos , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[8]  Mohan M. Trivedi,et al.  Trajectory Learning for Activity Understanding: Unsupervised, Multilevel, and Long-Term Adaptive Approach , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Halife Kodaz,et al.  A new hybrid method based on Particle Swarm Optimization, Ant Colony Optimization and 3-Opt algorithms for Traveling Salesman Problem , 2015, Appl. Soft Comput..

[10]  Gérard G. Medioni,et al.  Context tracker: Exploring supporters and distracters in unconstrained environments , 2011, CVPR 2011.

[11]  H. Fradi,et al.  Robust foreground segmentation using improved Gaussian Mixture Model and optical flow , 2012, 2012 International Conference on Informatics, Electronics & Vision (ICIEV).

[12]  Wolfram Burgard,et al.  A Tutorial on Graph-Based SLAM , 2010, IEEE Intelligent Transportation Systems Magazine.

[13]  Carlos González,et al.  LIDAR based perception solution for autonomous vehicles , 2011, 2011 11th International Conference on Intelligent Systems Design and Applications.

[14]  Mohan M. Trivedi,et al.  Looking at Vehicles on the Road: A Survey of Vision-Based Vehicle Detection, Tracking, and Behavior Analysis , 2013, IEEE Transactions on Intelligent Transportation Systems.

[15]  Wei Shen,et al.  Abnormal events detection in crowded scenes by trajectory cluster , 2015, Precision Engineering Measurements and Instrumentation.

[16]  Maxim Likhachev,et al.  Path planning for non-circular micro aerial vehicles in constrained environments , 2013, 2013 IEEE International Conference on Robotics and Automation.

[17]  G. Salvi,et al.  An Automated Nighttime Vehicle Counting and Detection System for Traffic Surveillance , 2014, 2014 International Conference on Computational Science and Computational Intelligence.

[18]  Huiying Xu,et al.  Supervision on abnormal activities in vehicle inspection service by anomaly detection in bipartite graph , 2016, 2016 IEEE International Conference on Intelligent Transportation Engineering (ICITE).

[19]  Mohan M. Trivedi,et al.  Learning trajectory patterns by clustering: Experimental studies and comparative evaluation , 2009, CVPR.

[20]  Debi Prosad Dogra,et al.  An efficient approach for trajectory classification using FCM and SVM , 2017, 2017 IEEE Region 10 Symposium (TENSYMP).

[21]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[22]  Vincent Roberge,et al.  Comparison of Parallel Genetic Algorithm and Particle Swarm Optimization for Real-Time UAV Path Planning , 2013, IEEE Transactions on Industrial Informatics.

[23]  Takashi Fuse,et al.  Statistical Anomaly Detection in Human Dynamics Monitoring Using a Hierarchical Dirichlet Process Hidden Markov Model , 2017, IEEE Transactions on Intelligent Transportation Systems.

[24]  Rongrong Ji,et al.  3D object retrieval with multi-feature collaboration and bipartite graph matching , 2016, Neurocomputing.

[25]  Kaspar Riesen,et al.  A Survey on Applications of Bipartite Graph Edit Distance , 2017, GbRPR.

[26]  Bin Ran,et al.  Vehicle Trajectory Analysis System via Mutual Information and Sparse Reconstruction , 2017 .

[27]  Adam Babinec,et al.  Automatic Vehicle Trajectory Extraction for Traffic Analysis from Aerial Video Data , 2015 .

[28]  Bogdan Gabrys,et al.  Comparing and Combining Time Series Trajectories Using Dynamic Time Warping , 2016, KES.

[29]  Debi Prosad Dogra,et al.  Study of Text Segmentation and Recognition Using Leap Motion Sensor , 2017, IEEE Sensors Journal.

[30]  Andrea Cavallaro,et al.  Single camera calibration for trajectory-based behavior analysis , 2007, 2007 IEEE Conference on Advanced Video and Signal Based Surveillance.

[31]  Barbara Savini,et al.  Path Planning for Autonomous Vehicles by Trajectory Smoothing Using Motion Primitives , 2008, IEEE Transactions on Control Systems Technology.

[32]  Peter H. N. de With,et al.  Automatic video-based human motion analyzer for consumer surveillance system , 2009, IEEE Transactions on Consumer Electronics.

[33]  Vania Bogorny,et al.  Toward Abnormal Trajectory and Event Detection in Video Surveillance , 2017, IEEE Transactions on Circuits and Systems for Video Technology.

[34]  Debi Prosad Dogra,et al.  Coupled HMM-based multi-sensor data fusion for sign language recognition , 2017, Pattern Recognit. Lett..

[35]  Nannan Li,et al.  Hierarchical activity discovery within spatio-temporal context for video anomaly detection , 2013, 2013 IEEE International Conference on Image Processing.

[36]  Hongyuan Zha,et al.  Unsupervised Trajectory Clustering via Adaptive Multi-kernel-Based Shrinkage , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[37]  Umapada Pal,et al.  A lexicon-free approach for 3D handwriting recognition using classifier combination , 2018, Pattern Recognit. Lett..

[38]  Serge P. Hoogendoorn,et al.  Car-Following Behavior Analysis from Microscopic Trajectory Data , 2005 .

[39]  Yunsick Sung,et al.  3D UAV Flying Path Optimization Method Based on the Douglas-Peucker Algorithm , 2017, MUE/FutureTech.

[40]  Ümit Özgüner,et al.  Trajectory prediction of a lane changing vehicle based on driver behavior estimation and classification , 2014, 17th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[41]  Ju-Jang Lee,et al.  Trajectory Optimization With Particle Swarm Optimization for Manipulator Motion Planning , 2015, IEEE Transactions on Industrial Informatics.

[42]  Jon Atli Benediktsson,et al.  Feature Selection Based on Hybridization of Genetic Algorithm and Particle Swarm Optimization , 2015, IEEE Geoscience and Remote Sensing Letters.

[43]  Uğur Özcan,et al.  A modified particle swarm optimization algorithm to mixed-model two-sided assembly line balancing , 2017, J. Intell. Manuf..

[44]  Kenneth Tze Kin Teo,et al.  Modeling of vehicle trajectory clustering based on LCSS for traffic pattern extraction , 2017, 2017 IEEE 2nd International Conference on Automatic Control and Intelligent Systems (I2CACIS).

[45]  Zhongfei Zhang,et al.  An Incremental DPMM-Based Method for Trajectory Clustering, Modeling, and Retrieval , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[46]  Jingdong Zhao,et al.  Solving the Time-Jerk Optimal Trajectory Planning Problem of a Robot Using Augmented Lagrange Constrained Particle Swarm Optimization , 2017 .

[47]  Kyuchang Kang,et al.  Hierarchically linked infinite hidden Markov model based trajectory analysis and semantic region retrieval in a trajectory dataset , 2017, Expert Syst. Appl..

[48]  David H. Douglas,et al.  ALGORITHMS FOR THE REDUCTION OF THE NUMBER OF POINTS REQUIRED TO REPRESENT A DIGITIZED LINE OR ITS CARICATURE , 1973 .

[49]  Diansheng Guo,et al.  A graph-based approach to vehicle trajectory analysis , 2010, J. Locat. Based Serv..