Vehicle Behavior Learning via Sparse Reconstruction with $\ell_{2}-\ell_{p}$ Minimization and Trajectory Similarity

Vehicle behavior learning can be used in video surveillance systems to identify normal and abnormal vehicle motion patterns for the management of traffic operations, public services, and law enforcement. The purpose of this paper is to develop a novel adaptive sparse reconstruction method for vehicle behavior learning based on video surveillance systems. First, the <inline-formula> <tex-math notation="LaTeX">$\ell_{0}$</tex-math></inline-formula> minimization problem of sparse reconstruction is relaxed to the <inline-formula> <tex-math notation="LaTeX">$\ell_{p}$</tex-math></inline-formula> minimization problem <inline-formula> <tex-math notation="LaTeX">$(\text{0} <p <\text{1})$</tex-math></inline-formula>. A hybrid algorithm orthogonal matching pursuit—quasi-Newton is proposed to effectively find the sparse solutions. Then, a sparse reconstruction and similarity-based trajectory classifier is developed to learn vehicle behavior based on the sparse solutions and the trajectory similarity. In order to validate the performance and the effectiveness of the proposed method, four datasets, including CROSS, i-LIDA, Stop Sign, and I5 are used in the experiments. The results show that the classification and the anomaly detection accuracies of the proposed method are superior to the representative methods, including the Naïve Bayes classifier, <inline-formula> <tex-math notation="LaTeX">$k$</tex-math></inline-formula> nearest neighbor, support vector machine, and traditional sparse reconstruction-based trajectory learning methods.

[1]  W. Eric L. Grimson,et al.  Trajectory analysis and semantic region modeling using a nonparametric Bayesian model , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Nello Cristianini,et al.  An Introduction to Support Vector Machines and Other Kernel-based Learning Methods , 2000 .

[3]  Mohan M. Trivedi,et al.  A Survey of Vision-Based Trajectory Learning and Analysis for Surveillance , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[4]  Kuntal Sengupta,et al.  Framework for real-time behavior interpretation from traffic video , 2005, IEEE Transactions on Intelligent Transportation Systems.

[5]  Lei Zhang,et al.  Sparse representation or collaborative representation: Which helps face recognition? , 2011, 2011 International Conference on Computer Vision.

[6]  Qixiang Ye,et al.  Visual abnormal behavior detection based on trajectory sparse reconstruction analysis , 2013, Neurocomputing.

[7]  S. Frick,et al.  Compressed Sensing , 2014, Computer Vision, A Reference Guide.

[8]  Zizhuo Wang,et al.  Complexity of Unconstrained L2-Lp Minimization , 2011 .

[9]  Mubarak Shah,et al.  Machine Vision and Applications Understanding Human Behavior from Motion Imagery , 2003 .

[10]  Martin Kiefel,et al.  Quasi-Newton Methods: A New Direction , 2012, ICML.

[11]  René Vidal,et al.  Robust classification using structured sparse representation , 2011, CVPR 2011.

[12]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[13]  Mila Nikolova,et al.  Analysis of the Recovery of Edges in Images and Signals by Minimizing Nonconvex Regularized Least-Squares , 2005, Multiscale Model. Simul..

[14]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Xin Zhang,et al.  Single-layer Unsupervised Feature Learning with l2 regularized sparse filtering , 2014, 2014 IEEE China Summit & International Conference on Signal and Information Processing (ChinaSIP).

[16]  Cheol Oh,et al.  Real-Time Detection of Hazardous Traffic Events on Freeways , 2009 .

[17]  Wu Chen,et al.  Method for Preceding Vehicle Type Classification Based on Sparse Representation , 2011 .

[18]  Edoardo Amaldi,et al.  On the Approximability of Minimizing Nonzero Variables or Unsatisfied Relations in Linear Systems , 1998, Theor. Comput. Sci..

[19]  Xiaojun Chen,et al.  Complexity of unconstrained $$L_2-L_p$$ minimization , 2011, Math. Program..

[20]  Mohan M. Trivedi,et al.  Trajectory Learning for Activity Understanding: Unsupervised, Multilevel, and Long-Term Adaptive Approach , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Y. Ye,et al.  Lower Bound Theory of Nonzero Entries in Solutions of ℓ2-ℓp Minimization , 2010, SIAM J. Sci. Comput..

[22]  Andrew Hunter,et al.  Application of the self-organising map to trajectory classification , 2000, Proceedings Third IEEE International Workshop on Visual Surveillance.

[23]  Michael A. Saunders,et al.  Atomic Decomposition by Basis Pursuit , 1998, SIAM J. Sci. Comput..

[24]  Jun-Wei Hsieh,et al.  Automatic traffic surveillance system for vehicle tracking and classification , 2006, IEEE Transactions on Intelligent Transportation Systems.

[25]  Ramakant Nevatia,et al.  Event Detection and Analysis from Video Streams , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  Jianqing Fan,et al.  Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties , 2001 .

[27]  Youn-Soo Kang,et al.  Hazardous Driving Event Detection and Analysis System in Vehicular Networks , 2013 .

[28]  Lawrence Carin,et al.  Infinite Hidden Markov Models for Unusual-Event Detection in Video , 2008, IEEE Transactions on Image Processing.

[29]  Shehzad Khalid,et al.  Classifying spatiotemporal object trajectories using unsupervised learning in the coefficient feature space , 2006, Multimedia Systems.

[30]  Mohan M. Trivedi,et al.  Novel concepts and challenges for the next generation of video surveillance systems , 2007, Machine Vision and Applications.

[31]  Ivan W. Selesnick,et al.  Efficient and Robust Image Restoration Using Multiple-Feature L2-Relaxed Sparse Analysis Priors , 2015, IEEE Transactions on Image Processing.

[32]  Tieniu Tan,et al.  A system for learning statistical motion patterns , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  D. Kibler,et al.  Instance-based learning algorithms , 2004, Machine Learning.

[34]  Gian Luca Foresti,et al.  Trajectory-Based Anomalous Event Detection , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[35]  Gian Luca Foresti,et al.  On-line trajectory clustering for anomalous events detection , 2006, Pattern Recognit. Lett..

[36]  Joel A. Tropp,et al.  Algorithms for simultaneous sparse approximation. Part I: Greedy pursuit , 2006, Signal Process..

[37]  Raja Bala,et al.  Adaptive Sparse Representations for Video Anomaly Detection , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[38]  Junsong Yuan,et al.  Abnormal event detection in crowded scenes using sparse representation , 2013, Pattern Recognit..

[39]  Rick Chartrand,et al.  Nonconvex Regularization for Shape Preservation , 2007, 2007 IEEE International Conference on Image Processing.

[40]  Ian H. Witten,et al.  Data mining: practical machine learning tools and techniques with Java implementations , 2002, SGMD.

[41]  Emmanuel J. Candès,et al.  Decoding by linear programming , 2005, IEEE Transactions on Information Theory.

[42]  W. Eric L. Grimson,et al.  Trajectory Analysis and Semantic Region Modeling Using Nonparametric Hierarchical Bayesian Models , 2011, International Journal of Computer Vision.

[43]  Nii Attoh-Okine,et al.  Traffic Sign Recognition Using Sparse Representations and Active Contour Models , 2014 .

[44]  David C. Hogg,et al.  Learning the Distribution of Object Trajectories for Event Recognition , 1995, BMVC.

[45]  Rick Chartrand,et al.  Exact Reconstruction of Sparse Signals via Nonconvex Minimization , 2007, IEEE Signal Processing Letters.