Real-time vehicle detection and counting in complex traffic scenes using background subtraction model with low-rank decomposition

Real-time vehicle counting can efficiently improve traffic control and management. Aiming to efficiently collect the real-time traffic information, the authors propose an effective vehicle counting system for detecting and tracking vehicles in complex traffic scenes. The proposed algorithm detects moving vehicles based on background subtraction method with `lowrank + sparse' decomposition. For accurately counting vehicles, an online Kalman filter algorithm is used to track the multiple moving objects and avoid counting one vehicle repeatedly. The proposed method is evaluated on three publicly available datasets, which include seven video sequences with various challenging scenes for detection performance evaluation, and another two video sequences for vehicle counting evaluation. The experimental results demonstrate a good performance of the proposed method in terms of both qualitative and quantitative evaluations.

[1]  John Wright,et al.  Robust Principal Component Analysis: Exact Recovery of Corrupted Low-Rank Matrices via Convex Optimization , 2009, NIPS.

[2]  Shuicheng Yan,et al.  Online Robust PCA via Stochastic Optimization , 2013, NIPS.

[3]  Fei-Yue Wang,et al.  Data-Driven Intelligent Transportation Systems: A Survey , 2011, IEEE Transactions on Intelligent Transportation Systems.

[4]  Paul Rodríguez,et al.  Automatic vehicle counting method based on principal component pursuit background modeling , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[5]  Pietro Perona,et al.  Pedestrian Detection: An Evaluation of the State of the Art , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Xiaowei Zhou,et al.  Moving Object Detection by Detecting Contiguous Outliers in the Low-Rank Representation , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Hong Zhang,et al.  COROLA: A Sequential Solution to Moving Object Detection Using Low-rank Approximation , 2015, Comput. Vis. Image Underst..

[8]  Sebastian Thrun,et al.  A probabilistic framework for car detection in images using context and scale , 2012, 2012 IEEE International Conference on Robotics and Automation.

[9]  Jan J. Koenderink,et al.  A Hitherto Unnoticed Singularity of Scale-Space , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  W. Eric L. Grimson,et al.  Adaptive background mixture models for real-time tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[11]  Omer Tanovic,et al.  Counting traffic using optical flow algorithm on video footage of a complex crossroad , 2010, Proceedings ELMAR-2010.

[12]  Larry S. Davis,et al.  Non-parametric Model for Background Subtraction , 2000, ECCV.

[13]  Yunsheng Zhang,et al.  Counting vehicles in urban traffic scenes using foreground time-spatial images , 2017 .

[14]  Brendt Wohlberg,et al.  Incremental Principal Component Pursuit for Video Background Modeling , 2015, Journal of Mathematical Imaging and Vision.

[15]  Umar Farooq,et al.  Vehicle Detection and Shape Recognition Using Optical Sensors: A Review , 2010, 2010 Second International Conference on Machine Learning and Computing.

[16]  Thierry Bouwmans,et al.  Robust PCA via Principal Component Pursuit: A review for a comparative evaluation in video surveillance , 2014, Comput. Vis. Image Underst..

[17]  Yi Ma,et al.  Robust principal component analysis? , 2009, JACM.

[18]  Yunsheng Zhang,et al.  Vehicles detection in complex urban traffic scenes using Gaussian mixture model with confidence measurement , 2016 .

[19]  Nikos Paragios,et al.  Background modeling and subtraction of dynamic scenes , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[20]  Andrew Blake,et al.  A Probabilistic Background Model for Tracking , 2000, ECCV.

[21]  Jie He,et al.  Vehicles detection in complex urban traffic scenes using a nonparametric approach with confidence measurement , 2015, 2015 International Conference and Workshop on Computing and Communication (IEMCON).

[22]  Jacob Scharcanski,et al.  A novel video based system for detecting and counting vehicles at user-defined virtual loops , 2015, Expert Syst. Appl..

[23]  Changshui Zhang,et al.  Front-view vehicle detection by Markov chain Monte Carlo method , 2009, Pattern Recognition.

[24]  Olga Veksler,et al.  Fast Approximate Energy Minimization via Graph Cuts , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[25]  Junzhou Huang,et al.  Background Subtraction Using Low Rank and Group Sparsity Constraints , 2012, ECCV.

[26]  Jacob Scharcanski,et al.  Tracking and counting vehicles in traffic video sequences using particle filtering , 2013, 2013 IEEE International Instrumentation and Measurement Technology Conference (I2MTC).

[27]  Victor Vianu,et al.  Invited articles section foreword , 2010, JACM.

[28]  Kuo-Chin Fan,et al.  Vehicle Detection Using Normalized Color and Edge Map , 2007, IEEE Transactions on Image Processing.

[29]  Dongmei Li,et al.  Real-time vehicles tracking based on Kalman filter in an ITS , 2007, Applied Optics and Photonics China.

[30]  Haiying Zhang,et al.  Overview of video-based vehicle detection technologies , 2011, 2011 6th International Conference on Computer Science & Education (ICCSE).

[31]  Xu Liu,et al.  Highway Vehicle Counting in Compressed Domain , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[32]  Serge J. Belongie,et al.  Counting Crowded Moving Objects , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[33]  Larry S. Davis,et al.  Background modeling and subtraction by codebook construction , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[34]  Reza Safabakhsh,et al.  Vehicle detection, counting and classification in various conditions , 2016 .

[35]  Xiaogang Wang,et al.  Cross-scene crowd counting via deep convolutional neural networks , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[36]  Bo Li,et al.  A multi-scale model integrating multiple features for vehicle detection , 2013, 16th International IEEE Conference on Intelligent Transportation Systems (ITSC 2013).

[37]  Oihana Otaegui,et al.  Adaptive Multicue Background Subtraction for Robust Vehicle Counting and Classification , 2012, IEEE Transactions on Intelligent Transportation Systems.

[38]  Fatih Murat Porikli,et al.  CDnet 2014: An Expanded Change Detection Benchmark Dataset , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[39]  Andrew Zisserman,et al.  Learning To Count Objects in Images , 2010, NIPS.

[40]  Antonio Fernández-Caballero,et al.  Vehicle Tracking by Simultaneous Detection and Viewpoint Estimation , 2013, IWINAC.

[41]  Fenghua Zhu,et al.  A survey of vision-based vehicle detection and tracking techniques in ITS , 2013, Proceedings of 2013 IEEE International Conference on Vehicular Electronics and Safety.