Highway Vehicle Counting in Compressed Domain

This paper presents a highway vehicle counting method in compressed domain, aiming at achieving acceptable estimation performance approaching the pixel-domain methods. Such a task essentially is challenging because the available information (e.g. motion vector) to describe vehicles in videos is quite limited and inaccurate, and the vehicle count in realistic traffic scenes always varies greatly. To tackle this issue, we first develop a batch of low-level features, which can be extracted from the encoding metadata of videos, to mitigate the informational insufficiency of compressed videos. Then we propose a Hierarchical Classification based Regression (HCR) model to estimate the vehicle count from features. HCR hierarchically divides the traffic scenes into different cases according to vehicle density, such that the broad-variation characteristics of traffic scenes can be better approximated. Finally, we evaluated the proposed method on the real highway surveillance videos. The results show that our method is very competitive to the pixel-domain methods, which can reach similar performance along with its lower complexity.

[1]  Uwe Krüger,et al.  Semisupervised Pedestrian Counting With Temporal and Spatial Consistencies , 2015, IEEE Transactions on Intelligent Transportation Systems.

[2]  Shaogang Gong,et al.  Feature Mining for Localised Crowd Counting , 2012, BMVC.

[3]  Munchurl Kim,et al.  Moving Object Detection and Tracking Using a Spatio-Temporal Graph in H.264/AVC Bitstreams for Video Surveillance , 2012, IEEE Transactions on Multimedia.

[4]  A.B. Chan,et al.  Classification and retrieval of traffic video using auto-regressive stochastic processes , 2005, IEEE Proceedings. Intelligent Vehicles Symposium, 2005..

[5]  F. Porikli,et al.  Traffic congestion estimation using HMM models without vehicle tracking , 2004, IEEE Intelligent Vehicles Symposium, 2004.

[6]  Richard P. Wildes,et al.  Classification of traffic video based on a spatiotemporal orientation analysis , 2011, 2011 IEEE Workshop on Applications of Computer Vision (WACV).

[7]  Qi Tian,et al.  An algorithm to estimate mean vehicle speed from MPEG Skycam video , 2007, Multimedia Tools and Applications.

[8]  Lei Huang,et al.  Advanced Local Binary Pattern Descriptors for Crowd Estimation , 2008, 2008 IEEE Pacific-Asia Workshop on Computational Intelligence and Industrial Application.

[9]  Sridha Sridharan,et al.  An evaluation of crowd counting methods, features and regression models , 2015, Comput. Vis. Image Underst..

[10]  Serge J. Belongie,et al.  Counting Crowded Moving Objects , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[11]  Andrew Zisserman,et al.  Learning To Count Objects in Images , 2010, NIPS.

[12]  Xiaogang Wang,et al.  Counting Vehicles from Semantic Regions , 2013, IEEE Transactions on Intelligent Transportation Systems.

[13]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[15]  Ivan V. Bajic,et al.  Video Object Tracking in the Compressed Domain Using Spatio-Temporal Markov Random Fields , 2013, IEEE Transactions on Image Processing.

[16]  A. Marana,et al.  Estimation of crowd density using image processing , 1997 .

[17]  Srinivas S. Kruthiventi,et al.  Crowd flow segmentation in compressed domain using CRF , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[18]  Nuno Vasconcelos,et al.  Privacy preserving crowd monitoring: Counting people without people models or tracking , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[19]  Ming Tang,et al.  Hierarchical and Networked Vehicle Surveillance in ITS: A Survey , 2015, IEEE Transactions on Intelligent Transportation Systems.

[20]  Bernhard Rinner,et al.  Efficient Level of Service Classification for Traffic Monitoring in the Compressed Video Domain , 2012, 2012 IEEE International Conference on Multimedia and Expo.

[21]  Pietro Perona,et al.  Pedestrian Detection: An Evaluation of the State of the Art , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Shaogang Gong,et al.  From Semi-supervised to Transfer Counting of Crowds , 2013, 2013 IEEE International Conference on Computer Vision.

[23]  Xiaogang Wang,et al.  Cross-scene crowd counting via deep convolutional neural networks , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[24]  Shaogang Gong,et al.  Crowd Counting and Profiling: Methodology and Evaluation , 2013, Modeling, Simulation and Visual Analysis of Crowds.

[25]  Ajay Luthra,et al.  Overview of the H.264/AVC video coding standard , 2003, IEEE Trans. Circuits Syst. Video Technol..

[26]  Dinesh Manocha,et al.  Modeling, Simulation and Visual Analysis of Crowds , 2013, The International Series in Video Computing.

[27]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[28]  M. Tekalp,et al.  Automatic Vehicle Counting from Video for Traffic Flow Analysis , 2007, 2007 IEEE Intelligent Vehicles Symposium.

[29]  R. Venkatesh Babu,et al.  A survey on compressed domain video analysis techniques , 2014, Multimedia Tools and Applications.

[30]  Liang Wang,et al.  Semi-supervised Elastic net for pedestrian counting , 2011, Pattern Recognit..

[31]  Sergio A. Velastin,et al.  Crowd monitoring using image processing , 1995 .

[32]  Ajay Luthra,et al.  Overview of the H.264/AVC video coding standard , 2003, SPIE Optics + Photonics.

[33]  David A. McAllester,et al.  Object Detection with Discriminatively Trained Part Based Models , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[34]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[35]  Shih-Chia Huang,et al.  Automatic Moving Object Extraction Through a Real-World Variable-Bandwidth Network for Traffic Monitoring Systems , 2014, IEEE Transactions on Industrial Electronics.

[36]  Alade O. Tokuta,et al.  Counting and Classification of Highway Vehicles by Regression Analysis , 2015, IEEE Transactions on Intelligent Transportation Systems.