ViTrack: Efficient Tracking on the Edge for Commodity Video Surveillance Systems

Nowadays, video surveillance systems are widely deployed in various places, e.g., schools, parks, airports, roads, etc. However, existing video surveillance systems are far from full utilization due to high computation overhead in video processing. In this work, we present ViTrack, a framework for efficient multi-video tracking using computation resource on the edge for commodity video surveillance systems. In the heart of ViTrack lies a two layer spatial/temporal compressive target detection method to significantly reduce the computation overhead by combining videos from multiple cameras. Further, ViTrack derives the video relationship and camera information even in absence of camera location, direction, etc. To address variant video quality and missing targets, ViTrack leverages a Markov Model based approach to efficiently recover missing information and finally derive the complete trajectory. We implement ViTrack on a real deployed video surveillance system with 110 cameras. The experiment results demonstrate that ViTrack can provide efficient trajectory tracking with processing time 45x less than the existing approach. For 110 video cameras, ViTrack can run on a Dell OptiPlex 390 computer to track given targets in almost real time. We believe ViTrack can enable practical video analysis for widely deployed commodity video surveillance systems.

[1]  Venkat Chandrasekaran,et al.  Recovery of Sparse Probability Measures via Convex Programming , 2012, NIPS.

[2]  Joel A. Tropp,et al.  Signal Recovery From Random Measurements Via Orthogonal Matching Pursuit , 2007, IEEE Transactions on Information Theory.

[3]  Michele Zorzi,et al.  On the interplay between routing and signal representation for Compressive Sensing in wireless sensor networks , 2009, 2009 Information Theory and Applications Workshop.

[4]  Horst Bischof,et al.  Real-Time License Plate Recognition on an Embedded DSP-Platform , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[5]  Emmanuel J. Candès,et al.  Decoding by linear programming , 2005, IEEE Transactions on Information Theory.

[6]  Pramod K. Varshney,et al.  Compressive Sensing Based Probabilistic Sensor Management for Target Tracking in Wireless Sensor Networks , 2015, IEEE Transactions on Signal Processing.

[7]  Emmanuel J. Candès,et al.  Near-Optimal Signal Recovery From Random Projections: Universal Encoding Strategies? , 2004, IEEE Transactions on Information Theory.

[8]  Abdul Wahid Memon,et al.  Machine Learning based Number Plate Detection and Recognition , 2016, ICPRAM.

[9]  S. Frick,et al.  Compressed Sensing , 2014, Computer Vision, A Reference Guide.

[10]  Frédéric Lerasle,et al.  A particle swarm optimization inspired tracker applied to visual tracking , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[11]  Mingyan Liu,et al.  In-situ soil moisture sensing: Measurement scheduling and estimation using compressive sensing , 2012, 2012 ACM/IEEE 11th International Conference on Information Processing in Sensor Networks (IPSN).

[12]  Wei-Chang Yeh,et al.  A categorized particle swarm optimization for object tracking , 2015, 2015 IEEE Congress on Evolutionary Computation (CEC).

[13]  Chunhua Shen,et al.  Real-time visual tracking using compressive sensing , 2011, CVPR 2011.

[14]  Bhaskar D. Rao,et al.  Sparse signal reconstruction from limited data using FOCUSS: a re-weighted minimum norm algorithm , 1997, IEEE Trans. Signal Process..

[15]  Keqin Li,et al.  Energy Confirmable Overlapping Target Tracking Based on Compressive Sensing in Wireless Sensor Networks , 2016, Ad Hoc Sens. Wirel. Networks.

[16]  Jiping Sun,et al.  Real-time multi-scale tracking based on compressive sensing , 2014, The Visual Computer.

[17]  D. Donoho.  For most large underdetermined systems of linear equations the minimal 𝓁1‐norm solution is also the sparsest solution , 2006 .

[18]  Young-June Choi,et al.  Sparse Signal Recovery by Stepwise Subspace Pursuit in Compressed Sensing , 2013, Int. J. Distributed Sens. Networks.