Effective moving object detection in H.264/AVC compressed domain for video surveillance

In this paper a novel approach is presented to detect moving object in H.264/AVC compressed domain for video surveillance applications. The proposed algorithm utilizes the information from the H.264 compressed bit stream to reduce the computational complexity and memory requirements. In order to exploit the spatial and temporal consistency of moving object, a Markov Random Field (MRF) model is employed to detect and segment moving object based on motion vectors and quantization parameters (QP). The size of the blocks (in bits) are also used to improve the detection result. Experiments show good performance achieved by the algorithm, and the moving object can be detected effectively from the compressed video sequence.

[1]  Parvaneh Saeedi,et al.  Moving Region Segmentation From Compressed Video Using Global Motion Estimation and Markov Random Fields , 2011, IEEE Transactions on Multimedia.

[2]  André Kaup,et al.  Compressed domain moving object detection by spatio-temporal analysis of H.264/AVC syntax elements , 2015, 2015 Picture Coding Symposium (PCS).

[3]  Raúl Mohedano,et al.  Statistical moving object detection for mobile devices with camera , 2015, 2015 IEEE International Conference on Consumer Electronics (ICCE).

[4]  R. Venkatesh Babu,et al.  Fast moving-object detection in H.264/AVC compressed domain for video surveillance , 2013, 2013 Fourth National Conference on Computer Vision, Pattern Recognition, Image Processing and Graphics (NCVPRIPG).

[5]  Debin Zhao,et al.  Real-Time Moving Object Segmentation and Classification From HEVC Compressed Surveillance Video , 2018, IEEE Transactions on Circuits and Systems for Video Technology.

[6]  Zheng Pan,et al.  A NOVEL FAST FRACTAL IMAGE COMPRESSION METHOD BASED ON DISTANCE CLUSTERING IN HIGH DIMENSIONAL SPHERE SURFACE , 2017 .

[7]  Søren Forchhammer,et al.  Fast Compressed Domain Motion Detection in H.264 Video Streams for Video Surveillance Applications , 2009, 2009 Sixth IEEE International Conference on Advanced Video and Signal Based Surveillance.

[8]  R. Venkatesh Babu,et al.  Anomaly detection in compressed H.264/AVC video , 2015, Multimedia Tools and Applications.

[9]  KokSheik Wong,et al.  Moving object detection in HEVC video by frame sub-sampling , 2015, 2015 International Symposium on Intelligent Signal Processing and Communication Systems (ISPACS).

[10]  Ahad Karimi Moridani,et al.  Vehicle Detection and Tracking in Roadway Traffic Analysis using Kalman Filter and Features , 2015 .

[11]  Jung-San Lee,et al.  Selective scalable secret image sharing with verification , 2015, Multimedia Tools and Applications.

[12]  Peter Lambert,et al.  Moving object detection in the H.264/AVC compressed domain for video surveillance applications , 2009, J. Vis. Commun. Image Represent..

[13]  Ivan V. Bajic,et al.  Video Object Tracking in the Compressed Domain Using Spatio-Temporal Markov Random Fields , 2013, IEEE Transactions on Image Processing.

[14]  Stan Z. Li,et al.  Markov Random Field Modeling in Image Analysis , 2001, Computer Science Workbench.

[15]  Wen Gao,et al.  Robust moving object segmentation on H.264/AVC compressed video using the block-based MRF model , 2005, Real Time Imaging.

[16]  R. Venkatesh Babu,et al.  A survey on compressed domain video analysis techniques , 2014, Multimedia Tools and Applications.

[17]  Francesco G. B. De Natale,et al.  Real-time moving object detection and segmentation in H.264 video streams , 2017, 2017 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB).

[18]  Athanassios N. Skodras,et al.  Moving object detection in the H.264 compressed domain , 2010, 2010 IEEE International Conference on Imaging Systems and Techniques.

[19]  R. Venkatesh Babu,et al.  Video object segmentation: a compressed domain approach , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[20]  Yi Deng,et al.  A Moving Object Segmentation in MPEG Compressed Domain Based on Motion Vectors and DCT Coefficients , 2008, 2008 Congress on Image and Signal Processing.

[21]  C.-M. Mak,et al.  Real-time video object segmentation in H.264 compressed domain , 2009, IET Image Process..

[22]  Steven Verstockt,et al.  Moving object detection in the HEVC compressed domain for ultra-high-resolution interactive video , 2017, 2017 IEEE International Conference on Consumer Electronics (ICCE).

[23]  J. Besag On the Statistical Analysis of Dirty Pictures , 1986 .

[24]  Shuai Liu,et al.  A review of visual moving target tracking , 2017, Multimedia Tools and Applications.