Complexity-Aware Adaptive Preprocessing Scheme for Region-of-Interest Spatial Scalable Video Coding

This paper presents a complexity-aware adaptive spatial preprocessing scheme for the efficient scalable video coding (SVC) by employing an adaptive prefilter for each SVC layer. According to the presented scheme, a dynamic transition region is defined between the region of interest (ROI) and background within each video frame, and then various parameters of each prefilter (such as the standard deviation, kernel matrix size, and also a number of filters for the dynamic preprocessing of a transition region between the ROI and the background) are adaptively varied. The presented scheme has proved to be very efficient because it is based on an SVC computational complexity-rate-distortion analysis, thereby adding a complexity dimension to the conventional SVC rate-distortion analysis. As a result, the encoding computational complexity resources are significantly reduced, which is especially useful for portable encoders with limited power resources. The performance of the presented adaptive spatial preprocessing scheme is evaluated and tested in detail from both computational complexity and visual presentation quality points of view, further comparing it with the joint scalable video model reference software (JSVM 9.19) and demonstrating significant improvements.

[1]  Wesley De Neve,et al.  A Real-Time Content Adaptation Framework for Exploiting ROI Scalability in H.264/AVC , 2006, ACIVS.

[2]  Ajay Luthra,et al.  Overview of the H.264/AVC video coding standard , 2003, IEEE Trans. Circuits Syst. Video Technol..

[3]  Ofer Hadar,et al.  Efficient adaptive bit-rate control for Scalable Video Coding by using Computational Complexity-Rate-Distortion analysis , 2011, 2011 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB).

[4]  Boris Mansencal,et al.  Multiple Moving Object Detection for Fast Video Content Description in Compressed Domain , 2008, EURASIP J. Adv. Signal Process..

[5]  Jo Yew Tham,et al.  Complexity control and computational resource allocation during H.264/SVC encoding , 2009, MM '09.

[6]  Gary J. Sullivan,et al.  Rate-constrained coder control and comparison of video coding standards , 2003, IEEE Trans. Circuits Syst. Video Technol..

[7]  Ofer Hadar,et al.  Dynamic Computational Complexity and Bit Allocation for Optimizing H.264/AVC Video Compression , 2006, 2006 International Conference on Information Technology: Research and Education.

[8]  Tong Gan,et al.  Rate-distortion-complexity performance analysis of the SVC decoder , 2009, 2009 IEEE International Conference on Multimedia and Expo.

[9]  Ishfaq Ahmad,et al.  Power-rate-distortion analysis for wireless video communication under energy constraints , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[10]  Ramya Gopalan Exploiting Region Of Interest For Improved Video Coding , 2009 .

[11]  Munchurl Kim,et al.  Moving Object Tracking in H.264/AVC Bitstream , 2007, MCAM.

[12]  Ming-Ting Sun,et al.  A Computation Control Motion Estimation Method for Complexity-Scalable Video Coding , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[13]  Gianluigi Ferrari,et al.  Extraction of video features for real-time detection of neonatal seizures , 2011, 2011 IEEE International Symposium on a World of Wireless, Mobile and Multimedia Networks.

[14]  Heiko Schwarz,et al.  Overview of the Scalable Video Coding Extension of the H.264/AVC Standard , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[15]  Mårten Sjöström,et al.  Improved ROI video coding using variable Gaussian pre-filters and variance in intensity , 2005, IEEE International Conference on Image Processing 2005.

[16]  Ofer Hadar,et al.  Complexity-aware adaptive bit-rate control with dynamic ROI pre-processing for scalable video coding , 2011, 2011 IEEE International Conference on Multimedia and Expo.

[17]  Detlev Marpe,et al.  Network-optimized adaptive SVC-based live video streaming , 2013, 2013 IEEE Third International Conference on Consumer Electronics ¿ Berlin (ICCE-Berlin).

[18]  Ofer Hadar,et al.  Recent trends in online mutimedia education for heterogeneous end-user devices based on Scalable Video Coding , 2013, 2013 IEEE Global Engineering Education Conference (EDUCON).

[19]  Mark Colbert Adaptive Block-based Image Coding with Pre-/ post-filtering , 2005 .

[20]  Laurent Itti,et al.  Automatic foveation for video compression using a neurobiological model of visual attention , 2004, IEEE Transactions on Image Processing.

[21]  Ofer Hadar,et al.  Live video streaming with adaptive pre-processing by using scalable video coding , 2013, 2013 IEEE International Conference on Consumer Electronics (ICCE).

[22]  Zengping Chen,et al.  A real-time target detection algorithm for Infrared Search and track system based on ROI extraction , 2012 .

[23]  Trac D. Tran,et al.  Lapped transform via time-domain pre- and post-filtering , 2003, IEEE Trans. Signal Process..

[24]  Ofer Hadar,et al.  Enhancement of an image compression algorithm by pre- and post-filtering , 2001 .

[25]  Ofer Hadar,et al.  Complexity-aware adaptive spatial pre-processing for ROI scalable video coding with dynamic transition region , 2011, 2011 18th IEEE International Conference on Image Processing.

[26]  Ofer Hadar,et al.  Optimization Methods for H.264/AVC Video Coding , 2010 .

[27]  Ofer Hadar,et al.  Efficient Region-of-Interest Scalable Video Coding with Adaptive Bit-Rate Control , 2013, Adv. Multim..

[28]  Heiko Schwarz,et al.  Context-based adaptive binary arithmetic coding in the H.264/AVC video compression standard , 2003, IEEE Trans. Circuits Syst. Video Technol..

[29]  Zhan Ma,et al.  Complexity modeling of scalable video decoding , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[30]  Andrea Vitali,et al.  Performance analysis of the scalable video coding standard , 2007, Packet Video 2007.