Efficient Region-of-Interest Scalable Video Coding with Adaptive Bit-Rate Control

This work relates to the regions-of-interest (ROI) coding that is a desirable feature in future applications based on the scalable video coding, which is an extension of the H.264/MPEG-4 AVC standard. Due to the dramatic technological progress, there is a plurality of heterogeneous devices, which can be used for viewing a variety of video content. Devices such as smartphones and tablets are mostly resource-limited devices, which make it difficult to display high-quality content. Usually, the displayed video content contains one or more ROI(s), which should be adaptively selected from the preencoded scalable video bitstream. Thus, an efficient scalable ROI video coding scheme is proposed in this work, thereby enabling the extraction of the desired regions-of-interest and the adaptive setting of the desirable ROI location, size, and resolution. In addition, an adaptive bit-rate control is provided for the region-of-interest scalable video coding. The performance of the presented techniques is demonstrated and compared with the joint scalable video model reference software (JSVM 9.19), thereby showing significant bit-rate savings as a tradeoff for the relatively low PSNR degradation.

[1]  Ming-Chieh Chi,et al.  ROI video coding based on H.263+ with robust skin-color detection technique , 2003, IEEE Trans. Consumer Electron..

[2]  Daniele Alfonso,et al.  Constant Quality Variable Bit-Rate control for SVC , 2010, 11th International Workshop on Image Analysis for Multimedia Interactive Services WIAMIS 10.

[3]  Gary J. Sullivan,et al.  Rate-constrained coder control and comparison of video coding standards , 2003, IEEE Trans. Circuits Syst. Video Technol..

[4]  Boris Mansencal,et al.  Multiple Moving Object Detection for Fast Video Content Description in Compressed Domain , 2008, EURASIP J. Adv. Signal Process..

[5]  Wen Gao,et al.  Robust moving object segmentation on H.264/AVC compressed video using the block-based MRF model , 2005, Real Time Imaging.

[6]  Hamid R. Rabiee,et al.  Rate-distortion optimization of scalable video codecs , 2010, Signal Process. Image Commun..

[7]  Ofer Hadar,et al.  Optimization Methods for H.264/AVC Video Coding , 2010 .

[8]  Yiqiang Zhan,et al.  Rapid Object Tracking on Compressed Video , 2001, IEEE Pacific Rim Conference on Multimedia.

[9]  Ofer Hadar,et al.  Adaptive bit-rate control for Region-of-Interest Scalable Video Coding , 2010, 2010 IEEE 26-th Convention of Electrical and Electronics Engineers in Israel.

[10]  Dorin Comaniciu,et al.  Real-time tracking of non-rigid objects using mean shift , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[11]  Ofer Hadar,et al.  Dynamic Computational Complexity and Bit Allocation for Optimizing H.264/AVC Video Compression , 2006, 2006 International Conference on Information Technology: Research and Education.

[12]  Jérôme Viéron,et al.  Extended Spatial Scalability : A Generalization of Spatial Scalability for Non Dyadic Configurations , 2006, 2006 International Conference on Image Processing.

[13]  T. Ogunfunmi,et al.  On the performance of a 3D flexible macroblock ordering for H.264/AVC , 2006, 2006 Digest of Technical Papers International Conference on Consumer Electronics.

[14]  Wen Gao,et al.  Rate control for scalable video model , 2005, Visual Communications and Image Processing.

[15]  Ofer Hadar,et al.  Complexity-aware adaptive spatial pre-processing for ROI scalable video coding with dynamic transition region , 2011, 2011 18th IEEE International Conference on Image Processing.

[16]  Liang-Tien Chia,et al.  Detection of visual attention regions in images using robust subspace analysis , 2008, J. Vis. Commun. Image Represent..

[17]  Ajay Luthra,et al.  Overview of the H.264/AVC video coding standard , 2003, IEEE Trans. Circuits Syst. Video Technol..

[18]  Ofer Hadar,et al.  Advances in Region-of-Interest Video and Image Processing , 2013 .

[19]  Anni Cai,et al.  Efficient residual prediction with error concealment in extended spatial scalability , 2010, 2010 Wireless Telecommunications Symposium (WTS).

[20]  Ofer Hadar,et al.  Efficient adaptive bit-rate control for Scalable Video Coding by using Computational Complexity-Rate-Distortion analysis , 2011, 2011 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB).

[21]  Jordi Ribas-Corbera,et al.  A generalized hypothetical reference decoder for H.264/AVC , 2003, IEEE Trans. Circuits Syst. Video Technol..

[22]  Ruimin Hu,et al.  Adaptive FMO selection strategy for error resilient H.264 coding , 2008, 2008 International Conference on Audio, Language and Image Processing.

[23]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[24]  Munchurl Kim,et al.  Moving Object Tracking in H.264/AVC Bitstream , 2007, MCAM.

[25]  Warnakulasuriya Anil Chandana Fernando,et al.  Unequal Error Protection Technique for ROI Based H.264 Video Coding , 2006, 2006 Canadian Conference on Electrical and Computer Engineering.

[26]  Ofer Hadar,et al.  Region-of-Interest Processing and Coding Techniques: Overview of Recent Trends and Directions , 2013 .

[27]  Susanto Rahardja,et al.  New Framework for Encoder Optimization of Scalable Video Coding , 2007, 2007 IEEE Workshop on Signal Processing Systems.

[28]  Zhengguo Li,et al.  Rate Control of H.264/AVC Scalable Extension , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[29]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[30]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1995, EuroCOLT.

[31]  Ofer Hadar,et al.  Recent trends in online mutimedia education for heterogeneous end-user devices based on Scalable Video Coding , 2013, 2013 IEEE Global Engineering Education Conference (EDUCON).

[32]  Ofer Hadar,et al.  Recent Advances in Region-of-interest Video Coding , 2011 .

[33]  Heiko Schwarz,et al.  Overview of the Scalable Video Coding Extension of the H.264/AVC Standard , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[34]  Ofer Hadar,et al.  Dynamically adjustable and scalable ROI video coding , 2010, 2010 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB).

[35]  Xiuzi Ye,et al.  Error resilience schemes of H.264/AVC for 3G conversational video services , 2005, The Fifth International Conference on Computer and Information Technology (CIT'05).

[36]  Charles D. Creusere,et al.  Tracking of extended size targets in H.264 compressed video using the probabilistic data association filter , 2004, 2004 12th European Signal Processing Conference.

[37]  Henri Nicolas,et al.  Compressed domain indexing of scalable H.264/SVC streams , 2009, Signal Process. Image Commun..

[38]  Wesley De Neve,et al.  A real-time content adaptation framework for exploiting ROI scalability in H.264/AVC , 2006 .

[39]  Tihao Chiang,et al.  A new rate control scheme using quadratic rate distortion model , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[40]  Ofer Hadar,et al.  Buffer control in H.264/AVC applications by implementing dynamic complexity-rate-distortion analysis , 2009, 2009 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting.

[41]  T. Wiegand,et al.  Text Description of Joint Model Reference Encoding Methods and Decoding Concealment Methods , 2004 .

[42]  Ofer Hadar,et al.  ROI adaptive scalable video coding for limited bandwidth wireless networks , 2010, 2010 IFIP Wireless Days.