Optimal SP frame selection and bit budget allocation for mobile H.264 video streaming

Mobile video streaming services are challenging, as they obey several system constraints, such as random access facilities, efficient server storage, and flexible rate adaptation. Rate adaptation can be performed by means of seamless switching among different encoded bitstreams. The H.264 video coding standard explicitly supports bitstream switching using specific frame coding modes, namely switching pictures (SP). Locations of SP frames affect the overall bit rate and quality of streamed video. In this study, we address the issue of optimal joint selection of the SP frames locations and bit budget allocation at frame layer. The optimization is carried out via a game theoretic approach under assigned system constraints on the overall streaming rate and the maximum random access delay. Numerical simulations show that our frame layer optimal encoding procedure brings advantages in terms of several characteristics of the streamed video, encompassing enhanced rate-distortion, reduced transmission buffer occupancy, equalization of the transmission delays, and more efficient switching.

[1]  Bo Shen,et al.  Methods to Improve Coding Efficiency of SP Frames , 2006, 2006 International Conference on Image Processing.

[2]  J. Nash.  Two-Person Cooperative Games , 1953 .

[3]  Ian F. Akyildiz,et al.  Wireless Multimedia Sensor Networks: Applications and Testbeds , 2008, Proceedings of the IEEE.

[4]  Byeungwoo Jeon,et al.  Fast Coding Mode Selection With Rate-Distortion Optimization for MPEG-4 Part-10 AVC/H.264 , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[5]  Marta Karczewicz,et al.  The SP- and SI-frames design for H.264/AVC , 2003, IEEE Trans. Circuits Syst. Video Technol..

[6]  A. F. Adams,et al.  The Survey , 2021, Dyslexia in Higher Education.

[7]  Yui-Lam Chan,et al.  Viewpoint switching in multiview videos using SP-frames , 2008, 2008 15th IEEE International Conference on Image Processing.

[8]  Chia-Wen Lin,et al.  R-D optimized quantization of H.264 SP-frames for bitstream switching under storage constraints , 2005, 2005 IEEE International Symposium on Circuits and Systems.

[9]  Yui-Lam Chan,et al.  Quantized Transform-Domain Motion Estimation for SP-Frame Coding in Viewpoint Switching of Multiview Video , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[10]  Gene Cheung,et al.  SP-frame selection for video streaming over burst-loss networks , 2005, Seventh IEEE International Symposium on Multimedia (ISM'05).

[11]  Stefania Colonnese,et al.  Optimal video coding for bit-rate switching applications: a game-theoretic approach , 2007, 2007 IEEE International Symposium on a World of Wireless, Mobile and Multimedia Networks.

[12]  Philip A. Chou,et al.  Rate-distortion optimized streaming of packetized media , 2006, IEEE Transactions on Multimedia.

[13]  Mihaela van der Schaar,et al.  Streaming-Viability Analysis and Packet Scheduling for Video Over In-Vehicle Wireless Networks , 2007, IEEE Transactions on Vehicular Technology.

[14]  Wen Gao,et al.  The improved SP frame coding technique for the JVT standard , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[15]  Gene Cheung,et al.  Low-Latency Error Control of H.264 Using SP-Frames and Streaming Agent Over Wireless Networks , 2007, 2007 IEEE International Conference on Communications.

[16]  Thomas Maugey,et al.  Interactive multiview video system with non-complex navigation at the decoder , 2012, ArXiv.

[17]  Wen Gao,et al.  Rate-distortion analysis for H.264/AVC video coding and its application to rate control , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[18]  João Ascenso,et al.  Low complexity intra mode selection for efficient distributed video coding , 2009, 2009 IEEE International Conference on Multimedia and Expo.

[19]  Ishfaq Ahmad,et al.  On using game theory to optimize the rate control in video coding , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[20]  Muhammad Altaf,et al.  Efficient bitstream switching for streaming of H.264/AVC coded video , 2011, EURASIP J. Image Video Process..

[21]  Thomas Stockhammer,et al.  Optimized H.264/AVC-Based Bit Stream Switching for Mobile Video Streaming , 2006, EURASIP J. Adv. Signal Process..

[22]  Miska M. Hannuksela,et al.  Perceptual-based quality assessment for audio-visual services: A survey , 2010, Signal Process. Image Commun..

[23]  Bernd Girod,et al.  Rate-distortion analysis and streaming of SP and SI frames , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[24]  Mohammed Ghanbari,et al.  Adaptive video stream switching for an IEEE 802.16 channel , 2011, 2011 Wireless Advanced.

[25]  Rajiv Soundararajan,et al.  Study of Subjective and Objective Quality Assessment of Video , 2010, IEEE Transactions on Image Processing.