Multiple Quantization Parameter Optimization in Versatile Video Coding for 360° Videos

Consumer Electronics (CE) devices have started to support 360° videos in order to improve the perceived video quality by consumers. Higher compression in 360° videos not only lead to improved consumer perception, but also efficient energy and storage usage in CE devices. Consequently, efficient compression of such video content is becoming a critical design consideration of CE devices. To this end, this paper first proposes a residual weighting algorithm that utilizes the features of Weighted Craster Parabolic Projection Peak Signal-to-Noise Ratio (WCPPPSNR), to instigate the first stage of magnitude reduction of the residuals. The model parameters associated with the residual weighting algorithm are determined in the initial experimental stage. Next, the paper proposes a Quantization Parameter (QP) optimization technique which introduces the second stage of magnitude reduction for residuals with minimal impact on the overall video quality. The proposed method is tested on the Versatile Video Coding (VVC) test model with All-Intra configuration. In this context, the empirical results demonstrate that the proposed method improves the coding efficiency by 3.34% on average and outperforms the state-of-the-art techniques.

[1]  Warnakulasuriya Anil Chandana Fernando,et al.  Evaluation of Modifications to CPPPSNR in 360° Video Quality Assessment , 2019, 2019 27th European Signal Processing Conference (EUSIPCO).

[2]  Yan Ye,et al.  An evaluation framework for 360-degree video compression , 2017, 2017 IEEE Visual Communications and Image Processing (VCIP).

[3]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[4]  Yiming Li,et al.  Spherical domain rate-distortion optimization for 360-degree video coding , 2017, 2017 IEEE International Conference on Multimedia and Expo (ICME).

[5]  Gwendal Simon,et al.  Viewport-adaptive navigable 360-degree video delivery , 2016, 2017 IEEE International Conference on Communications (ICC).

[6]  Shan Liu,et al.  Recent advances in video coding beyond the HEVC standard , 2019, APSIPA Transactions on Signal and Information Processing.

[7]  Anh T. Pham,et al.  Adaptive streaming of audiovisual content using MPEG DASH , 2012, IEEE Transactions on Consumer Electronics.

[8]  Yan Ye,et al.  An adaptive quantization method for 360-degree video coding , 2018, Optical Engineering + Applications.

[9]  G. Bjontegaard,et al.  Calculation of Average PSNR Differences between RD-curves , 2001 .

[10]  Yan Ye,et al.  Motion compensated prediction with geometry padding for 360 video coding , 2017, 2017 IEEE Visual Communications and Image Processing (VCIP).

[11]  Vladyslav Zakharchenko,et al.  Quality metric for spherical panoramic video , 2016, Optical Engineering + Applications.

[12]  Jisheng Li,et al.  Novel tile segmentation scheme for omnidirectional video , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[13]  Xiaokang Yang,et al.  The SJTU UHD 360-Degree Immersive Video Sequence Dataset , 2017, 2017 International Conference on Virtual Reality and Visualization (ICVRV).

[14]  Lu Yu,et al.  Weighted-to-Spherically-Uniform Quality Evaluation for Omnidirectional Video , 2017, IEEE Signal Processing Letters.

[15]  Wei Dai,et al.  Performance comparison of VVC, AV1, and HEVC on 8-bit and 10-bit content , 2018, Optical Engineering + Applications.

[16]  Philip Rosedale,et al.  Virtual Reality: The Next Disruptor: A new kind of worldwide communication , 2017, IEEE Consumer Electronics Magazine.

[17]  Miska M. Hannuksela,et al.  Standardization status of 360 degree video coding and delivery , 2017, 2017 IEEE Visual Communications and Image Processing (VCIP).

[18]  Chae-Bong Sohn,et al.  HLS-based 360 VR using spatial segmented adaptive streaming , 2018, 2018 IEEE International Conference on Consumer Electronics (ICCE).

[19]  M. Chavarrías,et al.  A 2-D Multiple Transform Processor for the Versatile Video Coding Standard , 2019, IEEE Transactions on Consumer Electronics.

[20]  Bernd Girod,et al.  A Framework to Evaluate Omnidirectional Video Coding Schemes , 2015, 2015 IEEE International Symposium on Mixed and Augmented Reality.

[21]  Yiming Li,et al.  Recent advances in omnidirectional video coding for virtual reality: Projection and evaluation , 2018, Signal Process..

[22]  Madhukar Budagavi,et al.  360 degrees video coding using region adaptive smoothing , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[23]  Mohamed Hefeeda,et al.  Streaming Virtual Reality Content , 2016, ArXiv.

[24]  Narciso García,et al.  Evaluation of 360VR cinemat1ic stereoscopic DASH service , 2017, 2017 IEEE International Conference on Consumer Electronics (ICCE).