Fast sample adaptive offset algorithm for 360-degree video coding

Abstract 360-degree video is becoming popular with the development of the virtual reality(VR) technology in recent years. For this kind of video, pictures are projected to a two-dimensional plane. Standard video encoders are used for compression. Due to the projection mapping of the spherical video to the two-dimensional plane video, many conventional coding tools can be adjusted properly for better performance. As the 360-degree videos are high resolution videos, usually 8K resolution videos, the high complexity for encoding 360-degree videos is a problem to be solved urgently, especially for the latest video standard H.265/HEVC. Sample adaptive offset (SAO) is a new tool adopted in H.265/HEVC. It can reduce ringing artifacts and achieve higher coding efficiency. But it also introduces high computational complexity, especially on high resolution videos. In this paper, a fuzzy control based fast SAO method is proposed to reduce the high computational complexity in SAO encoding process according to the characteristics of the ERP format video. Compared with the original algorithm in the reference software HM 16.14, experimental results show that the proposed method can reduce about 73% SAO encoding time on average under the common test conditions with negligible loss.

[1]  Jerry M. Mendel,et al.  Fuzzy basis functions: comparisons with other basis functions , 1995, IEEE Trans. Fuzzy Syst..

[2]  Harry Shum,et al.  A virtual reality system using the concentric mosaic: construction, rendering, and data compression , 2005, IEEE Trans. Multim..

[3]  Byeungwoo Jeon,et al.  Complexity-Efficient Rate Estimation for Mode Decision of the HEVC Encoder , 2015, IEEE Transactions on Broadcasting.

[4]  Dan Simon,et al.  Fuzzy logic for digital phase-locked loop filter design , 1995, IEEE Trans. Fuzzy Syst..

[5]  Gary J. Sullivan,et al.  Overview of the High Efficiency Video Coding (HEVC) Standard , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[6]  Michael Riegler,et al.  Tiling in Interactive Panoramic Video: Approaches and Evaluation , 2016, IEEE Transactions on Multimedia.

[7]  Munchurl Kim,et al.  Efficient In-Loop Filtering Across Tile Boundaries for Multi-Core HEVC Hardware Decoders With 4 K/8 K-UHD Video Applications , 2015, IEEE Transactions on Multimedia.

[8]  Chia-Yang Tsai,et al.  Sample Adaptive Offset in the HEVC Standard , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[9]  Tien-Tsin Wong,et al.  Cube2Video: Navigate Between Cubic Panoramas in Real-Time , 2013, IEEE Transactions on Multimedia.

[10]  Weiwei Shen,et al.  A Combined Deblocking Filter and SAO Hardware Architecture for HEVC , 2016, IEEE Transactions on Multimedia.

[11]  Aggelos K. Katsaggelos,et al.  A multicamera setup for generating stereo panoramic video , 2005, IEEE Trans. Multim..

[12]  Tien-Tsin Wong,et al.  A system for real-time panorama generation and display in tele-immersive applications , 2005, IEEE Transactions on Multimedia.

[13]  Zongju Peng,et al.  Binary and Multi-Class Learning Based Low Complexity Optimization for HEVC Encoding , 2017, IEEE Transactions on Broadcasting.

[14]  Ravi Prakash,et al.  Adaptive 360-degree video streaming using layered video coding , 2017, 2017 IEEE Virtual Reality (VR).

[15]  JeongGil Ko,et al.  An Efficient Architecture of In-Loop Filters for Multicore Scalable HEVC Hardware Decoders , 2018, IEEE Transactions on Multimedia.

[16]  Jaehwan Joo,et al.  Exploration of Practical HEVC/H.265 Sample Adaptive Offset Encoding Policies , 2015, IEEE Signal Processing Letters.

[17]  Byeungwoo Jeon,et al.  Early Skip Mode Decision for HEVC Encoder With Emphasis on Coding Quality , 2015, IEEE Transactions on Broadcasting.

[18]  Michael Yuen,et al.  A survey of hybrid MC/DPCM/DCT video coding distortions , 1998, Signal Process..

[19]  James C. Bezdek,et al.  Fuzzy models—What are they, and why? [Editorial] , 1993, IEEE Transactions on Fuzzy Systems.

[20]  Susanto Rahardja,et al.  Fast Coding Quad-Tree Decisions Using Prediction Residuals Statistics for High Efficiency Video Coding (HEVC) , 2016, IEEE Transactions on Broadcasting.

[21]  Satoshi Goto,et al.  A Dual-Clock VLSI Design of H.265 Sample Adaptive Offset Estimation for 8k Ultra-HD TV Encoding , 2017, IEEE Transactions on Very Large Scale Integration (VLSI) Systems.

[22]  Qian Xu,et al.  Spherical rotation orientation indication for HEVC and JEM coding of 360 degree video , 2017, Optical Engineering + Applications.

[23]  Chia-Hung Yeh,et al.  A Fast HEVC Encoding Method Using Depth Information of Collocated CUs and RD Cost Characteristics of PU Modes , 2017, IEEE Transactions on Broadcasting.

[24]  Rodney M. Goodman,et al.  Fuzzy rule-based networks for control , 1994, IEEE Trans. Fuzzy Syst..

[25]  Yiming Li,et al.  Recent advances in omnidirectional video coding for virtual reality: Projection and evaluation , 2018, Signal Process..

[26]  Miska M. Hannuksela,et al.  Semi-Fuzzy Rate Controller for Variable Bit Rate Video , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[27]  Gary J. Sullivan,et al.  Rate-distortion optimization for video compression , 1998, IEEE Signal Process. Mag..

[28]  Xingming Sun,et al.  Fast Motion Estimation Based on Content Property for Low-Complexity H.265/HEVC Encoder , 2016, IEEE Transactions on Broadcasting.