Intra-coding of 360-degree images on the sphere

Omni-directional images are characterized by their high resolution (usually 8K) and therefore require high compression efficiency. Existing methods project the spherical content onto one or multiple planes and process the mapped content with classical 2D video coding algorithms. However, this projection induces sub-optimality. Indeed, after projection, the statistical properties of the pixels are modified, the connectivity between neighboring pixels on the sphere might be lost, and finally, the sampling is not uniform. Therefore, we propose to process uniformly distributed pixels directly on the sphere to achieve high compression efficiency. In particular, a scanning order and a prediction scheme are proposed to exploit, directly on the sphere, the statistical dependencies between the pixels. A Graph Fourier Transform is also applied to exploit local dependencies while taking into account the 3D geometry. Experimental results demonstrate that the proposed method provides up to 5.6% bitrate reduction and on average around 2% bitrate reduction over state-of-the-art methods.

[1]  Kemal Ugur,et al.  Intra Coding of the HEVC Standard , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[2]  H. Shum,et al.  Data compression and transmission aspects of panoramic videos , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[3]  Thomas Maugey,et al.  Rate Distortion Optimized Graph Partitioning for Omnidirectional Image Coding , 2018, 2018 26th European Signal Processing Conference (EUSIPCO).

[4]  G. Blelloch Introduction to Data Compression * , 2022 .

[5]  Bernd Girod,et al.  A Framework to Evaluate Omnidirectional Video Coding Schemes , 2015, 2015 IEEE International Symposium on Mixed and Augmented Reality.

[6]  Pascal Frossard,et al.  Deformable block-based motion estimation in omnidirectional image sequences , 2017, 2017 IEEE 19th International Workshop on Multimedia Signal Processing (MMSP).

[7]  Pascal Frossard,et al.  Low bit-rate compression of omnidirectional images , 2009, 2009 Picture Coding Symposium.

[8]  Krista A. Ehinger,et al.  Recognizing scene viewpoint using panoramic place representation , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Khalid Sayood,et al.  Introduction to Data Compression, Third Edition (Morgan Kaufmann Series in Multimedia Information and Systems) , 2005 .

[10]  Andrew Chi-Sing Leung,et al.  The Rhombic Dodecahedron Map: An Efficient Scheme for Encoding Panoramic Video , 2009, IEEE Transactions on Multimedia.

[11]  Gary J. Sullivan,et al.  Overview of the High Efficiency Video Coding (HEVC) Standard , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[12]  Kenneth Rose,et al.  Rotational motion model for temporal prediction in 360 video coding , 2017, 2017 IEEE 19th International Workshop on Multimedia Signal Processing (MMSP).

[13]  Zehdreh Allen-Lafayette,et al.  Flattening the Earth, Two Thousand Years of Map Projections , 1998 .

[14]  Nathanael Perraudin,et al.  DeepSphere: Efficient spherical Convolutional Neural Network with HEALPix sampling for cosmological applications , 2018, Astron. Comput..

[15]  K. Gorski,et al.  HEALPix: A Framework for High-Resolution Discretization and Fast Analysis of Data Distributed on the Sphere , 2004, astro-ph/0409513.

[16]  Kenneth Rose,et al.  Motion Compensated Prediction for Translational Camera Motion in Spherical Video Coding , 2018, 2018 IEEE 20th International Workshop on Multimedia Signal Processing (MMSP).

[17]  Pascal Frossard,et al.  The emerging field of signal processing on graphs: Extending high-dimensional data analysis to networks and other irregular domains , 2012, IEEE Signal Processing Magazine.