Scalable kernel-based minimum mean square error estimate for light-field image compression

Light-field imaging can capture both spatial and angular information of a 3D scene and is considered as a prospective acquisition and display solution to supply a more natural and fatigue-free 3D visualization. However, one problem that occupies an important position to deal with the light-field data is the sheer size of data volume. In this context, efficient coding schemes for such particular type of image are needed. In this paper, we propose a scalable kernel-based minimum mean square error estimation (MMSE) method to further improve the coding efficiency of light-field image and accelerate the prediction process. The whole prediction procedure is decomposed into three layers. By using different prediction method in different layers, the coding efficiency of light-field image is further improved and the computation complexity is reduced both in encoder and decoder side. In addition, we design a layer management mechanism to determine which layers are to be employed to perform the prediction of the coding block by using the high correlation between the coding block and its adjacent known blocks. Experimental results demonstrate the advantage of the proposed compression method in terms of different quality metrics as well as the visual quality of views rendered from decompressed light-field content, compared to the HEVC intra-prediction method and several other prediction methods in this field.

[1]  Yongdong Zhang,et al.  Effective Uyghur Language Text Detection in Complex Background Images for Traffic Prompt Identification , 2018, IEEE Transactions on Intelligent Transportation Systems.

[2]  Luís Ducla Soares,et al.  Light field HEVC-based image coding using locally linear embedding and self-similarity compensated prediction , 2016, 2016 IEEE International Conference on Multimedia & Expo Workshops (ICMEW).

[3]  Ping An,et al.  Disparity compensation based 3D holoscopic image coding using HEVC , 2015, 2015 IEEE China Summit and International Conference on Signal and Information Processing (ChinaSIP).

[4]  Yun Li,et al.  Coding of Focused Plenoptic Contents by Displacement Intra Prediction , 2016, IEEE Transactions on Circuits and Systems for Video Technology.

[5]  Marc Levoy,et al.  Light field rendering , 1996, SIGGRAPH.

[6]  Yongdong Zhang,et al.  Efficient Parallel Framework for HEVC Motion Estimation on Many-Core Processors , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[7]  Wei Xiang,et al.  Light Field Multi-View Video Coding With Two-Directional Parallel Inter-View Prediction , 2016, IEEE Transactions on Image Processing.

[8]  Chao Yang,et al.  3D holoscopic image coding scheme using HEVC with Gaussian process regression , 2016, Signal Process. Image Commun..

[9]  Antonio M. Peinado,et al.  Kernel-Based MMSE Multimedia Signal Reconstruction and Its Application to Spatial Error Concealment , 2014, IEEE Transactions on Multimedia.

[10]  E. Adelson,et al.  The Plenoptic Function and the Elements of Early Vision , 1991 .

[11]  Luís Ducla Soares,et al.  HEVC-based light field image coding with bi-predicted self-similarity compensation , 2016, 2016 IEEE International Conference on Multimedia & Expo Workshops (ICMEW).

[12]  Touradj Ebrahimi,et al.  ICME 2016 Grand Challenge : Light-Field Image Compression July 11 th – 15 th , 2016 , Seattle , USA Call for Proposals and Evaluation Procedure , 2016 .

[13]  Bhaskar D. Rao,et al.  Sparse modelling and predictive coding of subaperture images for lossless plenoptic image compression , 2016, 2016 3DTV-Conference: The True Vision - Capture, Transmission and Display of 3D Video (3DTV-CON).

[14]  Bin Li,et al.  Pseudo-Sequence-Based 2-D Hierarchical Coding Structure for Light-Field Image Compression , 2016, IEEE Journal of Selected Topics in Signal Processing.

[15]  Li Li,et al.  Pseudo-sequence-based light field image compression , 2016, 2016 IEEE International Conference on Multimedia & Expo Workshops (ICMEW).

[16]  Yongdong Zhang,et al.  A Highly Parallel Framework for HEVC Coding Unit Partitioning Tree Decision on Many-core Processors , 2014, IEEE Signal Processing Letters.

[17]  Thomas Eriksson,et al.  Packet Video Error Concealment With Gaussian Mixture Models , 2008, IEEE Transactions on Image Processing.

[18]  Ping An,et al.  Hybrid Kernel-Based Template Prediction and Intra Block Copy for Light Field Image Coding , 2017, PCM.

[19]  Luís Ducla Soares,et al.  Locally linear embedding-based prediction for 3D holoscopic image coding using HEVC , 2014, 2014 22nd European Signal Processing Conference (EUSIPCO).

[20]  Marc Levoy,et al.  Light Fields and Computational Imaging , 2006, Computer.

[21]  Bin Li,et al.  Pseudo Sequence Based 2-D Hierarchical Coding Structure for Light-Field Image Compression , 2017, 2017 Data Compression Conference (DCC).

[22]  Luís Ducla Soares,et al.  HEVC-based 3D holoscopic video coding using self-similarity compensated prediction , 2016, Signal Process. Image Commun..

[23]  Chao Yang,et al.  Three-dimensional holoscopic image coding scheme using high-efficiency video coding with kernel-based minimum mean-square-error estimation , 2016, J. Electronic Imaging.

[24]  Yongdong Zhang,et al.  Lenselet image compression scheme based on subaperture images streaming , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[25]  Tieniu Tan,et al.  High quality depth map estimation of object surface from light-field images , 2017, Neurocomputing.

[26]  Ruigang Yang,et al.  Toward the Light Field Display: Autostereoscopic Rendering via a Cluster of Projectors , 2008, IEEE Transactions on Visualization and Computer Graphics.

[27]  Yongdong Zhang,et al.  Supervised Hash Coding With Deep Neural Network for Environment Perception of Intelligent Vehicles , 2018, IEEE Transactions on Intelligent Transportation Systems.

[28]  W. Marsden I and J , 2012 .