Three-dimensional holoscopic image-coding scheme using a sparse viewpoint image array and disparities

Abstract. Three-dimensional (3-D) holoscopic imaging is a candidate promising 3-D technology that can overcome some drawbacks of current 3-D technologies. Due to the particular optical structure, a holoscopic image consists of an array of two-dimensional microimages (MIs) that represent different perspectives of the scene. To address the data-intensive characteristics and specific structure of holoscopic images, efficient coding schemes are of utmost importance for efficient storage and transmission. We propose a 3-D holoscopic image-coding scheme using a sparse viewpoint image (VI) array and disparities. In the proposed scheme, a holoscopic image is decomposed into a VI array totally and the VI array is sampled into a sparse VI array. To reconstruct the full holoscopic image, disparities between adjoining MIs are calculated. Based on the remainder set of VIs and disparities, a full holoscopic image is reconstructed and encoded as a reference frame for the coding of the full holoscopic image. As an outcome of the representation, we propose a multiview plus depth compression scheme for 3-D holoscopic images coding. Experimental results show that the proposed coding scheme can achieve an average of 51% bit-rate reduction compared with high efficiency video coding intracoding.

[1]  A. Stern,et al.  A Hybrid Compression Method for Integral Images Using Discrete Wavelet Transform and Discrete Cosine Transform , 2007, Journal of Display Technology.

[2]  A. Lumsdaine Full Resolution Lightfield Rendering , 2008 .

[3]  Andrew Lumsdaine,et al.  The focused plenoptic camera , 2009, 2009 IEEE International Conference on Computational Photography (ICCP).

[4]  Andrew Lumsdaine,et al.  Focused plenoptic camera and rendering , 2010, J. Electronic Imaging.

[5]  S. Kishk,et al.  Integral Images Compression using Discrete Wavelets and PCA , 2011 .

[6]  Patrick Gioia,et al.  Efficient compression method for integral images using multi-view video coding , 2011, 2011 18th IEEE International Conference on Image Processing.

[7]  Luís Ducla Soares,et al.  Spatial prediction based on self-similarity compensation for 3D holoscopic image and video coding , 2011, 2011 18th IEEE International Conference on Image Processing.

[8]  Neil A. Dodgson,et al.  Three-Dimensional Displays: A Review and Applications Analysis , 2011, IEEE Transactions on Broadcasting.

[9]  Luís Ducla Soares,et al.  New HEVC prediction modes for 3D holoscopic video coding , 2012, 2012 19th IEEE International Conference on Image Processing.

[10]  Andrew Lumsdaine,et al.  Plenoptic rendering with interactive performance using GPUs , 2012, Electronic Imaging.

[11]  Luís Ducla Soares,et al.  Inter-Layer Prediction Scheme for Scalable 3-D Holoscopic Video Coding , 2013, IEEE Signal Processing Letters.

[12]  J. Oliveira 2D Image Rendering for 3D Holoscopic Content using Disparity-Assisted Patch Blending , 2013 .

[13]  Luís Ducla Soares,et al.  Locally linear embedding-based prediction for 3D holoscopic image coding using HEVC , 2014, 2014 22nd European Signal Processing Conference (EUSIPCO).

[14]  Frédéric Dufaux,et al.  Integral images compression scheme based on view extraction , 2015, 2015 23rd European Signal Processing Conference (EUSIPCO).

[15]  Ping An,et al.  Disparity compensation based 3D holoscopic image coding using HEVC , 2015, 2015 IEEE China Summit and International Conference on Signal and Information Processing (ChinaSIP).

[16]  Wei Xiang,et al.  Light Field Multi-View Video Coding With Two-Directional Parallel Inter-View Prediction , 2016, IEEE Transactions on Image Processing.

[17]  Chao Yang,et al.  Scalable coding of 3D holoscopic image by using a sparse interlaced view image set and disparity map , 2016, Multimedia Tools and Applications.

[18]  Ling Yang,et al.  3D Holoscopic Images Coding Scheme Based on Viewpoint Image Rendering , 2016, IFTC.

[19]  Luís Ducla Soares,et al.  Light field HEVC-based image coding using locally linear embedding and self-similarity compensated prediction , 2016, 2016 IEEE International Conference on Multimedia & Expo Workshops (ICMEW).

[20]  Chao Yang,et al.  3D holoscopic image coding scheme using HEVC with Gaussian process regression , 2016, Signal Process. Image Commun..

[21]  Caroline Conti,et al.  Improved inter-layer prediction for light field content coding with display scalability , 2016, Optical Engineering + Applications.

[22]  Ulf Jennehag,et al.  Scalable Coding of Plenoptic Images by Using a Sparse Set and Disparities , 2016, IEEE Transactions on Image Processing.

[23]  Christine Guillemot,et al.  Light field compression using depth image based view synthesis , 2017, 2017 IEEE International Conference on Multimedia & Expo Workshops (ICMEW).

[24]  Chao Yang,et al.  Coding of 3D holoscopic image by using spatial correlation of rendered view images , 2017, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).