Improved integral images compression based on multi-view extraction

Integral imaging is a technology based on plenoptic photography that captures and samples the light-field of a scene through a micro-lens array. It provides views of the scene from several angles and therefore is foreseen as a key technology for future immersive video applications. However, integral images have a large resolution and a structure based on micro-images which is challenging to encode. A compression scheme for integral images based on view extraction has previously been proposed, with average BD-rate gains of 15.7% (up to 31.3%) reported over HEVC when using one single extracted view. As the efficiency of the scheme depends on a tradeoff between the bitrate required to encode the view and the quality of the image reconstructed from the view, it is proposed to increase the number of extracted views. Several configurations are tested with different positions and different number of extracted views. Compression efficiency is increased with average BD-rate gains of 22.2% (up to 31.1%) reported over the HEVC anchor, with a realistic runtime increase.

[1]  Luís Ducla Soares,et al.  Inter-Layer Prediction Scheme for Scalable 3-D Holoscopic Video Coding , 2013, IEEE Signal Processing Letters.

[2]  David Salesin,et al.  Spatio-angular resolution tradeoffs in integral photography , 2006, EGSR '06.

[3]  Frederic Dufaux,et al.  Emerging Technologies for 3D Video: Creation, Coding, Transmission and Rendering , 2013, Emerging Technologies for 3D Video.

[4]  G. Lippmann Epreuves reversibles donnant la sensation du relief , 1908 .

[5]  Gary J. Sullivan,et al.  Overview of the High Efficiency Video Coding (HEVC) Standard , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[6]  J. Oliveira 2D Image Rendering for 3D Holoscopic Content using Disparity-Assisted Patch Blending , 2013 .

[7]  A. Stern,et al.  A Hybrid Compression Method for Integral Images Using Discrete Wavelet Transform and Discrete Cosine Transform , 2007, Journal of Display Technology.

[8]  F. Bossen,et al.  Common test conditions and software reference configurations , 2010 .

[9]  Amar Aggoun,et al.  Compression of integral 3D TV pictures , 1995 .

[10]  M. Landy,et al.  The Plenoptic Function and the Elements of Early Vision , 1991 .

[11]  Luís Ducla Soares,et al.  New HEVC prediction modes for 3D holoscopic video coding , 2012, 2012 19th IEEE International Conference on Image Processing.

[12]  G. Bjontegaard,et al.  Calculation of Average PSNR Differences between RD-curves , 2001 .

[13]  Frédéric Dufaux,et al.  Integral images compression scheme based on view extraction , 2015, 2015 23rd European Signal Processing Conference (EUSIPCO).

[14]  A. Lumsdaine Full Resolution Lightfield Rendering , 2008 .

[15]  Frédéric Dufaux,et al.  Full parallax super multi-view video coding , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[16]  Luís Ducla Soares,et al.  3D Holoscopic video coding using MVC , 2011, 2011 IEEE EUROCON - International Conference on Computer as a Tool.

[17]  Ruben Berzosa Calpe Overview of 3D Video: Coding Algorithms, Implementations and Standardization , 2011 .

[18]  Do-Kyoung Kwon,et al.  Fast intra block copy (IntraBC) search for HEVC screen content coding , 2014, 2014 IEEE International Symposium on Circuits and Systems (ISCAS).

[19]  Patrick Gioia,et al.  Efficient compression method for integral images using multi-view video coding , 2011, 2011 18th IEEE International Conference on Image Processing.

[20]  Andrew Lumsdaine,et al.  Focused plenoptic camera and rendering , 2010, J. Electronic Imaging.

[21]  D. Marpe,et al.  The H.264/MPEG4 advanced video coding standard and its applications , 2006, IEEE Communications Magazine.

[22]  Amar Aggoun,et al.  A novel coding scheme for full parallax 3D-TV pictures , 1997, 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing.