Data formats for high efficiency coding of Lytro-Illum light fields

Light fields captured by the Lytro-Illum camera are the first to appear in the consumer market, capable of providing refocused pictures at acceptable spatial resolution and quality. Since this is partially due to sampling of a huge number of light rays, efficient compression methods are required to store and exchange light field data. This paper presents a performance study of HEVC-compatible coding of Lytro-Illum light fields using different data formats for standard coding. The efficiency of 5 different light field data formats are evaluated using a data set of 12 light field images and the standard HEVC coding configurations of Still-Image Profile, All-Intra, Low Delay B and P and Random Access. Unexpectedly, the results show that relative performance is not consistent across all coding configurations, raising new research questions regarding standard coding of Lytro-Illum light fields using HEVC. Most importantly, the proposed data formats greatly increase HEVC performance.

[1]  C. Perra,et al.  Unfocused plenoptic camera calibration , 2014, 2014 22nd Telecommunications Forum Telfor (TELFOR).

[2]  David Salesin,et al.  Spatio-angular resolution tradeoffs in integral photography , 2006, EGSR '06.

[3]  N. Canagarajah,et al.  A Novel H.264/AVC Based Multi-View Video Coding Scheme , 2007, 2007 3DTV Conference.

[4]  Cristian Perra On the coding of plenoptic raw images , 2014, 2014 22nd Telecommunications Forum Telfor (TELFOR).

[5]  Cristian Perra,et al.  Lossless plenoptic image compression using adaptive block differential prediction , 2015, 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[6]  André Kaup,et al.  H.264/AVC-compatible coding of dynamic light fields using transposed picture ordering , 2005, 2005 13th European Signal Processing Conference.

[7]  Stefan B. Williams,et al.  Decoding, Calibration and Rectification for Lenselet-Based Plenoptic Cameras , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Petros Daras,et al.  Immersive 3D Holoscopic Video System , 2013, IEEE MultiMedia.