Efficient intra prediction scheme for light field image compression

Interactive photo-realistic graphics can be rendered by using light field datasets. One way of capturing the dataset is by using light field cameras with microlens arrays. The captured images contain repetitive patterns resulted from adjacent mi-crolenses. These images don't resemble the appearance of a natural scene. This dissimilarity leads to problems in light field image compression by using traditional image and video encoders, which are optimized for natural images and video sequences. In this paper, we introduce the full inter-prediction scheme in HEVC into intra-prediction for the compression of light field images. The proposed scheme is capable of performing both unidirectional and bi-directional prediction within an image. The evaluation results show that above 3 dB quality improvements or above 50 percent bit-rate saving can be achieved in terms of BD-PSNR for the proposed scheme compared to the original HEVC intra-prediction for light field images.

[1]  Andrew Lumsdaine,et al.  Focused plenoptic camera and rendering , 2010, J. Electronic Imaging.

[2]  Luís Ducla Soares,et al.  New HEVC prediction modes for 3D holoscopic video coding , 2012, 2012 19th IEEE International Conference on Image Processing.

[3]  F. Bossen,et al.  Common test conditions and software reference configurations , 2010 .

[4]  Luís Ducla Soares,et al.  3D Holoscopic video coding using MVC , 2011, 2011 IEEE EUROCON - International Conference on Computer as a Tool.

[5]  Xu Wenli,et al.  Data compression of light field using wavelet packet , 2004, 2004 IEEE International Conference on Multimedia and Expo (ICME) (IEEE Cat. No.04TH8763).

[6]  Bernd Girod,et al.  Light field compression using disparity-compensated lifting and shape adaptation , 2006, IEEE Transactions on Image Processing.

[7]  G. Bjontegaard,et al.  Calculation of Average PSNR Differences between RD-curves , 2001 .

[8]  Luís Ducla Soares,et al.  Improved spatial prediction for 3D holoscopic image and video coding , 2011, 2011 19th European Signal Processing Conference.

[9]  Thomas Wiegand,et al.  Video codec incorporating block-based multihypothesis motion-compensated prediction , 2000, Visual Communications and Image Processing.

[10]  Marc Levoy,et al.  Light field rendering , 1996, SIGGRAPH.