Quality-based improvement of quantization for light field compression

In the last decade, many methods have been proposed for rendering image-based objects. However, the number and the size of the images required are highly memory demanding. Based on the light field data structure, we propose an improved compression scheme favoring visual appearance and fast random access. Our method relies on vector quantization for preserving access in constant time. 2D Bounding boxes and masks are used to reduce the number of vectors during quantization. Several light field images are used instead of blocks of 4D samples, so that image similarities be exploited as much as possible. Psychophysical experiments performed in a room designed according to ITU recommendations validate the quality metrics of our method.

[1]  Joyce E. Farrell,et al.  Handbook of Image Quality: Characterization and Prediction , 2004 .

[2]  S. P. Lloyd,et al.  Least squares quantization in PCM , 1982, IEEE Trans. Inf. Theory.

[3]  Marcus A. Magnor,et al.  Hierarchical coding of light fields with disparity maps , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[4]  Dan Lelescu,et al.  Representation and coding of light field data , 2004, Graph. Model..

[5]  Marcus A. Magnor,et al.  Multi-view coding for image-based rendering using 3-D scene geometry , 2003, IEEE Trans. Circuits Syst. Video Technol..

[6]  Harry Shum,et al.  On the Compression of Image Based Rendering Scene: A Comparison among Block, Reference and Wavelet Coders , 2001, Int. J. Image Graph..

[7]  Bernd Girod,et al.  Shape adaptation for light field compression , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[8]  Bernd Girod,et al.  Light field compression using disparity-compensated lifting , 2003, 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03)..

[9]  Marc Levoy,et al.  Light field rendering , 1996, SIGGRAPH.

[10]  Brian Keelan,et al.  Handbook of Image Quality: Characterization and Prediction , 2002 .

[11]  Bernd Girod,et al.  Rate-distortion optimized streaming of compressed light fields , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[12]  Markus Flierl,et al.  FOR DISPARITY-COMPENSATED LIGHT FIELD COMPRESSION , 2001 .

[13]  Richard Szeliski,et al.  The lumigraph , 1996, SIGGRAPH.

[14]  Marcus A. Magnor,et al.  Data compression for light-field rendering , 2000, IEEE Trans. Circuits Syst. Video Technol..

[15]  Hans-Peter Seidel,et al.  Light Field Techniques for Reflections and Refractions , 1999, Rendering Techniques.

[16]  Xin Tong,et al.  Coding of multi-view images for immersive viewing , 2000, 2000 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.00CH37100).

[17]  M. Landy,et al.  The Plenoptic Function and the Elements of Early Vision , 1991 .

[18]  Robert M. Gray,et al.  An Algorithm for Vector Quantizer Design , 1980, IEEE Trans. Commun..

[19]  Jin Li,et al.  Compression of Lumigraph with multiple reference frame (MRF) prediction and just-in-time rendering , 2000, Proceedings DCC 2000. Data Compression Conference.