Light field compression using disparity-compensated lifting

We propose a novel approach for light field compression that incorporates disparity compensation into 4D wavelet coding using disparity-compensated lifting. With this approach, we obtain the benefits of wavelet coding, including compression efficiency and scalability in all dimensions. Additionally, our proposed approach solves the irreversibility limitations of previous wavelet coding approaches. Experimental results show that the compression efficiency of the proposed technique outperforms current state-of-the-art wavelet coding techniques by a wide margin.

[1]  Shipeng Li,et al.  Shape-adaptive discrete wavelet transforms for arbitrarily shaped visual object coding , 2000, IEEE Trans. Circuits Syst. Video Technol..

[2]  Marcus A. Magnor,et al.  Model-based coding of multiviewpoint imagery , 2000, Visual Communications and Image Processing.

[3]  William A. Pearlman,et al.  A new, fast, and efficient image codec based on set partitioning in hierarchical trees , 1996, IEEE Trans. Circuits Syst. Video Technol..

[4]  David S. Taubman,et al.  Motion-compensated highly scalable video compression using an adaptive 3D wavelet transform based on lifting , 2001, ICIP.

[5]  Wim Sweldens,et al.  The lifting scheme: a construction of second generation wavelets , 1998 .

[6]  Richard Szeliski,et al.  The lumigraph , 1996, SIGGRAPH.

[7]  Marcus A. Magnor,et al.  Progressive Compression and Rendering of Light Fields , 2000, VMV.

[8]  Marcus A. Magnor,et al.  Two approaches to incorporate approximate geometry into multi-view image coding , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[9]  Béatrice Pesquet-Popescu,et al.  Three-dimensional lifting schemes for motion compensated video compression , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[10]  Shipeng Li,et al.  Motion compensated lifting wavelet and its application in video coding , 2001, IEEE International Conference on Multimedia and Expo, 2001. ICME 2001..

[11]  Peter Eisert,et al.  Model-aided coding of multi-viewpoint image data , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[12]  Marcus A. Magnor,et al.  Data compression for light-field rendering , 2000, IEEE Trans. Circuits Syst. Video Technol..

[13]  Robert M. Gray,et al.  Video residual coding using SPIHT and dependent optimization , 2001, Proceedings DCC 2001. Data Compression Conference.

[14]  Marc Levoy,et al.  Light field rendering , 1996, SIGGRAPH.

[15]  Insung Ihm,et al.  Rendering of spherical light fields , 1997, Proceedings The Fifth Pacific Conference on Computer Graphics and Applications.

[16]  Xin Tong,et al.  Coding of multi-view images for immersive viewing , 2000, 2000 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.00CH37100).