Two approaches to incorporate approximate geometry into multi-view image coding

Two compression schemes for coding multiple images of a static scene are compared. Both codecs apply approximate 3-D scene geometry: in model-aided coding, images are predicted by model-driven disparity compensation, while the model-based coder uses the geometry to convert images into texture maps for compression. Images of real-world objects are used to evaluate both codecs. The coding performance is examined subject to varying geometry accuracy. Compression factors of up to 1000:1 at an acceptable reconstruction quality verify the usefulness of the 3-D geometry for coding multi-viewpoint imagery.

[1]  Marc Levoy,et al.  Light field rendering , 1996, SIGGRAPH.

[2]  Marcus A. Magnor,et al.  Model-based coding of multiviewpoint imagery , 2000, Visual Communications and Image Processing.

[3]  William A. Pearlman,et al.  A new, fast, and efficient image codec based on set partitioning in hierarchical trees , 1996, IEEE Trans. Circuits Syst. Video Technol..

[4]  Peter Eisert,et al.  Multi-hypothesis, volumetric reconstruction of 3-D objects from multiple calibrated camera views , 1999, 1999 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings. ICASSP99 (Cat. No.99CH36258).

[5]  Bernd Girod,et al.  Fully Embedded Coding of Triangle Meshes , 1999 .

[6]  Peter Eisert,et al.  Model-aided coding of multi-viewpoint image data , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[7]  Marcus A. Magnor,et al.  Data compression for light-field rendering , 2000, IEEE Trans. Circuits Syst. Video Technol..

[8]  Jitendra Malik,et al.  Modeling and Rendering Architecture from Photographs: A hybrid geometry- and image-based approach , 1996, SIGGRAPH.

[9]  Richard Szeliski,et al.  The lumigraph , 1996, SIGGRAPH.

[10]  Marcus A. Magnor,et al.  Progressive Compression and Rendering of Light Fields , 2000, VMV.