Compression of multiple depth maps for IBR

Image-based rendering techniques include those with geometry and those without. Geometric information in the form of a depth map aligned with the image holds a lot of promise for IBR due to the several methods available to capture it. It can improve the quality of generated views using a limited number of views. Compression of light fields or multiple images has attracted a lot of attention in the past. Compression of multiple depth maps of the same scene has not been explored much in the literature. We propose a method for compressing multiple depth maps in this paper using geometric proxy. Different quality of rendering and compression ratio can be achieved by varying different parameters. Experiments show the effectiveness of the compression technique on several model data.

[1]  Paul S. Heckbert,et al.  Survey of Polygonal Surface Simplification Algorithms , 1997 .

[2]  Harry Shum,et al.  Pop-up light field: An interactive image-based modeling and rendering system , 2004, TOGS.

[3]  Michael S. Landy,et al.  Computational models of visual processing , 1991 .

[4]  Marc Levoy,et al.  A volumetric method for building complex models from range images , 1996, SIGGRAPH.

[5]  P. J. Narayanan,et al.  Depth+Texture Representation for Image Based Rendering , 2004, ICVGIP.

[6]  Thomas Malzbender,et al.  The Coliseum Immersive Teleconferencing System , 2002 .

[7]  Dinesh Manocha,et al.  Spatially-encoded far-field representations for interactive walkthroughs , 2001, MULTIMEDIA '01.

[8]  Hai Tao,et al.  Compression and transmission of depth maps for image-based rendering , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[9]  Bernd Girod,et al.  Light field compression using disparity-compensated lifting , 2003, 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03)..

[10]  Leonard McMillan,et al.  Post-rendering 3D warping , 1997, SI3D.

[11]  S. B. Kang,et al.  Survey of image-based representations and compression techniques , 2003, IEEE Trans. Circuits Syst. Video Technol..

[12]  Takeo Kanade,et al.  Virtualized Reality: Constructing Virtual Worlds from Real Scenes , 1997, IEEE Multim..

[13]  Lance Williams,et al.  View Interpolation for Image Synthesis , 1993, SIGGRAPH.

[14]  Peter Eisert,et al.  Multi-view image coding with depth maps and 3-D geometry for prediction , 2001 .

[15]  Marc Levoy,et al.  Light field rendering , 1996, SIGGRAPH.

[16]  Insung Ihm,et al.  Rendering of spherical light fields , 1997, Proceedings The Fifth Pacific Conference on Computer Graphics and Applications.

[17]  Xin Tong,et al.  Coding of multi-view images for immersive viewing , 2000, 2000 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.00CH37100).

[18]  Jitendra Malik,et al.  Modeling and Rendering Architecture from Photographs: A hybrid geometry- and image-based approach , 1996, SIGGRAPH.

[19]  Steven M. Seitz,et al.  View morphing , 1996, SIGGRAPH.

[20]  Richard Szeliski,et al.  High-quality video view interpolation using a layered representation , 2004, SIGGRAPH 2004.

[21]  Michael Bosse,et al.  Unstructured lumigraph rendering , 2001, SIGGRAPH.

[22]  William E. Lorensen,et al.  Marching cubes: A high resolution 3D surface construction algorithm , 1987, SIGGRAPH.

[23]  Leonard McMillan,et al.  Plenoptic Modeling: An Image-Based Rendering System , 2023 .

[24]  Michael Cohen,et al.  Rendering Layered Depth Images , 1997 .

[25]  Harry Shum,et al.  Rendering with concentric mosaics , 1999, SIGGRAPH.

[26]  Richard Szeliski,et al.  The lumigraph , 1996, SIGGRAPH.

[27]  Ruigang Yang,et al.  3D Tele-Collaboration Over Internet2 , 2002 .

[28]  Takeo Kanade,et al.  Constructing virtual worlds using dense stereo , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[29]  Leonard McMillan,et al.  Scam light field rendering , 2002, 10th Pacific Conference on Computer Graphics and Applications, 2002. Proceedings..

[30]  Dinesh Manocha,et al.  IRW: an incremental representation for image-based walkthroughs , 2002, MULTIMEDIA '02.

[31]  Ramesh Raskar,et al.  Image-based visual hulls , 2000, SIGGRAPH.

[32]  M. Landy,et al.  The Plenoptic Function and the Elements of Early Vision , 1991 .