Dmesh: Fast Depth-Image Meshing And Warping

In this paper we present a novel and efficient depth-image representation and warping technique called DMesh which is based on a piece-wise linear approximation of the depth-image as a textured and simplified triangle mesh. We describe the application of a hierarchical multiresolution triangulation method to generate adaptively triangulated depth-meshes efficiently from reference depth-images, discuss depth-mesh segmentation methods to avoid occlusion artifacts and propose a new hardware accelerated depth-image rendering technique that supports per-pixel weighted blending of multiple depth-images in real-time. Applications of our technique include image-based object representations and the use of depth-images in large scale walk-through visualization systems.

[1]  Gary Bishop,et al.  Dynamic Shading in Image-Based Rendering , 1998 .

[2]  Anselmo Lastra,et al.  LDI tree: a hierarchical representation for image-based rendering , 1999, SIGGRAPH.

[3]  Renato Pajarola,et al.  Object-space point blending and splatting , 2003, SIGGRAPH '03.

[4]  Nelson L. Max,et al.  Hierarchical Rendering of Trees from Precomputed Multi-Layer Z-Buffers , 1996, Rendering Techniques.

[5]  Leonard McMillan,et al.  A List-Priority Rendering Algorithm for Redisplaying Projected Surfaces , 1995 .

[6]  Matthias Zwicker,et al.  Surface splatting , 2001, SIGGRAPH.

[7]  Leonard McMillan,et al.  Post-rendering 3D warping , 1997, SI3D.

[8]  François X. Sillion,et al.  Multi‐layered impostors for accelerated rendering , 1999, Comput. Graph. Forum.

[9]  Linda G. Shapiro,et al.  View-base Rendering: Visualizing Real Objects from Scanned Range and Color Data , 1997, Rendering Techniques.

[10]  Michael Wimmer,et al.  Eurographics Workshop on Rendering (2002) Textured Depth Meshes for Real-time Rendering of Arbitrary Scenes , 2022 .

[11]  Daniel G. Aliaga,et al.  MMR: an interactive massive model rendering system using geometric and image-based acceleration , 1999, SI3D.

[12]  William Ribarsky,et al.  Real-time, continuous level of detail rendering of height fields , 1996, SIGGRAPH.

[13]  R. Pajarola,et al.  Fast Depth-Image Meshing and Warping , 2002 .

[14]  Manuel Menezes de Oliveira Neto,et al.  Image-based objects , 1999, SI3D.

[15]  Amitabh Varshney,et al.  Walkthroughs of complex environments using image-based simplification , 1998 .

[16]  Lance Williams,et al.  View Interpolation for Image Synthesis , 1993, SIGGRAPH.

[17]  R. Pajarola,et al.  Object-Space Blending and Splatting of Points , 2003 .

[18]  Marc Levoy,et al.  QSplat: a multiresolution point rendering system for large meshes , 2000, SIGGRAPH.

[19]  Amitabh Varshney,et al.  Navigating static environments using image-space simplification and morphing , 1997, SI3D.

[20]  William J. Dally,et al.  Point Sample Rendering , 1998, Rendering Techniques.

[21]  Anselmo Lastra,et al.  Automatic image placement to provide a guaranteed frame rate , 1999, SIGGRAPH.

[22]  Michael D. McCool,et al.  Texture shaders , 1999, Workshop on Graphics Hardware.

[23]  Richard Szeliski,et al.  Layered depth images , 1998, SIGGRAPH.

[24]  David Salesin,et al.  Hierarchical image caching for accelerated walkthroughs of complex environments , 1996, SIGGRAPH.

[25]  Ming Wan,et al.  Image based rendering with stable frame rates , 2000, Proceedings Visualization 2000. VIS 2000 (Cat. No.00CH37145).

[26]  Andrew W. Fitzgibbon,et al.  An Experimental Comparison of Range Image Segmentation Algorithms , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[27]  Renato Pajarola.  Access to large scale terrain and image databases in geoinformation systems , 1998 .

[28]  Matthias Zwicker,et al.  Surfels: surface elements as rendering primitives , 2000, SIGGRAPH.

[29]  Ronald Pose,et al.  Priority rendering with a virtual reality address recalculation pipeline , 1994, SIGGRAPH.

[30]  Ross T. Whitaker,et al.  Partitioning 3D Surface Meshes Using Watershed Segmentation , 1999, IEEE Trans. Vis. Comput. Graph..

[31]  Baoquan Chen,et al.  POP: a hybrid point and polygon rendering system for large data , 2001, Proceedings Visualization, 2001. VIS '01..

[32]  George Drettakis,et al.  Efficient Impostor Manipulation for Real‐Time Visualization of Urban Scenery , 1997, Comput. Graph. Forum.