Image-based Representations for Accelerated Rendering of Complex Scenes

This paper gives an overview of image-based representations commonly used for reducing the geometric complexity of a scene description in order to accelerate the rendering process. Several different types of representations and ways for using them have been presented, which are classified and discussed here. Furthermore, the overview includes techniques for accelerating the rendering of static scenes or scenes with animations and/or dynamic lighting effects. The advantages and drawbacks of the different approaches are illuminated, and unsolved problems and roads for further research are shown.

[1]  Matthias Zwicker,et al.  Surface splatting , 2001, SIGGRAPH.

[2]  Céline Loscos,et al.  Real-time shadows for animated crowds in virtual cities , 2001, VRST '01.

[3]  Gernot Schaufler.  Exploiting frame-to-frame coherence in a virtual reality system , 1996, Proceedings of the IEEE 1996 Virtual Reality Annual International Symposium.

[4]  Daniel G. Aliaga,et al.  Architectural walkthroughs using portal textures , 1997 .

[5]  John Snyder,et al.  Rendering with coherent layers , 1997, SIGGRAPH.

[6]  Adam Finkelstein,et al.  Real-time fur over arbitrary surfaces , 2001, I3D '01.

[7]  Marc Stamminger,et al.  Sequential point trees , 2003, ACM Trans. Graph..

[8]  Reinhard Klein,et al.  BTF Rendering for Virtual Environments , 2003 .

[9]  Anselmo Lastra,et al.  LDI tree: a hierarchical representation for image-based rendering , 1999, SIGGRAPH.

[10]  Michael Wimmer,et al.  Fast walkthroughs with image caches and ray casting , 1999, Comput. Graph..

[11]  Stefan Jeschke,et al.  Accelerating the rendering process using impostors , 2004 .

[12]  Daniel G. Aliaga,et al.  Power Plant Walkthrough: An Integrated System for Massive Model Rendering , 1997 .

[13]  David Salesin,et al.  Surface light fields for 3D photography , 2000, SIGGRAPH.

[14]  Daniel Cohen-Or,et al.  Aggressive Visibility for Rendering Extremely Complex Foliage Scenes , 2004 .

[15]  Anselmo Lastra,et al.  Automatic image placement to provide a guaranteed frame rate , 1999, SIGGRAPH.

[16]  Daniel Thalmann,et al.  Real-time display of virtual humans: levels of details and impostors , 2000, IEEE Trans. Circuits Syst. Video Technol..

[17]  Nelson L. Max,et al.  Hierarchical Rendering of Trees from Precomputed Multi-Layer Z-Buffers , 1996, Rendering Techniques.

[18]  Anselmo Lastra,et al.  Real‐Time Cloud Rendering , 2001, Comput. Graph. Forum.

[19]  Richard Szeliski,et al.  The lumigraph , 1996, SIGGRAPH.

[20]  Michael Wimmer,et al.  Automatic impostor placement for guaranteed frame rates and low memory requirements , 2005, I3D '05.

[21]  Michael Wimmer,et al.  Eurographics Workshop on Rendering (2002) Textured Depth Meshes for Real-time Rendering of Arbitrary Scenes , 2022 .

[22]  E. Adelson,et al.  The Plenoptic Function and the Elements of Early Vision , 1991 .

[23]  Carlo H. Séquin,et al.  Tapestry: A Dynamic Mesh-based Display Representation for Interactive Rendering , 2000, Rendering Techniques.

[24]  Marc Levoy,et al.  Light field rendering , 1996, SIGGRAPH.

[25]  L. d Costa,et al.  Multiresolution Representation and Reconstruction of Adaptively Sampled Images , 1996 .

[26]  Jed Lengyel,et al.  Real-Time Hair , 2000, Rendering Techniques.

[27]  Frédo Durand,et al.  Billboard clouds , 2003, SCG '03.

[28]  Michael Wimmer,et al.  Rendering Time Estimation for Real-Time Rendering , 2003, Rendering Techniques.

[29]  Leif Kobbelt,et al.  Efficient High Quality Rendering of Point Sampled Geometry , 2002, Rendering Techniques.

[30]  Peter Shirley,et al.  Visual navigation of large environments using textured clusters , 1995, I3D '95.

[31]  Frédo Durand,et al.  Billboard clouds for extreme model simplification , 2003, ACM Trans. Graph..

[32]  Efficient warping for architectural walkthroughs using layered depth images , 1998, IEEE Visualization.

[33]  Henry Fuchs,et al.  Frameless rendering: double buffering considered harmful , 1994, SIGGRAPH.

[34]  Daniel Thalmann,et al.  Lowering the cost of virtual human rendering with structured animated impostors , 1999 .

[35]  Yiorgos Chrysanthou,et al.  Real-Time Rendering of Densely Populated Urban Environments , 2000, Rendering Techniques.

[36]  Dinesh Manocha,et al.  Spatially encoded image-space simplifications for interactive walkthrough , 2002 .

[37]  Richard Szeliski,et al.  Layered depth images , 1998, SIGGRAPH.

[38]  David Salesin,et al.  Hierarchical image caching for accelerated walkthroughs of complex environments , 1996, SIGGRAPH.

[39]  Tien-Tsin Wong,et al.  Image-based Rendering with Controllable Illumination , 1997, Rendering Techniques.

[40]  Fabrice Neyret,et al.  Interactive Volumetric Textures , 1998, Rendering Techniques.

[41]  François X. Sillion,et al.  Multi‐layered impostors for accelerated rendering , 1999, Comput. Graph. Forum.

[42]  Pierre Poulin,et al.  Interactive Rendering of Trees with Shading and Shadows , 2001, Rendering Techniques.

[43]  Oliver Deussen,et al.  Hierarchical Image-Based Rendering using Texture Mapping Hardware , 1999, Rendering Techniques.

[44]  A. Lastra,et al.  Efficient warping for architectural walkthroughs using layered depth images , 1998, Proceedings Visualization '98 (Cat. No.98CB36276).

[45]  David P. Luebke,et al.  View-dependent simplification of arbitrary polygonal environments , 1997, SIGGRAPH.

[46]  J. Edward Swan,et al.  LOD-sprite technique for accelerated terrain rendering , 1999, Proceedings Visualization '99 (Cat. No.99CB37067).

[47]  Voicu Popescu,et al.  Images for Accelerating Architectural Walkthroughs , 1998, IEEE Computer Graphics and Applications.

[48]  Michael Wimmer,et al.  Point-Based Impostors for Real-Time Visualization , 2001, Rendering Techniques.

[49]  Shenchang Eric Chen,et al.  QuickTime VR: an image-based approach to virtual environment navigation , 1995, SIGGRAPH.

[50]  Jr. Leonard McMillan,et al.  An Image-Based Approach to Three-Dimensional Computer Graphics , 1997 .

[51]  Peter Ebbesmeyer.  Textured virtual walls achieving interactive frame rates during walkthroughs of complex indoor environments , 1998, Proceedings. IEEE 1998 Virtual Reality Annual International Symposium (Cat. No.98CB36180).

[52]  Anselmo Lastra,et al.  Smooth transitions in texture-based simplification , 1998, Comput. Graph..

[53]  Gernot Schaufler.  Per-Object Image Warping with Layered Impostors , 1998, Rendering Techniques.

[54]  F. E. Nicodemus,et al.  Geometrical considerations and nomenclature for reflectance , 1977 .

[55]  Wolfgang Stuerzlinger,et al.  A Three Dimensional Image Cache for Virtual Reality , 1996, Comput. Graph. Forum.

[56]  Daniel G. Aliaga,et al.  MMR: an interactive massive model rendering system using geometric and image-based acceleration , 1999, SI3D.

[57]  Jason Weber,et al.  Creation and rendering of realistic trees , 1995, SIGGRAPH.

[58]  Dinesh Manocha,et al.  A video-based rendering acceleration algorithm for interactive walkthroughs , 2000, ACM Multimedia.

[59]  Gernot Schaufler.  Image-based object representation by layered impostors , 1998, VRST.

[60]  Carlo H. Séquin,et al.  Adaptive display algorithm for interactive frame rates during visualization of complex virtual environments , 1993, SIGGRAPH.

[61]  Gernot Schaufler,et al.  Nailboards: A Rendering Primitive for Image Caching in Dynamic Scenes , 1997, Rendering Techniques.

[62]  George Drettakis,et al.  Efficient Impostor Manipulation for Real‐Time Visualization of Urban Scenery , 1997, Comput. Graph. Forum.

[63]  Céline Loscos,et al.  Visualizing Crowds in Real‐Time , 2002, Comput. Graph. Forum.

[64]  Schaufler Gernot.  Image-based object representation by layered impostors , 1998 .

[65]  Jarek Rossignac,et al.  Computing Maximal Tiles and Application to Impostor‐Based Simplification , 2004, Comput. Graph. Forum.

[66]  Carol O'Sullivan,et al.  Geopostors: a real-time geometry/impostor crowd rendering system , 2005, SIGGRAPH 2005.

[67]  Tomas Akenine-Möller,et al.  Real-time rendering , 1997 .

[68]  Edwin H. Blake,et al.  Automatic Hierarchical Level of Detail Optimization in Computer Animation , 1997, Comput. Graph. Forum.

[69]  Céline Loscos,et al.  Image/Based Crowd Rendering , 2002, IEEE Computer Graphics and Applications.

[70]  Ronald Pose,et al.  Priority rendering with a virtual reality address recalculation pipeline , 1994, SIGGRAPH.

[71]  Lance Williams,et al.  View Interpolation for Image Synthesis , 1993, SIGGRAPH.

[72]  Michael Garland,et al.  Surface simplification using quadric error metrics , 1997, SIGGRAPH.

[73]  Aleks Jakulin.  Interactive Vegetation Rendering with Slicing and Blending , 2000, Eurographics.

[74]  Maryann Simmons.  Portal Tapestries , 2001 .

[75]  Anselmo Lastra,et al.  Architectural walkthroughs using portal textures , 1997, Proceedings. Visualization '97 (Cat. No. 97CB36155).

[76]  Dipl.-Ing,et al.  Real-time Rendering , 2022 .

[77]  George Drettakis,et al.  Interactive visualization of complex plant ecosystems , 2002, IEEE Visualization, 2002. VIS 2002..

[78]  Carol O'Sullivan,et al.  Geopostors: a real-time geometry / impostor crowd rendering system , 2005, I3D '05.

[79]  Michael Wimmer,et al.  Layered Environment-Map Impostors for Arbitrary Scenes , 2002, Graphics Interface.

[80]  Anselmo Lastra,et al.  3D image warping in architectural walkthroughs , 1998, Proceedings. IEEE 1998 Virtual Reality Annual International Symposium (Cat. No.98CB36180).

[81]  Frederick P. Brooks,et al.  Towards image realism with interactive update rates in complex virtual building environments , 1990, I3D '90.

[82]  Niniane Wang.  Realistic and Fast Cloud Rendering , 2004, J. Graphics, GPU, & Game Tools.

[83]  Philippe Decaudin,et al.  Rendering Forest Scenes in Real-Time , 2010 .

[84]  Ares Lagae,et al.  Interactive Rendering with Bidirectional Texture Functions , 2003, Comput. Graph. Forum.

[85]  George Drettakis,et al.  Interactive Rendering using the Render Cache , 1999, Rendering Techniques.

[86]  Jean-Michel Dischler,et al.  Efficiently Rendering Macro Geometric Surface Structures with Bi-Directional Texture Functions , 1998, Rendering Techniques.

[87]  Nelson L. Max,et al.  Rendering Trees from Precomputed Z-Buffer Views , 1995, Rendering Techniques.

[88]  Amitabh Varshney,et al.  Walkthroughs of complex environments using image-based simplification , 1998 .

[89]  Dinesh Manocha,et al.  Simplifying complex environments using incremental textured depth meshes , 2003, ACM Trans. Graph..

[90]  Reinhard Klein,et al.  Memory Efficient Billboard Clouds for BTF Textured Objects , 2004, VMV.

[91]  Daniel Thalmann,et al.  Animated Impostors for Real-Time Display of Numerous Virtual Humans , 1998, Virtual Worlds.

[92]  Dinesh Manocha,et al.  Spatially-encoded far-field representations for interactive walkthroughs , 2001, MULTIMEDIA '01.

[93]  George Drettakis,et al.  Enhancing and Optimizing the Render Cache , 2002, Rendering Techniques.

[94]  Harry Shum,et al.  Plenoptic sampling , 2000, SIGGRAPH.

[95]  Liviu Coconu,et al.  Hardware-Accelerated Point-Based Rendering of Complex Scenes , 2002, Rendering Techniques.

[96]  Amitabh Varshney,et al.  Navigating static environments using image-space simplification and morphing , 1997, SI3D.

[97]  Jay Torborg,et al.  Talisman: commodity realtime 3D graphics for the PC , 1996, SIGGRAPH.

[98]  Maryann Simmons,et al.  The Holodeck interactive ray cache , 1999, SIGGRAPH '99.