Image-space approach to real-time realistic rendering

One of the main goals of computer graphics is the fast synthesis of photorealistic image of virtual 3D scenes. The work presented in this thesis addresses this goal of speed and realism. In real-time realistic rendering, we encounter certain problems that are difficult to solve in the traditional 3-dimensional geometric space. We show that using an image-space approach can provide effective solutions to these problems. Unlike geometric space algorithms that operate on 3D primitives such as points, edges, and polygons, image-space algorithms operate on 2D snapshot images of the 3D geometric data. Operating in image-space effectively decouples the geometric complexity of the 3D data from the run-time of the rendering algorithm. Other important advantages of image-space algorithms include ease of implementation on modern graphics hardware, and fast computation of approximate solutions to certain lighting calculations. We have applied the image-space approach and developed algorithms for three prominent problems in real-time realistic rendering, namely, representing and lighting large 3D scenes in the context of grass rendering, rendering caustics, which is a complex indirect illumination effect, and subsurface scattering for rendering of translucent objects.

[1]  James F. Blinn,et al.  Texture and reflection in computer generated images , 1976, CACM.

[2]  Fabrice Neyret,et al.  Interactive Volumetric Textures , 1998, Rendering Techniques.

[3]  Hans-Peter Seidel,et al.  Hardware Accelerated Displacement Mapping for Image Based Rendering , 2001, Graphics Interface.

[4]  Jos Stam,et al.  Random caustics: natural textures and wave theory revisited , 1996, SIGGRAPH '96.

[5]  Stefan Guthe,et al.  Hardware Accelerated Per-Pixel Displacement Mapping , 2004, Graphics Interface.

[6]  Stephen Lin,et al.  View-dependent displacement mapping , 2003, ACM Trans. Graph..

[7]  Andreas Kolb,et al.  Efcient Empty Space Skipping for Per-Pixel Displacement Mapping , 2005 .

[8]  Charles D. Hansen,et al.  Interactive caustics using local precomputed irradiance , 2004, 12th Pacific Conference on Computer Graphics and Applications, 2004. PG 2004. Proceedings..

[9]  Philippe Decaudin,et al.  Rendering Forest Scenes in Real-Time , 2010 .

[10]  Robert L. Cook,et al.  Shade trees , 1984, SIGGRAPH.

[11]  Ares Lagae,et al.  Interactive Rendering with Bidirectional Texture Functions , 2003, Comput. Graph. Forum.

[12]  Jos Stam,et al.  Multiple Scattering as a Diffusion Process , 1995, Rendering Techniques.

[13]  Jean-Michel Dischler,et al.  Efficiently Rendering Macro Geometric Surface Structures with Bi-Directional Texture Functions , 1998, Rendering Techniques.

[14]  Henrik Wann Jensen,et al.  Global Illumination using Photon Maps , 1996, Rendering Techniques.

[15]  Nelson L. Max,et al.  Horizon mapping: shadows for bump-mapped surfaces , 1988, The Visual Computer.

[16]  John C. Hart,et al.  Sphere tracing: a geometric method for the antialiased ray tracing of implicit surfaces , 1996, The Visual Computer.

[17]  Marc Stamminger,et al.  Translucent Shadow Maps , 2003, Rendering Techniques.

[18]  Rae A. Earnshaw,et al.  Shadow Mapping for Hemispherical and Omnidirectional Light Sources , 2002 .

[19]  Wolfgang Straßer,et al.  Real‐Time Caustics , 2003, Comput. Graph. Forum.

[20]  Chris Wyman,et al.  Interactive image-space techniques for approximating caustics , 2006, I3D '06.

[21]  Mark Watt,et al.  Light-water interaction using backward beam tracing , 1990, SIGGRAPH.

[22]  George Drettakis,et al.  Interactive visualization of complex plant ecosystems , 2002, IEEE Visualization, 2002. VIS 2002..

[23]  Ralf Sarlette,et al.  Efficient and Realistic Visualization of Cloth , 2003, Rendering Techniques.

[24]  Pat Hanrahan,et al.  Reflection from layered surfaces due to subsurface scattering , 1993, SIGGRAPH.

[25]  Peter-Pike J. Sloan,et al.  Local, deformable precomputed radiance transfer , 2005, ACM Trans. Graph..

[26]  Philipp Slusallek,et al.  Realtime Caustics using Distributed Photon Mapping , 2004, Rendering Techniques.

[27]  Amitabh Varshney,et al.  Real-time rendering of translucent meshes , 2004, TOGS.

[28]  Hans-Peter Seidel,et al.  View-independent environment maps , 1998, Workshop on Graphics Hardware.

[29]  S. Tachi,et al.  Detailed Shape Representation with Parallax Mapping , 2001 .

[30]  Musawir A. Shah,et al.  Caustics Mapping: An Image-Space Technique for Real-Time Caustics , 2007, IEEE Transactions on Visualization and Computer Graphics.

[31]  Pat Hanrahan,et al.  All-frequency shadows using non-linear wavelet lighting approximation , 2003, ACM Trans. Graph..

[32]  Sumanta N. Pattanaik,et al.  Subsurface Texture Mapping , 2006, IEEE Computer Graphics and Applications.

[33]  Marc Stamminger,et al.  Splatting indirect illumination , 2006, I3D '06.

[34]  Backward Ray Tracing.  Backward Ray Tracing , 1986 .

[35]  Musawir A. Shah,et al.  Real-time rendering of realistic-looking grass , 2005, GRAPHITE.

[36]  Kei Iwasaki,et al.  A Fast Rendering Method for Refractive and Reflective Caustics Due to Water Surfaces , 2003, Comput. Graph. Forum.

[37]  John C. Hart,et al.  GPU algorithms for radiosity and subsurface scattering , 2003, HWWS '03.

[38]  Rui Wang,et al.  All-frequency interactive relighting of translucent objects with single and multiple scattering , 2005, ACM Trans. Graph..

[39]  Steve Marschner,et al.  A practical model for subsurface light transport , 2001, SIGGRAPH.

[40]  Jason Weber,et al.  Creation and rendering of realistic trees , 1995, SIGGRAPH.

[41]  Aleks Jakulin.  Interactive Vegetation Rendering with Slicing and Blending , 2000, Eurographics.

[42]  Cass W. Everitt,et al.  Interactive Order-Independent Transparency , 2001 .

[43]  Per H. Christensen,et al.  Efficient simulation of light transport in scenes with participating media using photon maps , 1998, SIGGRAPH.

[44]  Philippe Decaudin,et al.  GPU-based lighting and shadowing of complex natural scenes , 2004, SIGGRAPH '04.

[45]  Tomoyuki Nishita,et al.  Method of displaying optical effects within water using accumulation buffer , 1994, SIGGRAPH.

[46]  Wan-Chun Ma,et al.  Level-of-detail representation of bidirectional texture functions for real-time rendering , 2005, I3D '05.

[47]  Pierre Poulin,et al.  Interactive Rendering of Trees with Shading and Shadows , 2001, Rendering Techniques.

[48]  Kei Iwasaki,et al.  An Efficient Method for Rendering Underwater Optical Effects Using Graphics Hardware , 2002, Comput. Graph. Forum.

[49]  Marie-Paule Cani,et al.  Animating prairies in real-time , 2001, I3D '01.

[50]  Christophe Schlick,et al.  A Rendering Algorithm for Discrete Volume Density Objects , 1993, Comput. Graph. Forum.

[51]  A. James Stewart,et al.  General Calculations using Graphics Hardware with Applications to Interactive Caustics , 2000, Rendering Techniques.

[52]  Kenneth E. Torrance,et al.  The zonal method for calculating light intensities in the presence of a participating medium , 1987, SIGGRAPH.

[53]  Sumanta N. Pattanaik,et al.  Faster Relief Mapping using the Secant Method , 2007, J. Graph. Tools.

[54]  Hans-Peter Seidel,et al.  Interactive rendering of translucent objects , 2002, 10th Pacific Conference on Computer Graphics and Applications, 2002. Proceedings..

[55]  Jan Kautz,et al.  Precomputed radiance transfer for real-time rendering in dynamic, low-frequency lighting environments , 2002 .

[56]  Henrik Wann Jensen,et al.  Light diffusion in multi-layered translucent materials , 2005, ACM Trans. Graph..

[57]  Pat Hanrahan,et al.  Photon mapping on programmable graphics hardware , 2003, HWWS '03.

[58]  Shree K. Nayar,et al.  Reflectance and texture of real-world surfaces , 1999, TOGS.

[59]  Musawir A. Shah,et al.  Image-Space Subsurface Scattering for Interactive Rendering of Deformable Translucent Objects , 2009, IEEE Computer Graphics and Applications.

[60]  Manuel Menezes de Oliveira Neto,et al.  Real-time relief mapping on arbitrary polygonal surfaces , 2005, I3D '05.

[61]  Manuel Menezes de Oliveira Neto,et al.  Relief texture mapping , 2000, SIGGRAPH.

[62]  Gernot Schaufler,et al.  Efficient displacement Mapping by Image Warping , 1999, Rendering Techniques.

[63]  Pat Hanrahan,et al.  Beam tracing polygonal objects , 1984, SIGGRAPH.

[64]  Alan Edelman,et al.  Modeling and rendering of weathered stone , 1999, SIGGRAPH.

[65]  László Szirmay-Kalos,et al.  Approximate Ray‐Tracing on the GPU with Distance Impostors , 2005, Comput. Graph. Forum.

[66]  Hans-Peter Seidel,et al.  Interactive Rendering of Translucent Deformable Objects , 2003, Rendering Techniques.

[67]  Stephen Lin,et al.  Generalized Displacement Maps , 2004, Rendering Techniques.

[68]  Hans-Peter Seidel,et al.  Efficient Rendering of Local Subsurface Scattering , 2005, Comput. Graph. Forum.

[69]  Chris Wyman.  An approximate image-space approach for interactive refraction , 2005, ACM Trans. Graph..

[70]  Peter-Pike J. Sloan,et al.  Clustered principal components for precomputed radiance transfer , 2003, ACM Trans. Graph..

[71]  M. Alex O. Vasilescu,et al.  TensorTextures: multilinear image-based rendering , 2004, SIGGRAPH 2004.

[72]  John W. Patterson,et al.  Inverse Displacement Mapping , 1991, Comput. Graph. Forum.

[73]  Henrik Wann Jensen,et al.  A rapid hierarchical rendering technique for translucent materials , 2005, ACM Trans. Graph..

[74]  Hans-Peter Seidel,et al.  Realistic, hardware-accelerated shading and lighting , 1999, SIGGRAPH.

[75]  Tomas Akenine-Möller,et al.  Interactive rendering of caustics using interpolated warped volumes , 2005, Graphics Interface.

[76]  Peter Shirley,et al.  Direct Ray Tracing of Displacement Mapped Triangles , 2000, Rendering Techniques.

[77]  James F. Blinn,et al.  Simulation of wrinkled surfaces , 1978, SIGGRAPH.