Real-time reflection on moving vehicles in urban environments

In the context of virtual reality, the simulation of complex environments with many animated objects is becoming more and more common. Virtual reality applications have always promoted the development of new efficient algorithms and image-based rendering techniques for real-time interaction. In this paper, we propose a technique which allows the real-time simulation in a city of the reflections of static geometry (eg. building) on specular dynamic objects (vehicles). For this, we introduce the idea of multiple environment maps. We pre-compute a set of reference environment maps at strategic positions in the scene, that are used at run time and for each visible dynamic object, to compute local environment maps by resampling images. To efficiently manage a small number of reference environment maps, compared to the scene dimension, for each vertex of the reconstructed environment we perform a ray tracing in a heightfield representation of the scene. We control the frame rate by adaptative reconstruction of environment maps. We have implemented this approach, and the results show that it is efficient and scalable to many dynamic objects while maintaining interactive frame rates.

[1]  Douglas Voorhies,et al.  Reflection vector shading hardware , 1994, SIGGRAPH.

[2]  Anselmo Lastra,et al.  Automatic image placement to provide a guaranteed frame rate , 1999, SIGGRAPH.

[3]  Marc Olano,et al.  Reflection space image based rendering , 1999, SIGGRAPH.

[4]  C. R. Hoffman,et al.  Illumination and Reflection Maps : Simulated Objects in Simulated and Real Environments Gene , 1984 .

[5]  Hans-Peter Seidel,et al.  Realistic, hardware-accelerated shading and lighting , 1999, SIGGRAPH.

[6]  John M. Snyder,et al.  Realistic Reflections and Refractions on Graphics Hardware with Hybrid Rendering and Layered Environment Maps , 2001, Rendering Techniques.

[7]  Wolfgang Stuerzlinger,et al.  Imaging all Visible Surfaces , 1999, Graphics Interface.

[8]  Shenchang Eric Chen,et al.  QuickTime VR: an image-based approach to virtual environment navigation , 1995, SIGGRAPH.

[9]  Ned Greene,et al.  Environment Mapping and Other Applications of World Projections , 1986, IEEE Computer Graphics and Applications.

[10]  Leonard McMillan,et al.  Plenoptic Modeling: An Image-Based Rendering System , 2023 .

[11]  Richard Szeliski,et al.  The lumigraph , 1996, SIGGRAPH.

[12]  Turner Whitted,et al.  An improved illumination model for shaded display , 1979, CACM.

[13]  Michael Bosse,et al.  Unstructured lumigraph rendering , 2001, SIGGRAPH.

[14]  Marc Levoy,et al.  Light field rendering , 1996, SIGGRAPH.

[15]  Richard Szeliski,et al.  Layered depth images , 1998, SIGGRAPH.

[16]  F. Kenton Musgrave Grid tracing: fast ray tracing for height fields , 1988 .

[17]  Jay Torborg,et al.  Talisman: commodity realtime 3D graphics for the PC , 1996, SIGGRAPH.

[18]  Dani Lischinski,et al.  Automatic camera placement for image-based modeling , 1999, Proceedings. Seventh Pacific Conference on Computer Graphics and Applications (Cat. No.PR00293).

[19]  Jan Kautz,et al.  Approximation of Glossy Reflection with Prefiltered Environment Maps , 2000, Graphics Interface.

[20]  Céline Loscos,et al.  Image/Based Crowd Rendering , 2002, IEEE Computer Graphics and Applications.

[21]  John Amanatides,et al.  A Fast Voxel Traversal Algorithm for Ray Tracing , 1987, Eurographics.

[22]  David Salesin,et al.  Rendering antialiased shadows with depth maps , 1987, SIGGRAPH.

[23]  Dani Lischinski,et al.  Image-Based Rendering for Non-Diffuse Synthetic Scenes , 1998, Rendering Techniques.

[24]  Steven M. Seitz,et al.  View morphing , 1996, SIGGRAPH.

[25]  John M. Snyder,et al.  Parameterized environment maps , 2001, I3D '01.

[26]  Edward Cutrell,et al.  Measuring the Perception of Visual Realism in Images , 2001, Rendering Techniques.

[27]  Jitendra Malik,et al.  Modeling and Rendering Architecture from Photographs: A hybrid geometry- and image-based approach , 1996, SIGGRAPH.

[28]  Lance Williams,et al.  View Interpolation for Image Synthesis , 1993, SIGGRAPH.

[29]  James F. Blinn,et al.  Texture and reflection in computer generated images , 1998 .