Perceptually-driven decision theory for interactive realistic rendering

In this paper we introduce a new approach to realistic rendering at interactive rates on commodity graphics hardware. The approach uses efficient perceptual metrics within a decision theoretic framework to optimally order rendering operations, producing images of the highest visual quality within system constraints. We demonstrate the usefulness of this approach for various applications such as diffuse texture caching, environment map prioritization and radiosity mesh simplification. Although here we address the problem of realistic rendering at interactive rates, the perceptually-based decision theoretic methodology we introduce can be usefully applied in many areas of computer graphics.

[1]  Eric Horvitz,et al.  Perception, Attention, and Resources: A Decision-Theoretic Approach to Graphics Rendering , 1997, UAI.

[2]  Hans-Peter Seidel,et al.  Walkthroughs with Corrective Texturing , 2000, Rendering Techniques.

[3]  Donald P. Greenberg,et al.  A perceptually based physical error metric for realistic image synthesis , 1999, SIGGRAPH.

[4]  Ned Greene,et al.  Environment Mapping and Other Applications of World Projections , 1986, IEEE Computer Graphics and Applications.

[5]  Anselmo Lastra,et al.  Increased photorealism for interactive architectural walkthroughs , 1999, SI3D.

[6]  Homan Igehy,et al.  Prefetching in a texture cache architecture , 1998, Workshop on Graphics Hardware.

[7]  Fabio Pellacini,et al.  A Perceptually-Based Texture Caching Algorithm for Hardware-Based Rendering , 2001, Rendering Techniques.

[8]  Hans-Peter Seidel,et al.  Perception-guided global illumination solution for animation rendering , 2001, SIGGRAPH.

[9]  Dipl.-Ing,et al.  Real-time Rendering , 2022 .

[10]  Benjamin Watson,et al.  Measuring and predicting visual fidelity , 2001, SIGGRAPH.

[11]  Donald P. Greenberg,et al.  Spatiotemporal sensitivity and visual attention for efficient rendering of dynamic environments , 2005, TOGS.

[12]  Norman I. Badler,et al.  Multi-pass pipeline rendering: realism for dynamic environments , 1997, SI3D.

[13]  George Drettakis,et al.  Interactive Rendering using the Render Cache , 1999, Rendering Techniques.

[14]  David P. Luebke,et al.  Perceptually-Driven Simplification for Interactive Rendering , 2001, Rendering Techniques.

[15]  Hans-Peter Seidel,et al.  Realistic, hardware-accelerated shading and lighting , 1999, SIGGRAPH.

[16]  Daniel Cohen-Or,et al.  A Real-Time Photo-Realistic Visual Flythrough , 1996, IEEE Trans. Vis. Comput. Graph..

[17]  Charles D. Hansen,et al.  Towards Interactive Photorealistic Rendering of Indoor Scenes: A Hybrid Approach , 1999, Rendering Techniques.

[18]  John Snyder,et al.  Rendering with coherent layers , 1997, SIGGRAPH.

[19]  Kellogg S. Booth,et al.  Report from the chair , 1986 .

[20]  Joëlle Thollot,et al.  Conservative visibility preprocessing using extended projections , 2000, SIGGRAPH.

[21]  Hans-Peter Seidel,et al.  Perceptually Guided Corrective Splatting , 2001, Comput. Graph. Forum.

[22]  David P. Luebke,et al.  Portals and mirrors: simple, fast evaluation of potentially visible sets , 1995, I3D '95.

[23]  John M. Airey,et al.  Increasing update rates in the building walkthrough system with automatic model-space subdivision and potentially visible set calculations , 1990 .

[24]  Parris K. Egbert,et al.  Interactive display of very large textures , 1998, Proceedings Visualization '98 (Cat. No.98CB36276).

[25]  Donald P. Greenberg,et al.  Perceiving spatial relationships in computer-generated images , 1992, IEEE Computer Graphics and Applications.

[26]  Daniel G. Aliaga,et al.  MMR: an interactive massive model rendering system using geometric and image-based acceleration , 1999, SI3D.

[27]  Bernice E. Rogowitz,et al.  Perceptual issues in substituting texture for geometry , 2000, Electronic Imaging.

[28]  Pat Hanrahan,et al.  A rapid hierarchical radiosity algorithm , 1991, SIGGRAPH.

[29]  Sartaj Sahni,et al.  Approximate Algorithms for the 0/1 Knapsack Problem , 1975, JACM.

[30]  Karol Myszkowski,et al.  Perceptually-Informed Accelerated Rendering of High Quality Walkthrough Sequences , 1999, Rendering Techniques.

[31]  Jay Torborg,et al.  Talisman: commodity realtime 3D graphics for the PC , 1996, SIGGRAPH.

[32]  Peter Shirley,et al.  Visual navigation of large environments using textured clusters , 1995, I3D '95.

[33]  Hugues Hoppe,et al.  Progressive meshes , 1996, SIGGRAPH.

[34]  Marc Olano,et al.  Reflection space image based rendering , 1999, SIGGRAPH.

[35]  Seth Teller,et al.  Visibility Computations in Densely Occluded Polyhedral Environments , 1992 .

[36]  Carlo H. Séquin,et al.  Adaptive display algorithm for interactive frame rates during visualization of complex virtual environments , 1993, SIGGRAPH.

[37]  S. Palmer.  Vision Science : Photons to Phenomenology , 1999 .

[38]  Parris K. Egbert,et al.  Interactive display of very large textures , 1998 .

[39]  Shenchang Eric Chen,et al.  QuickTime VR: an image-based approach to virtual environment navigation , 1995, SIGGRAPH.

[40]  Wolfgang Stuerzlinger,et al.  Interactive Rendering of Globally Illuminated Glossy Scenes , 1997, Rendering Techniques.

[41]  Karol Myszkowski,et al.  The Visible Differences Predictor: Applications to Global Illumination Problems , 1998, Rendering Techniques.

[42]  Tomas Akenine-Möller,et al.  Real-time rendering , 1997 .

[43]  François X. Sillion,et al.  Conservative volumetric visibility with occluder fusion , 2000, SIGGRAPH.

[44]  Peter-Pike J. Sloan,et al.  Interactive ray tracing , 1999, SI3D.

[45]  Donald P. Greenberg,et al.  A model of visual masking for computer graphics , 1997, SIGGRAPH.

[46]  David S. Johnson,et al.  Computers and Intractability: A Guide to the Theory of NP-Completeness , 1978 .

[47]  David Salesin,et al.  Hierarchical image caching for accelerated walkthroughs of complex environments , 1996, SIGGRAPH.

[48]  Markus Wagner,et al.  Interactive Distributed Ray Tracing of Highly Complex Models , 2001, Rendering Techniques.

[49]  Frédo Durand,et al.  A Survey of Visibility for Walkthrough Applications , 2003, IEEE Trans. Vis. Comput. Graph..

[50]  Scott J. Daly,et al.  Visible differences predictor: an algorithm for the assessment of image fidelity , 1992, Electronic Imaging.

[51]  Donald P. Greenberg,et al.  Fitting virtual lights for non-diffuse walkthroughs , 1997, SIGGRAPH.

[52]  François X. Sillion,et al.  Multi‐layered impostors for accelerated rendering , 1999, Comput. Graph. Forum.

[53]  P. Hanrahan,et al.  A Rapid Hierarchical Radiosity Algorithm for Unoccluded Environments , 1992 .

[54]  Markus Wagner,et al.  Interactive Rendering with Coherent Ray Tracing , 2001, Comput. Graph. Forum.

[55]  Maryann Simmons,et al.  The holodeck ray cache: an interactive rendering system for global illumination in nondiffuse environments , 1999, TOGS.

[56]  Hans-Peter Seidel,et al.  Unified Approach to Prefiltered Environment Maps , 2000, Rendering Techniques.

[57]  Juan-Roberto Jiménez,et al.  Interactive rendering of globally illuminated scenes including anisotropic and inhomogeneous participating media , 2005, The Visual Computer.

[58]  Bernice E. Rogowitz,et al.  Are image quality metrics adequate to evaluate the quality of geometric objects? , 2001, IS&T/SPIE Electronic Imaging.

[59]  Maneesh Agrawala,et al.  Rendering from compressed textures , 1996, SIGGRAPH.

[60]  Dani Lischinski,et al.  Image-Based Rendering for Non-Diffuse Synthetic Scenes , 1998, Rendering Techniques.

[61]  Jan Kautz,et al.  Approximation of Glossy Reflection with Prefiltered Environment Maps , 2000, Graphics Interface.

[62]  Donald P. Greenberg,et al.  Toward a psychophysically-based light reflection model for image synthesis , 2000, SIGGRAPH.

[63]  Donald P. Greenberg,et al.  Interactive global illumination in dynamic scenes , 2002, SIGGRAPH.

[64]  Donald P. Greenberg,et al.  Using Perceptual Texture Masking for Efficient Image Synthesis , 2002, Comput. Graph. Forum.

[65]  George Drettakis,et al.  Efficient Glossy Global Illumination with Interactive Viewing , 1999, Comput. Graph. Forum.

[66]  Gary W. Meyer,et al.  A perceptually based adaptive sampling algorithm , 1998, SIGGRAPH.