Stylization-based ray prioritization for guaranteed frame rates

This paper presents a new method to control graceful scene degradation in complex ray-based rendering environments. It proposes to constrain the image sampling density with object features, which are known to support the comprehension of the three-dimensional shape. The presented method uses Non-Photorealistic Rendering (NPR) techniques to extract features such as silhouettes, suggestive contours, suggestive highlights, ridges and valleys. To map different feature types to sampling densities, we also present an evaluation of the features impact on the resulting image quality. To reconstruct the image from sparse sampling data, we use linear interpolation on an adaptively aligned fractal pattern. With this technique, we are able to present an algorithm that guarantees a desired minimal frame rate without much loss of image quality. Our scheduling algorithm maximizes the use of each given time slice by rendering features in order of their corresponding importance values until a time constraint is reached. We demonstrate how our method can be used to boost and guarantee the rendering time in complex ray-based environments consisting of geometric as well as volumetric data.

[1]  Adam Finkelstein,et al.  Where do people draw lines , 2008, SIGGRAPH 2008.

[2]  Martin Kraus,et al.  High-quality pre-integrated volume rendering using hardware-accelerated pixel shading , 2001, HWWS '01.

[3]  Joe Michael Kniss,et al.  Interactive volume rendering using multi-dimensional transfer functions and direct manipulation widgets , 2001, Proceedings Visualization, 2001. VIS '01..

[4]  Donald P. Greenberg,et al.  A perceptually based physical error metric for realistic image synthesis , 1999, SIGGRAPH.

[5]  Don P. Mitchell,et al.  Generating antialiased images at low sampling densities , 1987, SIGGRAPH.

[6]  Philipp Slusallek,et al.  Interactive Ray Tracing for Virtual TV Studio Applications , 2005, J. Virtual Real. Broadcast..

[7]  Pat Hanrahan,et al.  Fast algorithms for volume ray tracing , 1992, VVS.

[8]  Kenneth R. Sloan,et al.  Accelerated volume rendering using homogeneous region encoding , 1997 .

[9]  Samuel P. Uselton,et al.  Statistically optimized sampling for distributed ray tracing , 1985, SIGGRAPH.

[10]  Alan C. Bovik,et al.  Mean squared error: Love it or leave it? A new look at Signal Fidelity Measures , 2009, IEEE Signal Processing Magazine.

[11]  Mark A. Z. Dippé,et al.  Antialiasing through stochastic sampling , 1985, SIGGRAPH.

[12]  Klaus Mueller,et al.  Empty space skipping and occlusion clipping for texture-based volume rendering , 2003, IEEE Visualization, 2003. VIS 2003..

[13]  Peter-Pike J. Sloan,et al.  Interactive ray tracing , 2005, SIGGRAPH Courses.

[14]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[15]  Stefan Bruckner,et al.  Interactive Illustrative Volume Visualization , 2008 .

[16]  William E. Lorensen,et al.  The visualization toolkit (2nd ed.): an object-oriented approach to 3D graphics , 1998 .

[17]  J. Painter,et al.  Antialiased ray tracing by adaptive progressive refinement , 1989, SIGGRAPH.

[18]  David P. Luebke,et al.  View-dependent simplification of arbitrary polygonal environments , 1997, SIGGRAPH.

[19]  Szymon Rusinkiewicz,et al.  Highlight lines for conveying shape , 2007, NPAR '07.

[20]  Rüdiger Westermann,et al.  Level-of-detail volume rendering via 3D textures , 2000, VVS.

[21]  Bernd Hamann,et al.  Multiresolution techniques for interactive texture-based volume visualization , 1999, Proceedings Visualization '99 (Cat. No.99CB37067).

[22]  Adam Finkelstein,et al.  Line drawings from volume data , 2005, SIGGRAPH 2005.

[23]  William E. Lorensen,et al.  Marching cubes: A high resolution 3D surface construction algorithm , 1987, SIGGRAPH.

[24]  Randima Fernando,et al.  GPU Gems: Programming Techniques, Tips and Tricks for Real-Time Graphics , 2004 .

[25]  Adam Finkelstein,et al.  Where do people draw lines? , 2008, ACM Trans. Graph..

[26]  Gabriel Taubin,et al.  A signal processing approach to fair surface design , 1995, SIGGRAPH.

[27]  Ingo Wald A Flexible and Scalable Rendering Engine for Interactive 3D Graphics , 2002 .

[28]  Dieter Schmalstieg,et al.  Multi-Frame Rate Volume Rendering , 2010, EGPGV@Eurographics.

[29]  Ingo Wald,et al.  State of the Art in Ray Tracing Animated Scenes , 2009, Comput. Graph. Forum.

[30]  Roberto Scopigno,et al.  Multiresolution volume visualization with a texture-based octree , 2001, The Visual Computer.

[31]  Isaac Amidror,et al.  Scattered data interpolation methods for electronic imaging systems: a survey , 2002, J. Electronic Imaging.

[32]  Martin Kraus,et al.  Topology-Guided Downsampling , 2001, VG.

[33]  Marc Levoy,et al.  Volume rendering by adaptive refinement , 1990, The Visual Computer.

[34]  Martin Kraus,et al.  Efficient image reconstruction for point-based and line-based rendering , 2008, Comput. Graph..

[35]  Pradeep Dubey,et al.  Larrabee: A Many-Core x86 Architecture for Visual Computing , 2009, IEEE Micro.

[36]  Hans-Peter Seidel,et al.  Faster isosurface ray tracing using implicit KD-trees , 2005, IEEE Transactions on Visualization and Computer Graphics.

[37]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[38]  David K. McAllister,et al.  OptiX: a general purpose ray tracing engine , 2010, ACM Trans. Graph..

[39]  Matthias Zwicker,et al.  Surfels: surface elements as rendering primitives , 2000, SIGGRAPH.

[40]  William J. Dally,et al.  Point Sample Rendering , 1998, Rendering Techniques.

[41]  Joseph JáJá,et al.  Interactive High-Resolution Isosurface Ray Casting on Multicore Processors , 2008, IEEE Transactions on Visualization and Computer Graphics.

[42]  Richard Szeliski,et al.  The lumigraph , 1996, SIGGRAPH.

[43]  Michael Wimmer,et al.  Automatic impostor placement for guaranteed frame rates and low memory requirements , 2005, I3D '05.

[44]  Benjamin Watson,et al.  Adaptive frameless rendering , 2005, EGSR '05.

[45]  Craig Gotsman,et al.  Parallel Progressive Ray‐tracing , 1997, Comput. Graph. Forum.