Joint visual attention and rendering complexity based sample rate estimation in selective rendering

In this work, a sample rate estimator is proposed for selective graphics rendering so that the samples are allocated such that the best perceived image quality can be achieved under a given sample budget. In the proposed estimator, the sample rate of a pixel is decided by not only the visual attention (VA) level of the region to which the pixel belongs but also the required rendering complexity (RC) level of the pixel. The VA and RC values are determined based on the phase-spectrum of the Fourier transform (PFT). Compared with existing sample rate estimators for selective rendering that only consider the VA information, the proposed estimator helps to produce synthesized images with higher perceived quality using the same number of samples.

[1]  Luís Paulo Santos,et al.  There-Reality: Selective Rendering in High Fidelity Virtual Environments , 2007, Int. J. Virtual Real..

[2]  Hans-Peter Seidel,et al.  Perceptually Guided Corrective Splatting , 2001, Comput. Graph. Forum.

[3]  Insung Ihm,et al.  Selective and adaptive supersampling for real-time ray tracing , 2009, High Performance Graphics.

[4]  James T. Kajiya,et al.  The rendering equation , 1998 .

[5]  Don P. Mitchell,et al.  Generating antialiased images at low sampling densities , 1987, SIGGRAPH.

[6]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[7]  Liming Zhang,et al.  Spatio-temporal Saliency detection using phase spectrum of quaternion fourier transform , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Matthias Zwicker,et al.  Multidimensional adaptive sampling and reconstruction for ray tracing , 2008, ACM Trans. Graph..

[9]  Greg Humphreys,et al.  Physically Based Rendering: From Theory to Implementation , 2004 .

[10]  R. Ramamoorthi,et al.  Adaptive wavelet rendering , 2009, SIGGRAPH 2009.

[11]  Dirk Bartz,et al.  State-of-the-Art of the Role of Perception for Computer Graphics , 2008 .

[12]  Sungkil Lee,et al.  Real-Time Tracking of Visually Attended Objects in Virtual Environments and Its Application to LOD , 2009, IEEE Transactions on Visualization and Computer Graphics.

[13]  Kurt Debattista,et al.  A GPU based saliency map for high-fidelity selective rendering , 2006, AFRIGRAPH '06.