Spatiotemporal sensitivity and visual attention for efficient rendering of dynamic environments

We present a method to accelerate global illumination computation in prerendered animations by taking advantage of limitations of the human visual system. A spatiotemporal error tolerance map, constructed from psychophysical data based on velocity dependent contrast sensitivity, is used to accelerate rendering. The error map is augmented by a model of visual attention in order to account for the tracking behavior of the eye. Perceptual acceleration combined with good sampling protocols provide a global illumination solution feasible for use in animation. Results indicate an order of magnitude improvement in computational speed.

[1]  Don P. Mitchell,et al.  Generating antialiased images at low sampling densities , 1987, SIGGRAPH.

[2]  Pietro Perona,et al.  Overcomplete steerable pyramid filters and rotation invariance , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[3]  Maneesh Agrawala,et al.  Model-based motion estimation for synthetic animations , 1995, MULTIMEDIA '95.

[4]  Scott J. Daly,et al.  Visible differences predictor: an algorithm for the assessment of image fidelity , 1992, Electronic Imaging.

[5]  Karol Myszkowski,et al.  The Visible Differences Predictor: Applications to Global Illumination Problems , 1998, Rendering Techniques.

[6]  Jr. Leonard McMillan,et al.  An Image-Based Approach to Three-Dimensional Computer Graphics , 1997 .

[7]  Ramin Zabih,et al.  Non-parametric Local Transforms for Computing Visual Correspondence , 1994, ECCV.

[8]  A. Leventhal.  The neural basis of visual function , 1991 .

[9]  Eric Horvitz,et al.  Perception, Attention, and Resources: A Decision-Theoretic Approach to Graphics Rendering , 1997, UAI.

[10]  Gary W. Meyer,et al.  Comparison of two image quality models , 1998, Electronic Imaging.

[11]  Donald P. Greenberg,et al.  A model of visual adaptation for realistic image synthesis , 1996, SIGGRAPH.

[12]  J. Painter,et al.  Antialiased ray tracing by adaptive progressive refinement , 1989, SIGGRAPH.

[13]  Gary W. Meyer,et al.  Color spatial acuity control of a screen subdivision image synthesis algorithm , 1992, Electronic Imaging.

[14]  Jordi Ribas-Corbera,et al.  Visual eccentricity models in face-based video compression , 1999, Electronic Imaging.

[15]  Samuel P. Uselton,et al.  Statistically optimized sampling for distributed ray tracing , 1985, SIGGRAPH.

[16]  Dan S. Wallach,et al.  Accelerated MPEG compression of dynamic polygonal scenes , 1994, SIGGRAPH.

[17]  Gary W. Meyer,et al.  A perceptually based adaptive sampling algorithm , 1998, SIGGRAPH.

[18]  Karol Myszkowski,et al.  Perceptually-Informed Accelerated Rendering of High Quality Walkthrough Sequences , 1999, Rendering Techniques.

[19]  A. L. I︠A︡rbus.  Eye Movements and Vision , 1967 .

[20]  Christine D. Piatko,et al.  A visibility matching tone reproduction operator for high dynamic range scenes , 1997 .

[21]  Donald P. Greenberg,et al.  A model of visual masking for computer graphics , 1997, SIGGRAPH.

[22]  Scott Daly,et al.  Engineering observations from spatiovelocity and spatiotemporal visual models , 1998, Electronic Imaging.

[23]  James Arvo,et al.  Unbiased sampling techniques for image synthesis , 1991, SIGGRAPH.

[24]  HanrahanPat,et al.  Direct WYSIWYG painting and texturing on 3D shapes , 1990 .

[25]  Christof Koch,et al.  Comparison of feature combination strategies for saliency-based visual attention systems , 1999, Electronic Imaging.

[26]  Donald P. Greenberg.  A framework for realistic image synthesis , 1999, CACM.

[27]  S Ullman,et al.  Shifts in selective visual attention: towards the underlying neural circuitry. , 1985, Human neurobiology.

[28]  Roger J. Hubbold,et al.  Perceptually‐Driven Radiosity , 1997, Comput. Graph. Forum.

[29]  James T. Kajiya,et al.  The rendering equation , 1998 .

[30]  S. Yantis.  2. Attentional capture in vision , 1996 .

[31]  Roberto Scopigno,et al.  Computer Graphics forum , 2003, Computer Graphics Forum.

[32]  A. L. Yarbus,et al.  Eye Movements and Vision , 1967, Springer US.

[33]  Christine D. Piatko,et al.  A visibility matching tone reproduction operator for high dynamic range scenes , 1997, SIGGRAPH '97.

[34]  Jeffrey Lubin,et al.  A VISUAL DISCRIMINATION MODEL FOR IMAGING SYSTEM DESIGN AND EVALUATION , 1995 .

[35]  D. H. Kelly.  Motion and vision. II. Stabilized spatio-temporal threshold surface. , 1979, Journal of the Optical Society of America.

[36]  Gary W. Meyer,et al.  A frequency based ray tracer , 1995, SIGGRAPH.

[37]  Christof Koch,et al.  Learning to Detect Salient Objects in Natural Scenes Using Visual Attention , 1999 .

[38]  Donald P. Greenberg,et al.  A perceptually based physical error metric for realistic image synthesis , 1999, SIGGRAPH.

[39]  오승준.  [서평]「Digital Video Processing」 , 1996 .

[40]  J. Robson,et al.  Application of fourier analysis to the visibility of gratings , 1968, The Journal of physiology.

[41]  C. Koch,et al.  A saliency-based search mechanism for overt and covert shifts of visual attention , 2000, Vision Research.

[42]  Edward H. Adelson,et al.  The Laplacian Pyramid as a Compact Image Code , 1983, IEEE Trans. Commun..

[43]  Werner Purgathofer,et al.  Overview of Perceptually-Driven Radiosity Methods , 1999 .

[44]  John K. Tsotsos,et al.  Modeling Visual Attention via Selective Tuning , 1995, Artif. Intell..

[45]  Edward H. Adelson,et al.  The Design and Use of Steerable Filters , 1991, IEEE Trans. Pattern Anal. Mach. Intell..