Perception, Attention, and Resources: A Decision-Theoretic Approach to Graphics Rendering

We describe work to control graphics rendering under limited computational resources by taking a decision-theoretic perspective on perceptual costs and computational savings of approximations. The work extends earlier work on the control of rendering by introducing methods and models for computing the expected cost associated with degradations of scene components. The expected cost is computed by considering the perceptual cost of degradations and a probability distribution over the attentional focus of viewers. We review the critical literature describing findings on visual search and attention, discuss the implications of the findings, and introduce models of expected perceptual cost. Finally, we discuss policies that harness information about the expected cost of scene components.

[1]  C. Eriksen,et al.  Temporal and spatial characteristics of selective encoding from visual displays , 1972 .

[2]  C. Eriksen,et al.  Visual attention within and around the field of focal attention: A zoom lens model , 1986, Perception & psychophysics.

[3]  J. Beck,et al.  The effects of concentrated and distributed attention on peripheral acuity , 1973 .

[4]  Sartaj Sahni,et al.  Approximate Algorithms for the 0/1 Knapsack Problem , 1975, JACM.

[5]  C. Eriksen,et al.  Allocation of attention in the visual field. , 1985, Journal of experimental psychology. Human perception and performance.

[6]  Leonard McMillan,et al.  Plenoptic Modeling: An Image-Based Rendering System , 2023 .

[7]  Lance Williams,et al.  View Interpolation for Image Synthesis , 1993, SIGGRAPH.

[8]  P. Cavanagh,et al.  Effect of surface medium on visual search for orientation and size features. , 1990, Journal of experimental psychology. Human perception and performance.

[9]  C. Eriksen,et al.  Allocation of attention in the visual field. , 1985, Journal of experimental psychology. Human perception and performance.

[10]  C. Eriksen,et al.  Selective encoding from multielement visual displays , 1973 .

[11]  Drew H. Abney,et al.  Journal of Experimental Psychology : Human Perception and Performance Influence of Musical Groove on Postural Sway , 2015 .

[12]  G. Shulman,et al.  Spatial determinants of the distribution of attention , 1985, Perception & psychophysics.

[13]  David S. Johnson,et al.  Computers and Intractability: A Guide to the Theory of NP-Completeness , 1978 .

[14]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[15]  Hugues Hoppe,et al.  Progressive meshes , 1996, SIGGRAPH.

[16]  P. Goolkasian,et al.  Retinal location and its effect on the processing of target and distractor information. , 1981, Journal of experimental psychology. Human perception and performance.

[17]  R. Shiffrin,et al.  Visual processing capacity and attentional control. , 1972, Journal of experimental psychology.

[18]  R. Shepard,et al.  Distribution of visual attention over space. , 1983, Journal of experimental psychology. Human perception and performance.

[19]  Howard E. Egeth,et al.  Attention and Preattention , 1977 .

[20]  David Salesin,et al.  Hierarchical image caching for accelerated walkthroughs of complex environments , 1996, SIGGRAPH.

[21]  G. Humphreys On Varying the Span of Visual Attention: Evidence for Two Modes of Spatial Attention , 1981 .

[22]  M. Posner,et al.  Orienting of Attention* , 1980, The Quarterly journal of experimental psychology.

[23]  Ronald Pose,et al.  Priority rendering with a virtual reality address recalculation pipeline , 1994, SIGGRAPH.

[24]  G Sperling,et al.  The attention operating characteristic: examples from visual search. , 1978, Science.

[25]  U. Neisser Decision-time without reaction-time: Experiments in visual scanning. , 1963 .

[26]  William Prinzmetal,et al.  Perceptual capacity limits in visual detection and search , 1983 .

[27]  Carlo H. Séquin,et al.  Adaptive display algorithm for interactive frame rates during visualization of complex virtual environments , 1993, SIGGRAPH.

[28]  J. Jonides Further toward a model of the Mind’s eye’s movement , 1983 .

[29]  Marilyn L. Shaw,et al.  A capacity allocation model for reaction time. , 1978 .

[30]  Susan L. Franzel,et al.  Guided search: an alternative to the feature integration model for visual search. , 1989, Journal of experimental psychology. Human perception and performance.

[31]  Jay Torborg,et al.  Talisman: commodity realtime 3D graphics for the PC , 1996, SIGGRAPH.

[32]  R. A. Kinchla,et al.  Detecting target elements in multielement arrays: A confusability model , 1974 .