Hybrid image-/model-based gaze-contingent rendering

A nonisotropic hybrid image-/model-based gaze-contingent rendering technique utilizing ray casting on a GPU is discussed. Empirical evidence derived from human subject experiments indicates an inverse relationship between a peripherally degraded scene's high-resolution inset size and mean search time, a trend consistent with existing image- and model- based techniques. In addition, the data suggest that maintaining a target's silhouette edges decreases search times when compared to targets with degraded edges. Benefits of the hybrid technique include simplicity of design and parallelizability, both conducive to GPU implementation.

[1]  Jack Bresenham,et al.  Algorithm for computer control of a digital plotter , 1965, IBM Syst. J..

[2]  L. Stark,et al.  The main sequence, a tool for studying human eye movements , 1975 .

[3]  James H. Clark,et al.  Hierarchical geometric models for visible surface algorithms , 1976, CACM.

[4]  M. Posner,et al.  Attention and the detection of signals. , 1980, Journal of experimental psychology.

[5]  Allen Newell,et al.  The psychology of human-computer interaction , 1983 .

[6]  James T. Kajiya,et al.  Ray tracing complex scenes , 1986, SIGGRAPH.

[7]  John Amanatides,et al.  A Fast Voxel Traversal Algorithm for Ray Tracing , 1987, Eurographics.

[8]  James Arvo,et al.  A survey of ray tracing acceleration techniques , 1989 .

[9]  Marc Levoy,et al.  Gaze-directed volume rendering , 1990, I3D '90.

[10]  Steven K. Feiner,et al.  Computer graphics: principles and practice (2nd ed.) , 1990 .

[11]  Tony DeRose,et al.  Multiresolution analysis of arbitrary meshes , 1995, SIGGRAPH.

[12]  W. Stürzlinger,et al.  Generating Multiple Levels of Detail from Polygonal Geometry Models , 1995, Virtual Environments.

[13]  Robert J. K. Jacob,et al.  Eye tracking in advanced interface design , 1995 .

[14]  Dinesh Manocha,et al.  OBBTree: a hierarchical structure for rapid interference detection , 1996, SIGGRAPH.

[15]  William Ribarsky,et al.  Real-time, continuous level of detail rendering of height fields , 1996, SIGGRAPH.

[16]  Hideyuki Tamura,et al.  Gaze-directed adaptive rendering for interacting with virtual space , 1996, Proceedings of the IEEE 1996 Virtual Reality Annual International Symposium.

[17]  Kenneth I. Joy,et al.  Free-form deformations with lattices of arbitrary topology , 1996, SIGGRAPH.

[18]  Peter Schröder,et al.  Interactive multiresolution mesh editing , 1997, SIGGRAPH.

[19]  Martin Reddy,et al.  Perceptually modulated level of detail for virtual environments , 1997 .

[20]  Tomas Akenine-Möller,et al.  Fast, Minimum Storage Ray-Triangle Intersection , 1997, J. Graphics, GPU, & Game Tools.

[21]  Donald D. Hoffman,et al.  Salience of visual parts , 1997, Cognition.

[22]  Dieter Schmalstieg,et al.  Smooth levels of detail , 1997, Proceedings of IEEE 1997 Annual International Symposium on Virtual Reality.

[23]  David P. Luebke,et al.  View-dependent simplification of arbitrary polygonal environments , 1997, SIGGRAPH.

[24]  Hugues Hoppe,et al.  View-dependent refinement of progressive meshes , 1997, SIGGRAPH.

[25]  Benjamin Watson,et al.  Managing level of detail through peripheral degradation: effects on search performance with a head-mounted display , 1997, TCHI.

[26]  Benjamin Watson,et al.  Managing level of detail through head-tracked peripheral degradation: a model and resulting design principles , 1997, VRST '97.

[27]  Wilson S. Geisler,et al.  Real-time foveated multiresolution system for low-bandwidth video communication , 1998, Electronic Imaging.

[28]  W. Hayward.  Effects of outline shape in object recognition , 1998 .

[29]  R. Murray,et al.  Saccadic eye movements in families multiply affected with schizophrenia: the Maudsley Family Study. , 1998, The American journal of psychiatry.

[30]  N. P. Bichot,et al.  Visuospatial attention: Beyond a spotlight model , 1999, Psychonomic bulletin & review.

[31]  Robert J. K. Jacob,et al.  Interacting with eye movements in virtual environments , 2000, CHI.

[32]  Eugenio Culurciello,et al.  Evaluating variable resolution displays with visual search: task performance and eye movements , 2000, ETRA.

[33]  Andrew T. Duchowski,et al.  A Platform for Gaze-Contingent Virtual Environments , 2000 .

[34]  Marc Levoy,et al.  QSplat: a multiresolution point rendering system for large meshes , 2000, SIGGRAPH.

[35]  Jordi Ribas-Corbera,et al.  As plain as the noise on your face: Adaptive video compression using face detection and visual eccentricity models , 2001, J. Electronic Imaging.

[36]  Marc Levoy,et al.  Streaming QSplat: a viewer for networked visualization of large, dense models , 2001, I3D '01.

[37]  David P. Luebke,et al.  Perceptually-Driven Simplification for Interactive Rendering , 2001, Rendering Techniques.

[38]  Joonki Paik,et al.  Triangle mesh-based edge detection and its application to surface segmentation and adaptive surface smoothing , 2002, Proceedings. International Conference on Image Processing.

[39]  Ernst Niebur,et al.  Variable-Resolution Displays: A Theoretical, Practical, and Behavioral Evaluation , 2002, Hum. Factors.

[40]  Eric Castet,et al.  Motion perception of saccade-induced retinal translation , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[41]  Hunter A. Murphy,et al.  3-D eye movement analysis , 2002, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[42]  Gerd Marmitt,et al.  Modeling Visual Attention in VR: Measuring the Accuracy of Predicted Scanpaths , 2002, Eurographics.

[43]  Lester C. Loschky,et al.  Investigating spatial vision and dynamic attentional selection using a gaze-contingent multiresolutional display. , 2002, Journal of experimental psychology. Applied.

[44]  I. Biederman,et al.  Effects of illumination intensity and direction on object coding in macaque inferior temporal cortex. , 2002, Cerebral cortex.

[45]  D. Luebke,et al.  Perceptually Driven Interactive Rendering , 2002 .

[46]  C. Joyce,et al.  Tracking eye fixations with electroocular and electroencephalographic recordings. , 2002, Psychophysiology.

[47]  J. Baron,et al.  Notes on the use of R for psychology experiments and questionnaires , 2003 .

[48]  A. Kingstone,et al.  Topic: Cognition , 2003 .

[49]  Jonathan D. Cohen,et al.  Perceptually guided simplification of lit, textured meshes , 2003, I3D '03.

[50]  C. Masters,et al.  Spectrum of saccade system function in Alzheimer disease. , 2003, Archives of neurology.

[51]  Andrew T. Duchowski,et al.  Eye Tracking Methodology: Theory and Practice , 2003, Springer London.

[52]  Lester C. Loschky,et al.  Gaze-Contingent Multiresolutional Displays: An Integrative Review , 2003, Hum. Factors.

[53]  Thanh Giang,et al.  Evaluating the visual fidelity of physically based animations , 2003, ACM Trans. Graph..

[54]  James A. Ferwerda,et al.  Three varieties of realism in computer graphics , 2003, IS&T/SPIE Electronic Imaging.

[55]  Peter Bergström.  Eye-movement controlled image coding , 2003 .

[56]  J. Smeets,et al.  Nature of variability in saccades. , 2003, Journal of neurophysiology.

[57]  Benjamin Watson,et al.  Supra-threshold control of peripheral LOD , 2004, SIGGRAPH 2004.

[58]  Robert S. Allison,et al.  Using Saccadic Suppression to Hide Graphic Updates , 2004, EGVE.

[59]  Andrew T. Duchowski,et al.  Gaze-Contingent Displays: A Review , 2004, Cyberpsychology Behav. Soc. Netw..

[60]  D. Pelli,et al.  Crowding is unlike ordinary masking: distinguishing feature integration from detection. , 2004, Journal of vision.

[61]  Ernst Niebur,et al.  A feasibility test for perceptually adaptive level of detail rendering on desktop systems , 2004, APGV '04.

[62]  Laurent Itti,et al.  Automatic foveation for video compression using a neurobiological model of visual attention , 2004, IEEE Transactions on Image Processing.

[63]  Pat Hanrahan,et al.  Ray tracing on programmable graphics hardware , 2002, SIGGRAPH Courses.

[64]  Lester C. Loschky,et al.  The limits of visual resolution in natural scene viewing , 2005 .

[65]  Benjamin Watson,et al.  Adaptive frameless rendering , 2005, EGSR '05.

[66]  Martin Reddy,et al.  Specification and evaluation of level of detail selection criteria , 1998, Virtual Reality.

[67]  Jeffrey S. Perry,et al.  Visual search: the role of peripheral information measured using gaze-contingent displays. , 2006, Journal of vision.

[68]  Aaron Knoll,et al.  Ray tracing animated scenes using coherent grid traversal , 2006, SIGGRAPH 2006.

[69]  Hans-Peter Seidel,et al.  Stackless KD‐Tree Traversal for High Performance GPU Ray Tracing , 2007, Comput. Graph. Forum.

[70]  E. Louie,et al.  Holistic crowding: selective interference between configural representations of faces in crowded scenes. , 2007, Journal of vision.

[71]  Arzu Çöltekin,et al.  Foveated gaze-contingent displays for peripheral LOD management, 3D visualization, and stereo imaging , 2007, TOMCCAP.

[72]  Ann McNamara,et al.  Subtle gaze direction , 2007, SIGGRAPH '07.

[73]  Lester C. Loschky,et al.  How late can you update gaze-contingent multiresolutional displays without detection? , 2007, TOMCCAP.

[74]  Andrew T. Duchowski,et al.  Hybrid image-/model-based gaze-contingent rendering , 2007, APGV.