Gaze-contingent display using texture mapping and OpenGL: system and applications

This paper describes a novel gaze-contingent display (GCD) using texture mapping and OpenGL. This new system has a number of key features: (a) it is platform independent, i.e. it runs on different computers and under different operating systems; (b) it is eyetracker independent, since it provides an interactive focus+context display that can be easily integrated with any eye-tracker that provides real-time 2-D gaze estimation; (c) it is flexible in that it provides for straightforward modification of the main GCD parameters, including size and shape of the window and its border; and (d) through the use of OpenGL extensions it can perform local real-time image analysis within the GCD window. The new GCD system implementation is described in detail and some performance figures are given. Several applications of this system are studied, including gaze-contingent multi-resolution displays, gaze-contingent multi-modality displays, and gaze-contingent image analysis.

[1]  G. McConkie,et al.  The span of the effective stimulus during a fixation in reading , 1975 .

[2]  G. K. Noorden.  Movements of the Eyes , 1978 .

[3]  S Saida,et al.  Useful visual field size for pattern perception , 1979, Perception & psychophysics.

[4]  Carl F. R. Weiman,et al.  Video compression via log polar mapping , 1990, Defense, Security, and Sensing.

[5]  システムソフトエンジニアリング.  OpenGL programming guide(日本語版) : the official guide to learning OpenGL, release 1 , 1993 .

[6]  Tom Davis,et al.  Opengl programming guide: the official guide to learning opengl , 1993 .

[7]  Peter De Graef,et al.  On-line control of moving masks and windows on a complex background using the ATVista videographics adapter , 1994 .

[8]  G. Dagnelie,et al.  Toward an artificial eye , 1996 .

[9]  Benjamin Watson,et al.  Managing level of detail through peripheral degradation: effects on search performance with a head-mounted display , 1997, TCHI.

[10]  P M van Diepen,et al.  A pixel-resolution video switcher for eye-contingent display changes. , 1997, Spatial vision.

[11]  Wilson S. Geisler,et al.  Real-time foveated multiresolution system for low-bandwidth video communication , 1998, Electronic Imaging.

[12]  K. Rayner.  Eye movements in reading and information processing: 20 years of research. , 1998, Psychological bulletin.

[13]  Wilson S. Geisler,et al.  Variable‐Resolution Displays for Visual Communication and Simulation , 1999 .

[14]  Lester C. Loschky,et al.  User performance with gaze contingent multiresolutional displays , 2000, ETRA.

[15]  S. G. Nikolov,et al.  Volume visualisation via region enhancement around an observer's fixation point , 2000 .

[16]  M. Pomplun,et al.  Investigating the visual span in comparative search: the effects of task difficulty and divided attention , 2001, Cognition.

[17]  M. Pomplun,et al.  Peripheral and parafoveal cueing and masking effects on saccadic selectivity in a gaze-contingent window paradigm , 2001, Vision Research.

[18]  N. Charness,et al.  Visual Span in Expert Chess Players: Evidence From Eye Movements , 2001, Psychological science.

[19]  Ernst Niebur,et al.  Variable-Resolution Displays: A Theoretical, Practical, and Behavioral Evaluation , 2002, Hum. Factors.

[20]  David R. Bull,et al.  Gaze-Contingent Multi-modality Displays of Multi-layered Geographical Maps , 2002, Numerical Methods and Application.

[21]  Andrew T Duchowski,et al.  A breadth-first survey of eye-tracking applications , 2002, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[22]  Lester C. Loschky,et al.  Reduced saliency of peripheral targets in gaze-contingent multi-resolutional displays: blended versus sharp boundary windows , 2002, ETRA.

[23]  Wilson S. Geisler,et al.  Real-time simulation of arbitrary visual fields , 2002, ETRA.

[24]  Stavri G. Nikolov,et al.  Multi-modality gaze-contingent displays for image fusion , 2002, Proceedings of the Fifth International Conference on Information Fusion. FUSION 2002. (IEEE Cat.No.02EX5997).

[25]  David Bull,et al.  A system for gaze-contingent image analysis and multi-sensorial image display , 2003, Sixth International Conference of Information Fusion, 2003. Proceedings of the.

[26]  Andrew T. Duchowski,et al.  Eye Tracking Methodology: Theory and Practice , 2003, Springer London.

[27]  Mark Segal,et al.  The OpenGL Graphics System: A Specification , 2004 .

[28]  Lester C. Loschky,et al.  User Performance With Gaze Contingent Displays , 2022 .