Dynamic Intelligent Lighting for Directing Visual Attention in Interactive 3-D Scenes

Recent enhancements in real-time graphics have facilitated the design of high fidelity game environments with complex 3-D worlds inhabited by animated characters. Under such settings, it is hard, especially for the untrained eyes, to attend to an object of interest. Neuroscience research as well as film and theatre practice identified several visual properties, such as contrast, orientation, and color that play a major role in channeling attention. In this paper, we discuss an adaptive lighting design system called adaptive lighting for visual attention (ALVA) that dynamically adjusts the lighting color and brightness to enhance visual attention within game environments using features identified by neuroscience, psychophysics, and visual design literature. We also discuss some preliminary results showing the utility of ALVA in directing player's attention to important elements in a fast paced 3-D game, and thus enhancing the game experience especially for nongamers who are not visually trained to spot objects or characters in such complex 3-D worlds.

[1]  Michael D. Byrne,et al.  ACT-R/PM and menu selection: applying a cognitive architecture to HCI , 2001, Int. J. Hum. Comput. Stud..

[2]  Vishal Vaingankar,et al.  Goal Directed Visual Search Based on Color Cues: Co-operative Effectes of Top-Down & Bottom-Up Visual Attention , 2004 .

[3]  Jochen Braun,et al.  Modeling the Modulatory Effect of Attention on Human Spatial Vision , 2001, NIPS.

[4]  A. Treisman.  Visual Attention and the Perception of Features and Objects , 1994 .

[5]  C. Koch,et al.  A saliency-based search mechanism for overt and covert shifts of visual attention , 2000, Vision Research.

[6]  Magy Seif El-Nasr,et al.  Automating Lighting Design for Interactive Entertainment , 2004, CIE.

[7]  Magy Seif El-Nasr,et al.  Intelligent Lighting for Game Environments , 2005, J. Game Dev..

[8]  Simon Niedenthal,et al.  Shadowplay: Simulated Illumination in Game Worlds , 2005, DiGRA Conference.

[9]  Allen Allport,et al.  Visual attention , 1989 .

[10]  Gerhard Krieger,et al.  Scene analysis with saccadic eye movements: Top-down and bottom-up modeling , 2001, J. Electronic Imaging.

[11]  Magy Seif El-Nasr,et al.  Visual attention in 3D video games , 2006, ACE '06.

[12]  Magy Seif El-Nasr,et al.  Real-Time Lighting Design for Interactive Narrative , 2003, International Conference on Virtual Storytelling.

[13]  S Ullman,et al.  Shifts in selective visual attention: towards the underlying neural circuitry. , 1985, Human neurobiology.

[14]  Christof Koch,et al.  Feature combination strategies for saliency-based visual attention systems , 2001, J. Electronic Imaging.

[15]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[16]  C. Koch,et al.  Computational modelling of visual attention , 2001, Nature Reviews Neuroscience.

[17]  Jeremy M Wolfe,et al.  Visual Attention , 2020, Computational Models for Cognitive Vision.

[18]  S R Shemitz,et al.  Designing with light. , 1982, Interior design.

[19]  Magy Seif El-Nasr,et al.  Automatic expressive lighting for interactive scenes , 2003 .

[20]  Simon Niedenthal,et al.  Shadowplay workshop , 2005, DiGRA Conference.

[21]  K. Plataniotis,et al.  Color Image Processing and Applications , 2000 .

[22]  Laurent Itti,et al.  A Goal Oriented Attention Guidance Model , 2002, Biologically Motivated Computer Vision.

[23]  Bärbel Mertsching,et al.  Integration of Static and Dynamic Scene Features Guiding Visual Attention , 1997, DAGM-Symposium.