Directing attention and influencing memory with visual saliency modulation

In augmented reality, it is often necessary to draw the user's attention to particular objects in the real world without distracting her from her task. We explore the effectiveness of directing a user's attention by imperceptibly modifying existing features of a video. We present three user studies of the effects of applying a saliency modulation technique to video; evaluating modulation awareness, attention, and memory. Our results validate the saliency modulation technique as an alternative means to convey information to the user, suggesting attention shifts and influencing recall of selected regions without perceptible changes to visual input.

[1]  Laurent Itti,et al.  Models of Bottom-up Attention and Saliency , 2005 .

[2]  Holger Regenbrecht,et al.  Techniques for view transition in multi-camera outdoor environments , 2010, Graphics Interface.

[3]  J. Wolfe,et al.  What attributes guide the deployment of visual attention and how do they do it? , 2004, Nature Reviews Neuroscience.

[4]  Frédo Durand,et al.  De-emphasis of distracting image regions using texture power maps , 2005, APGV '05.

[5]  E. Vogel,et al.  Interactions between attention and working memory , 2006, Neuroscience.

[6]  Steven K. Feiner,et al.  Focus and Context in Mixed Reality by Modulating First Order Salient Features , 2010, Smart Graphics.

[7]  M. Chun,et al.  Interactions between attention and memory , 2007, Current Opinion in Neurobiology.

[8]  Douglas DeCarlo,et al.  Visual interest and NPR: an evaluation and manifesto , 2004, NPAR '04.

[9]  Ann McNamara,et al.  Subtle gaze direction , 2007, SIGGRAPH '07.

[10]  S Ullman,et al.  Shifts in selective visual attention: towards the underlying neural circuitry. , 1985, Human neurobiology.

[11]  Laurent Itti,et al.  Memory, eye position and computed saliency , 2010 .

[12]  Amitabh Varshney,et al.  Persuading Visual Attention through Geometry , 2008, IEEE Transactions on Visualization and Computer Graphics.

[13]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[14]  Ronald A. Rensink,et al.  On the Failure to Detect Changes in Scenes Across Brief Interruptions , 2000 .

[15]  Heinz Hügli,et al.  Empirical Validation of the Saliency-based Model of Visual Attention , 2003 .

[16]  Amitabh Varshney,et al.  Saliency-guided Enhancement for Volume Visualization , 2006, IEEE Transactions on Visualization and Computer Graphics.

[17]  Laurent Itti,et al.  Visual salience , 2007, Scholarpedia.

[18]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[19]  Sungkil Lee,et al.  Real-time tracking of visually attended objects in interactive virtual environments , 2007, VRST '07.

[20]  Michael S. Fine,et al.  Visual Salience Affects Performance in a Working Memory Task , 2009, The Journal of Neuroscience.