Influence of reward learning on visual attention and eye movements in a naturalistic environment: A virtual reality study

Rewards constitute crucial signals that motivate approach behavior and facilitate the perceptual processing of objects associated with favorable outcomes in past encounters. Reward-related influences on perception and attention have been reliably observed in studies where a reward is paired with a unidimensional low-level visual feature, such as the color or orientation of a line in visual search tasks. However, our environment is drastically different and composed of multidimensional and changing visual features, encountered in complex and dynamic scenes. Here, we designed an immersive virtual reality (VR) experiment using a 4-frame CAVE system to investigate the impact of rewards on attentional orienting and gaze patterns in a naturalistic and ecological environment. Forty-one healthy participants explored a virtual forest and responded to targets appearing on either the left or right side of their path. To test for reward-induced biases in spatial orienting, targets on one side were associated with high reward, whereas those on the opposite side were paired with a low reward. Eye-movements recording showed that left-side high rewards led to subsequent increase of eye gaze fixations towards this side of the path, but no such asymmetry was found after exposure to right-sided high rewards. A milder spatial bias was also observed after left-side high rewards during subsequent exploration of a virtual castle yard, but not during route turn choices along the forest path. Our results indicate that reward-related influences on attention and behavior may be better learned in left than right space, in line with a right hemisphere dominance, and could generalize to another environment to some extent, but not to spatial choices in another decision task, suggesting some domain- or context-specificity. This proof-of-concept study also outlines the advantages and the possible drawbacks of the use of the 3D CAVE immersive platform for VR in neuroscience.

[1]  Steven Yantis,et al.  Learned Value Magnifies Salience-Based Attentional Capture , 2011, PloS one.

[2]  C. Koch,et al.  Simultaneous modeling of visual saliency and value computation improves predictions of economic choice , 2013, Proceedings of the National Academy of Sciences.

[3]  M. Catani,et al.  A lateralized brain network for visuospatial attention , 2011, Nature Neuroscience.

[4]  M. McCourt,et al.  Pseudoneglect: a review and meta-analysis of performance factors in line bisection tasks , 2000, Neuropsychologia.

[5]  P. Bartolomeo,et al.  Cortical control of Inhibition of Return: Exploring the causal contributions of the left parietal cortex , 2013, Cortex.

[6]  Hyoung F. Kim,et al.  Why skill matters , 2013, Trends in Cognitive Sciences.

[7]  O. Hikosaka,et al.  Comparison of Reward Modulation in the Frontal Eye Field and Caudate of the Macaque , 2006, The Journal of Neuroscience.

[8]  J. Theeuwes,et al.  Reward grabs the eye: Oculomotor capture by rewarding stimuli , 2012, Vision Research.

[9]  C. Kennard,et al.  Impaired spatial working memory across saccades contributes to abnormal search in parietal neglect. , 2001, Brain : a journal of neurology.

[10]  P. Bartolomeo,et al.  Cortical control of inhibition of return: Causal evidence for task-dependent modulations by dorsal and ventral parietal regions , 2013, Cortex.

[11]  L. Chelazzi,et al.  Altering Spatial Priority Maps via Reward-Based Learning , 2014, The Journal of Neuroscience.

[12]  Patryk A. Laurent,et al.  Generalization of value-based attentional priority , 2012, Visual cognition.

[13]  Dean F. Wong,et al.  The Role of Dopamine in Value-Based Attentional Orienting , 2016, Current Biology.

[14]  W. Zoest,et al.  Reward creates oculomotor salience , 2012, Current Biology.

[15]  P. Vuilleumier,et al.  Mapping the functional neuroanatomy of spatial neglect and human parietal lobe functions: progress and challenges , 2013, Annals of the New York Academy of Sciences.

[16]  P. Vuilleumier,et al.  How does reward compete with goal-directed and stimulus-driven shifts of attention? , 2017, Cognition & emotion.

[17]  Patrik Vuilleumier,et al.  How Does Awareness Modulate Goal-Directed and Stimulus-Driven Shifts of Attention Triggered by Value Learning? , 2016, PloS one.

[18]  H. Aarts,et al.  Unconscious reward cues increase invested effort, but do not change speed–accuracy tradeoffs , 2010, Cognition.

[19]  Richard E Carson,et al.  Lateralization and gender differences in the dopaminergic response to unpredictable reward in the human ventral striatum , 2011, The European journal of neuroscience.

[20]  Lesley K Fellows,et al.  Ventromedial Frontal Cortex Is Critical for Guiding Attention to Reward-Predictive Visual Features in Humans , 2015, The Journal of Neuroscience.

[21]  Jan Theeuwes,et al.  Effects of reward on oculomotor control. , 2016, Journal of neurophysiology.

[22]  Patryk A. Laurent,et al.  Value-driven attentional capture , 2011, Proceedings of the National Academy of Sciences.

[23]  W. Zoest,et al.  Reward-associated stimuli capture the eyes in spite of strategic attentional set , 2013, Vision Research.

[24]  Avinash R. Vaidya,et al.  Testing necessary regional frontal contributions to value assessment and fixation-based updating , 2015, Nature Communications.

[25]  S. Shimojo,et al.  Gaze bias both reflects and influences preference , 2003, Nature Neuroscience.

[26]  P. Bartolomeo,et al.  Cortico–thalamic disconnection in a patient with supernumerary phantom limb , 2017, Experimental Brain Research.

[27]  P. Bartolomeo,et al.  Brain networks of visuospatial attention and their disruption in visual neglect , 2012, Front. Hum. Neurosci..

[28]  Steven Yantis,et al.  Reward predictions bias attentional selection , 2013, Front. Hum. Neurosci..

[29]  Brian A. Anderson,et al.  Value-driven attentional priority is context specific , 2014, Psychonomic Bulletin & Review.

[30]  Marius V Peelen,et al.  Reward guides attention to object categories in real-world scenes. , 2015, Journal of experimental psychology. General.

[31]  J. Maunsell.  Neuronal representations of cognitive state: reward or attention? , 2004, Trends in Cognitive Sciences.

[32]  L. Chelazzi,et al.  Learning to Attend and to Ignore Is a Matter of Gains and Losses , 2009, Psychological science.

[33]  M. Peelen,et al.  Neural Mechanisms of Incentive Salience in Naturalistic Human Vision , 2015, Neuron.

[34]  P. Sterzer,et al.  The influence of motivational salience on saccade latencies , 2012, Experimental Brain Research.

[35]  P. Vuilleumier,et al.  Priming by motivationally salient distractors produces hemispheric asymmetries in visual processing , 2018, Psychological Research.

[36]  P. Vuilleumier,et al.  Gambling against neglect: Unconscious spatial biases induced by reward reinforcement in healthy people and brain-damaged patients , 2013, Cortex.

[37]  Okihide Hikosaka,et al.  Positive and negative modulation of motor response in primate superior colliculus by reward expectation. , 2007, Journal of neurophysiology.

[38]  S. Schwartz,et al.  The left hemisphere learns what is right: Hemispatial reward learning depends on reinforcement learning processes in the contralateral hemisphere , 2016, Neuropsychologia.

[39]  Michel Thiebaut de Schotten,et al.  Cortical control of inhibition of return: Evidence from patients with inferior parietal damage and visual neglect , 2012, Neuropsychologia.

[40]  Pietro Perona,et al.  Optimal reward harvesting in complex perceptual environments , 2010, Proceedings of the National Academy of Sciences.

[41]  K. Berridge,et al.  What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience? , 1998, Brain Research Reviews.

[42]  L. Chelazzi,et al.  How motivation and reward learning modulate selective attention. , 2016, Progress in brain research.

[43]  Arman Rahmim,et al.  Linking dopaminergic reward signals to the development of attentional bias: A positron emission tomographic study , 2017, NeuroImage.

[44]  P. Bartolomeo,et al.  Inappropriate rightward saccades after right hemisphere damage: Oculomotor analysis and anatomical correlates , 2015, Neuropsychologia.

[45]  L. Chelazzi,et al.  Behavioral/systems/cognitive Reward Changes Salience in Human Vision via the Anterior Cingulate , 2022 .

[46]  M. Corbetta,et al.  Control of goal-directed and stimulus-driven attention in the brain , 2002, Nature Reviews Neuroscience.

[47]  H. Demaree,et al.  Brain lateralization of emotional processing: historical roots and a future incorporating "dominance". , 2005, Behavioral and cognitive neuroscience reviews.