Neuronal Learning of Invariant Object Representation in the Ventral Visual Stream Is Not Dependent on Reward

Neurons at the top of primate ventral visual stream [inferior temporal cortex (IT)] have selectivity for objects that is highly tolerant to variation in the object's appearance on the retina. Previous nonhuman primate (Macaca mulatta) studies suggest that this neuronal tolerance is at least partly supported by the natural temporal contiguity of visual experience, because altering that temporal contiguity can robustly alter adult IT position and size tolerance. According to that work, it is the statistics of the subject's visual experience, not the subject's reward, that instruct the specific images that IT treats as equivalent. But is reward necessary for gating this type of learning in the ventral stream? Here we show that this is not the case—temporal tolerance learning proceeds at the same rate, regardless of reward magnitude and regardless of the temporal co-occurrence of reward, even in a behavioral task that does not require the subject to engage the object images. This suggests that the ventral visual stream uses autonomous, fully unsupervised mechanisms to constantly leverage all visual experience to help build its invariant object representation.

[1]  D. Robinson,et al.  A METHOD OF MEASURING EYE MOVEMENT USING A SCLERAL SEARCH COIL IN A MAGNETIC FIELD. , 1963, IEEE transactions on bio-medical engineering.

[2]  Y. Miyashita.  Neuronal correlate of visual associative long-term memory in the primate temporal cortex , 1988, Nature.

[3]  Peter Földiák,et al.  Learning Invariance from Transformation Sequences , 1991, Neural Comput..

[4]  J. Leo van Hemmen,et al.  Temporal association , 1991 .

[5]  Y. Miyashita,et al.  Neural organization for the long-term memory of paired associates , 1991, Nature.

[6]  M. Stryker.  Neurobiology. Temporal associations. , 1991, Nature.

[7]  Keiji Tanaka,et al.  Inferotemporal cortex and object vision. , 1996, Annual review of neuroscience.

[8]  R Vogels,et al.  Coding of stimulus invariances by inferior temporal neurons. , 1996, Progress in brain research.

[9]  E. Rolls,et al.  INVARIANT FACE AND OBJECT RECOGNITION IN THE VISUAL SYSTEM , 1997, Progress in Neurobiology.

[10]  R. Desimone,et al.  Responses of Macaque Perirhinal Neurons during and after Visual Stimulus Association Learning , 1999, The Journal of Neuroscience.

[11]  J. Maunsell,et al.  Form representation in monkey inferotemporal cortex is virtually unaltered by free viewing , 2000, Nature Neuroscience.

[12]  Y. Dan,et al.  Stimulus Timing-Dependent Plasticity in Cortical Processing of Orientation , 2001, Neuron.

[13]  M. Merzenich,et al.  Cortical remodelling induced by activity of ventral tegmental dopamine neurons , 2001, Nature.

[14]  H. Bülthoff,et al.  Effects of temporal association on recognition memory , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[15]  L. Squire,et al.  Neuronal representations of stimulus associations develop in the temporal lobe during learning , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[16]  Terrence J. Sejnowski,et al.  Slow Feature Analysis: Unsupervised Learning of Invariances , 2002, Neural Computation.

[17]  M. Tarr,et al.  Visual Object Recognition , 1996, ISTCS.

[18]  J. DiCarlo,et al.  'Breaking' position-invariant object recognition , 2005, Nature Neuroscience.

[19]  Tomaso Poggio,et al.  Fast Readout of Object Identity from Macaque Inferior Temporal Cortex , 2005, Science.

[20]  P. König,et al.  A Model of the Ventral Visual System Based on Temporal Stability and Local Memory , 2006, PLoS biology.

[21]  W. Schultz.  Multiple dopamine functions at different time courses. , 2007, Annual review of neuroscience.

[22]  C. Schreiner,et al.  A synaptic memory trace for cortical receptive field plasticity , 2007, Nature.

[23]  David D. Cox,et al.  Opinion TRENDS in Cognitive Sciences Vol.11 No.8 Untangling invariant object recognition , 2022 .

[24]  O. Hikosaka.  Basal Ganglia Mechanisms of Reward‐Oriented Eye Movement , 2007, Annals of the New York Academy of Sciences.

[25]  Timothée Masquelier,et al.  Unsupervised Learning of Visual Features through Spike Timing Dependent Plasticity , 2007, PLoS Comput. Biol..

[26]  Stephen D. Van Hooser,et al.  Experience with moving visual stimuli drives the early development of cortical direction selectivity , 2008, Nature.

[27]  S. Gerber,et al.  Unsupervised Natural Experience Rapidly Alters Invariant Object Representation in Visual Cortex , 2008 .

[28]  Mitsuo Kawato,et al.  Boosting perceptual learning by fake feedback , 2009, Vision Research.

[29]  Guy Wallis,et al.  Learning Illumination-and Orientation-invariant Representations of Objects through Temporal Association General Methods Experiment Ii , 2022 .

[30]  Aaron R. Seitz,et al.  Rewards Evoke Learning of Unconsciously Processed Visual Stimuli in Adult Humans , 2009, Neuron.

[31]  C. Law,et al.  Reinforcement learning can account for associative and perceptual learning on a visual decision task , 2009, Nature Neuroscience.

[32]  David D. Cox,et al.  What response properties do individual neurons need to underlie position and clutter "invariant" object recognition? , 2009, Journal of neurophysiology.

[33]  Robert A. Legenstein,et al.  Reinforcement Learning on Slow Features of High-Dimensional Input Streams , 2010, PLoS Comput. Biol..

[34]  Aaron R. Seitz,et al.  Dissociable Neural Effects of Long-term Stimulus–Reward Pairing in Macaque Visual Cortex , 2010, Journal of Cognitive Neuroscience.

[35]  J. DiCarlo,et al.  Unsupervised Natural Visual Experience Rapidly Reshapes Size-Invariant Object Representation in Inferior Temporal Cortex , 2010, Neuron.

[36]  Ethan S. Bromberg-Martin,et al.  Multiple Timescales of Memory in Lateral Habenula and Dopamine Neurons , 2010, Neuron.