Learned spatiotemporal sequence recognition and prediction in primary visual cortex

Learning to recognize and predict temporal sequences is fundamental to sensory perception and is impaired in several neuropsychiatric disorders, but little is known about where and how this occurs in the brain. We discovered that repeated presentations of a visual sequence over a course of days resulted in evoked response potentiation in mouse V1 that was highly specific for stimulus order and timing. Notably, after V1 was trained to recognize a sequence, cortical activity regenerated the full sequence even when individual stimulus elements were omitted. Our results advance the understanding of how the brain makes 'intelligent guesses' on the basis of limited information to form visual percepts and suggest that it is possible to study the mechanistic basis of this high-level cognitive ability by studying low-level sensory systems.

[1]  Mark F Bear,et al.  Visual Experience Induces Long-Term Potentiation in the Primary Visual Cortex , 2010, The Journal of Neuroscience.

[2]  Susumu Tonegawa,et al.  In Vivo Two-Photon Imaging Reveals a Role of Arc in Enhancing Orientation Specificity in Visual Cortex , 2006, Cell.

[3]  Morten H. Christiansen,et al.  Sequential learning in non-human primates , 2001, Trends in Cognitive Sciences.

[4]  Daniel Bullock,et al.  Learning and production of movement sequences: behavioral, neurophysiological, and modeling perspectives. , 2004, Human movement science.

[5]  Guinevere F. Eden,et al.  Dyslexics are impaired on implicit higher-order sequence learning, but not on implicit spatial context learning , 2006, Neuropsychologia.

[6]  HighWire Press.  The journal of neuroscience : the official journal of the Society for Neuroscience. , 1981 .

[7]  Michael J. Goard,et al.  Fast Modulation of Visual Perception by Basal Forebrain Cholinergic Neurons , 2013, Nature Neuroscience.

[8]  J. Changeux,et al.  A Neuronal Model of Predictive Coding Accounting for the Mismatch Negativity , 2012, The Journal of Neuroscience.

[9]  A. Chiba,et al.  The role of visual cortex acetylcholine in learning to discriminate temporally modulated visual stimuli , 2013, Front. Behav. Neurosci..

[10]  M. Stryker,et al.  Development and Plasticity of the Primary Visual Cortex , 2012, Neuron.

[11]  Tim Gollisch,et al.  Eye Smarter than Scientists Believed: Neural Computations in Circuits of the Retina , 2010, Neuron.

[12]  Lin Yang,et al.  Perceptual Learning Increases the Strength of the Earliest Signals in Visual Cortex , 2010, The Journal of Neuroscience.

[13]  Valentin Dragoi,et al.  Image sequence reactivation in awake V4 networks , 2012, Proceedings of the National Academy of Sciences.

[14]  R. Douglas,et al.  Mapping the Matrix: The Ways of Neocortex , 2007, Neuron.

[15]  Jared G. Smith,et al.  The implicit sequence learning deficit in patients with Parkinson's disease: A matter of impaired sequence integration? , 2006, Neuropsychologia.

[16]  Dean V Buonomano,et al.  Embedding Multiple Trajectories in Simulated Recurrent Neural Networks in a Self-Organizing Manner , 2009, The Journal of Neuroscience.

[17]  W. Fias,et al.  The Neural Basis of Implicit Perceptual Sequence Learning , 2011, Front. Hum. Neurosci..

[18]  T. Poggio,et al.  BOOK REVIEW David Marr’s Vision: floreat computational neuroscience VISION: A COMPUTATIONAL INVESTIGATION INTO THE HUMAN REPRESENTATION AND PROCESSING OF VISUAL INFORMATION , 2009 .

[19]  William P. Hetrick,et al.  Temporal processing dysfunction in schizophrenia , 2008, Brain and Cognition.

[20]  H. Barlow.  Vision: A computational investigation into the human representation and processing of visual information: David Marr. San Francisco: W. H. Freeman, 1982. pp. xvi + 397 , 1983 .

[21]  Y. Dan,et al.  Activity Recall in Visual Cortical Ensemble , 2012, Nature Neuroscience.

[22]  Mark F Bear,et al.  Reward timing in the primary visual cortex. , 2006, Science.

[23]  Frank Tong,et al.  Perceptual Learning Selectively Refines Orientation Representations in Early Visual Cortex , 2012, The Journal of Neuroscience.

[24]  Ann Allergy,et al.  O R I G I N a L a R T I C L E S , 2022 .

[25]  W. Singer,et al.  Modulation of visual cortical plasticity by acetylcholine and noradrenaline , 1986, Nature.

[26]  Michael W. Spratling.  Predictive Coding as a Model of Response Properties in Cortical Area V1 , 2010, The Journal of Neuroscience.

[27]  Rajesh P. N. Rao,et al.  Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive-field effects. , 1999 .

[28]  U. Mitzdorf.  Current source-density method and application in cat cerebral cortex: investigation of evoked potentials and EEG phenomena. , 1985, Physiological reviews.

[29]  C. Olson,et al.  Statistical learning of visual transitions in monkey inferotemporal cortex , 2011, Proceedings of the National Academy of Sciences.

[30]  Tai Sing Lee,et al.  Hierarchical Bayesian inference in the visual cortex. , 2003, Journal of the Optical Society of America. A, Optics, image science, and vision.

[31]  M. Bear,et al.  Instructive Effect of Visual Experience in Mouse Visual Cortex , 2006, Neuron.

[32]  D. Buonomano,et al.  The neural basis of temporal processing. , 2004, Annual review of neuroscience.

[33]  M. Fahle.  Perceptual learning: a case for early selection. , 2004, Journal of vision.

[34]  M. Hasselmo.  The role of acetylcholine in learning and memory , 2006, Current Opinion in Neurobiology.

[35]  M. Bear,et al.  A Cholinergic Mechanism for Reward Timing within Primary Visual Cortex , 2013, Neuron.

[36]  Sunbin Song,et al.  Perceptual sequence learning in a serial reaction time task , 2008, Experimental Brain Research.

[37]  P. E. Gold,et al.  Intra-amygdala infusions of scopolamine impair performance on a conditioned place preference task but not a spatial radial maze task , 1998, Behavioural Brain Research.

[38]  Mark F. Bear,et al.  How the mechanisms of long-term synaptic potentiation and depression serve experience-dependent plasticity in primary visual cortex , 2014, Philosophical Transactions of the Royal Society B: Biological Sciences.

[39]  S. Gerber,et al.  Unsupervised Natural Experience Rapidly Alters Invariant Object Representation in Visual Cortex , 2008 .

[40]  Richard J. Siegert,et al.  Is implicit sequence learning impaired in schizophrenia? A meta-analysis , 2008, Brain and Cognition.

[41]  K. Lashley.  The problem of serial order in behavior , 1951 .

[42]  James J. DiCarlo,et al.  How Does the Brain Solve Visual Object Recognition? , 2012, Neuron.

[43]  Karl J. Friston,et al.  Canonical Microcircuits for Predictive Coding , 2012, Neuron.