Action-Based Learning of Multistate Objects in the Medial Temporal Lobe.

Actions constrain perception by changing the appearance of objects in the environment. As such, they provide an interactive basis for learning the structure of visual input. If an action systematically transforms one stimulus into another, then these stimuli are more likely to reflect different states of the same persisting object over time. Here we show that such multistate objects are represented in the human medial temporal lobe--the result of a mechanism in which actions influence associative learning of how objects transition between states. We further demonstrate that greater recruitment of these action-based representations during object perception is accompanied by attenuated activity in stimulus-selective visual cortex. In this way, our interactions with the environment help build visual knowledge that predictively facilitates perceptual processing.

[1]  N. Turk-Browne,et al.  Mechanisms for widespread hippocampal involvement in cognition. , 2013, Journal of experimental psychology. General.

[2]  R. Henson,et al.  Explaining away repetition effects via predictive coding , 2012, Cognitive neuroscience.

[3]  Stephen K. Reed,et al.  Pattern recognition and categorization , 1972 .

[4]  Z. Pylyshyn The role of location indexes in spatial perception: A sketch of the FINST spatial-index model , 1989, Cognition.

[5]  Jonathan Flombaum,et al.  Spatiotemporal priority as a fundamental principle of object persistence , 2009 .

[6]  James J. DiCarlo,et al.  How Does the Brain Solve Visual Object Recognition? , 2012, Neuron.

[7]  Janneke F. M. Jehee,et al.  Less Is More: Expectation Sharpens Representations in the Primary Visual Cortex , 2012, Neuron.

[8]  G. Rizzolatti,et al.  Cortical mechanisms underlying the organization of goal-directed actions and mirror neuron-based action understanding. , 2014, Physiological reviews.

[9]  Y. Miyashita Neuronal correlate of visual associative long-term memory in the primate temporal cortex , 1988, Nature.

[10]  Valerie A. Carr,et al.  Imaging the Human Medial Temporal Lobe with High-Resolution fMRI , 2010, Neuron.

[11]  I. Biederman,et al.  Recognizing depth-rotated objects: Evidence and conditions for three-dimensional viewpoint invariance. , 1993 .

[12]  Nicholas C. Hindy,et al.  A cortical network for the encoding of object change. , 2015, Cerebral cortex.

[13]  Hans P. Op de Beeck,et al.  Against hyperacuity in brain reading: Spatial smoothing does not hurt multivariate fMRI analyses? , 2010, NeuroImage.

[14]  Eleanor Rosch,et al.  Principles of Categorization , 1978 .

[15]  Lauren V. Kustner,et al.  Shaping of Object Representations in the Human Medial Temporal Lobe Based on Temporal Regularities , 2012, Current Biology.

[16]  Y. Naya,et al.  Integrating What and When Across the Primate Medial Temporal Lobe , 2011, Science.

[17]  Andy C. H. Lee,et al.  The Perirhinal Cortex and Recognition Memory Interference , 2013, The Journal of Neuroscience.

[18]  Sharon L. Thompson-Schill,et al.  The Effect of Object State-Changes on Event Processing: Do Objects Compete with Themselves? , 2012, The Journal of Neuroscience.

[19]  R. Passingham,et al.  Action observation and acquired motor skills: an FMRI study with expert dancers. , 2005, Cerebral cortex.

[20]  H. Yin,et al.  The role of the basal ganglia in habit formation , 2006, Nature Reviews Neuroscience.

[21]  J. Gibson The Ecological Approach to Visual Perception , 1979 .

[22]  D. Schacter,et al.  Reductions in cortical activity during priming , 2007, Current Opinion in Neurobiology.

[23]  N. Kanwisher,et al.  The lateral occipital complex and its role in object recognition , 2001, Vision Research.

[24]  Bruce Fischl,et al.  Accurate and robust brain image alignment using boundary-based registration , 2009, NeuroImage.

[25]  Jarrod A. Lewis-Peacock,et al.  Pruning of memories by context-based prediction error , 2014, Proceedings of the National Academy of Sciences.

[26]  R. O’Reilly,et al.  Conjunctive representations in learning and memory: principles of cortical and hippocampal function. , 2001, Psychological review.

[27]  D. Shohamy,et al.  Preference by Association: How Memory Mechanisms in the Hippocampus Bias Decisions , 2012, Science.

[28]  N. Kanwisher,et al.  Cortical Regions Involved in Perceiving Object Shape , 2000, The Journal of Neuroscience.

[29]  Per B Sederberg,et al.  Scene Representations in Parahippocampal Cortex Depend on Temporal Context , 2012, The Journal of Neuroscience.

[30]  P. Mamassian,et al.  A New Look at Sensory Attenuation , 2010, Psychological science.

[31]  Jody C Culham,et al.  fMRI Repetition Suppression for Familiar But Not Arbitrary Actions with Tools , 2012, The Journal of Neuroscience.

[32]  Michael X. Cohen,et al.  Interference of working memory load with long‐term memory formation , 2009, The European journal of neuroscience.

[33]  A. Tversky,et al.  Similarity, separability, and the triangle inequality. , 1982, Psychological review.

[34]  Michael J. Constantino,et al.  Neural repetition suppression reflects fulfilled perceptual expectations , 2008 .

[35]  Douglas L. Medin,et al.  Context theory of classification learning. , 1978 .

[36]  A M Dale,et al.  Optimal experimental design for event‐related fMRI , 1999, Human brain mapping.

[37]  Douglas L. Hintzman,et al.  "Schema Abstraction" in a Multiple-Trace Memory Model , 1986 .

[38]  H. Eichenbaum,et al.  Memory, amnesia, and the hippocampal system , 1993 .

[39]  Karl J. Friston,et al.  A theory of cortical responses , 2005, Philosophical Transactions of the Royal Society B: Biological Sciences.

[40]  Y. Niv,et al.  Dialogues on prediction errors , 2008, Trends in Cognitive Sciences.

[41]  H. Duvernoy,et al.  The Human Hippocampus: Functional Anatomy, Vascularization and Serial Sections with MRI , 1997 .

[42]  G. Glover,et al.  Associative retrieval processes in the human medial temporal lobe: hippocampal retrieval success and CA1 mismatch detection. , 2011, Learning & memory.

[43]  Christian F. Doeller,et al.  Reinstatement of Associative Memories in Early Visual Cortex Is Signaled by the Hippocampus , 2014, The Journal of Neuroscience.

[44]  H. Eichenbaum,et al.  The medial temporal lobe and recognition memory. , 2007, Annual review of neuroscience.

[45]  R. Shepard The analysis of proximities: Multidimensional scaling with an unknown distance function. II , 1962 .

[46]  Sean M. Polyn,et al.  Beyond mind-reading: multi-voxel pattern analysis of fMRI data , 2006, Trends in Cognitive Sciences.

[47]  R. O’Reilly,et al.  Modeling hippocampal and neocortical contributions to recognition memory: a complementary-learning-systems approach. , 2003, Psychological review.

[48]  Marvin M Chun,et al.  Spatiotemporal object continuity in human ventral visual cortex , 2008, Proceedings of the National Academy of Sciences.

[49]  J. Kalaska,et al.  Neural mechanisms for interacting with a world full of action choices. , 2010, Annual review of neuroscience.

[50]  Russell A. Poldrack,et al.  What do differences between multi-voxel and univariate analysis mean? How subject-, voxel-, and trial-level variance impact fMRI analysis , 2014, NeuroImage.

[51]  C. Stark,et al.  Pattern Separation in the Human Hippocampal CA3 and Dentate Gyrus , 2008, Science.

[52]  Richard N Henson,et al.  Predictive, interactive multiple memory systems , 2010, Hippocampus.

[53]  R W Cox,et al.  AFNI: software for analysis and visualization of functional magnetic resonance neuroimages. , 1996, Computers and biomedical research, an international journal.

[54]  Daphna Shohamy,et al.  Cooperation between the Hippocampus and the Striatum during Episodic Encoding , 2011, Journal of Cognitive Neuroscience.

[55]  M. Gluck,et al.  Interactive memory systems in the human brain , 2001, Nature.

[56]  L. Frank,et al.  Single Neurons in the Monkey Hippocampus and Learning of New Associations , 2003, Science.

[57]  Mark W. Woolrich,et al.  Advances in functional and structural MR image analysis and implementation as FSL , 2004, NeuroImage.

[58]  C Brock Kirwan,et al.  Overcoming interference: an fMRI investigation of pattern separation in the medial temporal lobe. , 2007, Learning & memory.

[59]  R. Shepard The analysis of proximities: Multidimensional scaling with an unknown distance function. I. , 1962 .

[60]  Robert Tibshirani,et al.  Bootstrap Methods for Standard Errors, Confidence Intervals, and Other Measures of Statistical Accuracy , 1986 .

[61]  R. Desimone,et al.  Responses of Macaque Perirhinal Neurons during and after Visual Stimulus Association Learning , 1999, The Journal of Neuroscience.

[62]  K. Grill-Spector,et al.  Relating retinotopic and object-selective responses in human lateral occipital cortex. , 2008, Journal of neurophysiology.

[63]  Stefan Leutgeb,et al.  Pattern separation, pattern completion, and new neuronal codes within a continuous CA3 map. , 2007, Learning & memory.

[64]  M. Jenkinson Non-linear registration aka Spatial normalisation , 2007 .

[65]  D. Kahneman,et al.  The reviewing of object files: Object-specific integration of information , 1992, Cognitive Psychology.

[66]  D Marr,et al.  Simple memory: a theory for archicortex. , 1971, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[67]  Jonas Larsson,et al.  fMRI repetition suppression: neuronal adaptation or stimulus expectation? , 2012, Cerebral cortex.

[68]  A. Borst Seeing smells: imaging olfactory learning in bees , 1999, Nature Neuroscience.

[69]  Y. Miyashita Inferior temporal cortex: where visual perception meets memory. , 1993, Annual review of neuroscience.

[70]  L. Davachi Item, context and relational episodic encoding in humans , 2006, Current Opinion in Neurobiology.