Neuronal Computation Underlying Inferential Reasoning in Humans and Mice

[1]  M. E. Hasselmo,et al.  Modeling of grid cell activity demonstrates in vivo entorhinal ‘look-ahead’ properties , 2013, Neuroscience.

[2]  Brad E. Pfeiffer,et al.  Hippocampal place cell sequences depict future paths to remembered goals , 2013, Nature.

[3]  Dagmar Zeithamova,et al.  Flexible Memories: Differential Roles for Medial Temporal Lobe and Prefrontal Cortex in Cross-Episode Binding , 2010, The Journal of Neuroscience.

[4]  M. Wilson,et al.  Temporally Structured Replay of Awake Hippocampal Ensemble Activity during Rapid Eye Movement Sleep , 2001, Neuron.

[5]  Blake S. Porter,et al.  Hippocampal Representation of Related and Opposing Memories Develop within Distinct, Hierarchically Organized Neural Schemas , 2014, Neuron.

[6]  D. Hassabis,et al.  Hippocampal place cells construct reward related sequences through unexplored space , 2015, eLife.

[7]  J. Born,et al.  The memory function of sleep , 2010, Nature Reviews Neuroscience.

[8]  Arne D. Ekstrom,et al.  Cellular networks underlying human spatial navigation , 2003, Nature.

[9]  G. Buzsáki.  Hippocampal sharp wave‐ripple: A cognitive biomarker for episodic memory and planning , 2015, Hippocampus.

[10]  M. Quirk,et al.  Experience-Dependent Asymmetric Shape of Hippocampal Receptive Fields , 2000, Neuron.

[11]  G. Buzsáki,et al.  tFast Network Oscillations in the Hippocampal CA1 Region of the Behaving Rat , 1999, The Journal of Neuroscience.

[12]  L. Nadel,et al.  The Hippocampus as a Cognitive Map , 1978 .

[13]  Joshua L. Jones,et al.  Dopamine transients are sufficient and necessary for acquisition of model-based associations , 2017, Nature Neuroscience.

[14]  David J Foster,et al.  Hippocampal Replay Captures the Unique Topological Structure of a Novel Environment , 2014, The Journal of Neuroscience.

[15]  Y. Niv,et al.  Model-based predictions for dopamine , 2018, Current Opinion in Neurobiology.

[16]  Avi J. H. Chanales,et al.  The role of sleep in forming a memory representation of a two‐dimensional space , 2013, Hippocampus.

[17]  Kenneth D. Harris,et al.  Fast and accurate spike sorting of high-channel count probes with KiloSort , 2016, NIPS.

[18]  K. Deisseroth.  Circuit dynamics of adaptive and maladaptive behaviour , 2014, Nature.

[19]  K. Deisseroth,et al.  Optogenetics , 2013, Proceedings of the National Academy of Sciences.

[20]  D. Dupret,et al.  Dopaminergic neurons promote hippocampal reactivation and spatial memory persistence , 2014, Nature Neuroscience.

[21]  P. Lewis,et al.  Overlapping memory replay during sleep builds cognitive schemata , 2011, Trends in Cognitive Sciences.

[22]  N. Daw,et al.  Integrating memories to guide decisions , 2015, Current Opinion in Behavioral Sciences.

[23]  D. Shohamy,et al.  Integrating Memories in the Human Brain: Hippocampal-Midbrain Encoding of Overlapping Events , 2008, Neuron.

[24]  D. Nicholson,et al.  Lesions of the perirhinal cortex impair sensory preconditioning in rats , 2000, Behavioural Brain Research.

[25]  Matthijs A. A. van der Meer,et al.  Hippocampal Replay Is Not a Simple Function of Experience , 2010, Neuron.

[26]  Samuel Garcia,et al.  SpikeForest, reproducible web-facing ground-truth validation of automated neural spike sorters , 2020, eLife.

[27]  H. Lau,et al.  Relational Memory: A Daytime Nap Facilitates the Abstraction of General Concepts , 2011, PloS one.

[28]  Margaret L. Schlichting,et al.  CA1 subfield contributions to memory integration and inference , 2014, Hippocampus.

[29]  James L. McClelland,et al.  Generalization Through the Recurrent Interaction of Episodic Memories , 2012, Psychological review.

[30]  Rebecca L. Gómez,et al.  Generalizing memories over time: Sleep and reinforcement facilitate transitive inference , 2013, Neurobiology of Learning and Memory.

[31]  H. Eichenbaum,et al.  Interplay of Hippocampus and Prefrontal Cortex in Memory , 2013, Current Biology.

[32]  P. Dudchenko.  The hippocampus as a cognitive map , 2010 .

[33]  R. Buckner.  The role of the hippocampus in prediction and imagination. , 2010, Annual review of psychology.

[34]  J. Csicsvari,et al.  Accuracy of tetrode spike separation as determined by simultaneous intracellular and extracellular measurements. , 2000, Journal of neurophysiology.

[35]  B. Efron.  The Bootstrap and Modern Statistics , 2000 .

[36]  D. Dupret,et al.  Hippocampal Offline Reactivation Consolidates Recently Formed Cell Assembly Patterns during Sharp Wave-Ripples , 2016, Neuron.

[37]  Takashi Kitamura,et al.  Engrams and circuits crucial for systems consolidation of a memory , 2017, Science.

[38]  Timothy E. J. Behrens,et al.  Online evaluation of novel choices by simultaneous representation of multiple memories , 2013, Nature Neuroscience.

[39]  Margaret F. Carr,et al.  Hippocampal SWR Activity Predicts Correct Decisions during the Initial Learning of an Alternation Task , 2013, Neuron.

[40]  Martin J. Chadwick,et al.  Big-Loop Recurrence within the Hippocampal System Supports Integration of Information across Episodes , 2018, Neuron.

[41]  L. Squire.  Memory and the hippocampus: a synthesis from findings with rats, monkeys, and humans. , 1992, Psychological review.

[42]  H. Eichenbaum,et al.  Hippocampal Neurons Encode Information about Different Types of Memory Episodes Occurring in the Same Location , 2000, Neuron.

[43]  Dagmar Zeithamova,et al.  Hippocampal and Ventral Medial Prefrontal Activation during Retrieval-Mediated Learning Supports Novel Inference , 2012, Neuron.

[44]  G. Buzsáki,et al.  Memory, navigation and theta rhythm in the hippocampal-entorhinal system , 2013, Nature Neuroscience.

[45]  Mattias P. Karlsson,et al.  Awake replay of remote experiences in the hippocampus , 2009, Nature Neuroscience.

[46]  G. Buzsáki,et al.  Forward and reverse hippocampal place-cell sequences during ripples , 2007, Nature Neuroscience.

[47]  P. Dayan,et al.  Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control , 2005, Nature Neuroscience.

[48]  J. Csicsvari,et al.  Replay and Time Compression of Recurring Spike Sequences in the Hippocampus , 1999, The Journal of Neuroscience.

[49]  Geoffrey Schoenbaum,et al.  Midbrain dopamine neurons compute inferred and cached value prediction errors in a common framework , 2016, eLife.

[50]  R. O’Reilly,et al.  Conjunctive representations in learning and memory: principles of cortical and hippocampal function. , 2001, Psychological review.

[51]  David J. Foster,et al.  A model of hippocampally dependent navigation, using the temporal difference learning rule , 2000, Hippocampus.

[52]  H. Eichenbaum,et al.  Conservation of hippocampal memory function in rats and humans , 1996, Nature.

[53]  David J. Foster,et al.  Reverse replay of behavioural sequences in hippocampal place cells during the awake state , 2006, Nature.

[54]  W. Brogden.  Sensory pre-conditioning. , 1939 .

[55]  Richard S. Sutton,et al.  Dyna, an integrated architecture for learning, planning, and reacting , 1990, SGAR.

[56]  L. Frank,et al.  Rewarded Outcomes Enhance Reactivation of Experience in the Hippocampus , 2009, Neuron.

[57]  Guillén Fernández,et al.  Persistent schema-dependent hippocampal-neocortical connectivity during memory encoding and postencoding rest in humans , 2010, Proceedings of the National Academy of Sciences.

[58]  Timothy E. J. Behrens,et al.  Human Replay Spontaneously Reorganizes Experience , 2019, Cell.

[59]  Timothy E. J. Behrens,et al.  Dissociable Reward and Timing Signals in Human Midbrain and Ventral Striatum , 2011, Neuron.

[60]  B. McNaughton,et al.  The contributions of position, direction, and velocity to single unit activity in the hippocampus of freely-moving rats , 1983, Experimental Brain Research.

[61]  J. Nagode,et al.  Human hippocampal activation during transitive inference , 2002, Neuroreport.

[62]  Margaret L. Schlichting,et al.  Hippocampal–medial prefrontal circuit supports memory updating during learning and post-encoding rest , 2016, Neurobiology of Learning and Memory.

[63]  Hanspeter Pfister,et al.  UpSet: Visualization of Intersecting Sets , 2014, IEEE Transactions on Visualization and Computer Graphics.

[64]  S. Robinson,et al.  Chemogenetic Silencing of Neurons in Retrosplenial Cortex Disrupts Sensory Preconditioning , 2014, The Journal of Neuroscience.

[65]  D. Shohamy,et al.  Preference by Association: How Memory Mechanisms in the Hippocampus Bias Decisions , 2012, Science.

[66]  J. O'Doherty,et al.  The Role of the Ventromedial Prefrontal Cortex in Abstract State-Based Inference during Decision Making in Humans , 2006, The Journal of Neuroscience.

[67]  J. O’Neill,et al.  Place-selective firing contributes to the reverse-order reactivation of CA1 pyramidal cells during sharp waves in open-field exploration , 2007, The European journal of neuroscience.

[68]  Joshua L. Jones,et al.  Orbitofrontal Cortex Supports Behavior and Learning Using Inferred But Not Cached Values , 2012, Science.

[69]  Adam Johnson,et al.  Neural Ensembles in CA3 Transiently Encode Paths Forward of the Animal at a Decision Point , 2007, The Journal of Neuroscience.

[70]  J. Born,et al.  Sleep inspires insight , 2004, Nature.

[71]  J. O'Keefe,et al.  The hippocampus as a spatial map. Preliminary evidence from unit activity in the freely-moving rat. , 1971, Brain research.

[72]  Asohan Amarasingham,et al.  Internally Generated Cell Assembly Sequences in the Rat Hippocampus , 2008, Science.

[73]  Loren M. Frank,et al.  The hippocampal sharp wave–ripple in memory retrieval for immediate use and consolidation , 2018, Nature Reviews Neuroscience.

[74]  Hannah M. Batchelor,et al.  Dopamine Neurons Respond to Errors in the Prediction of Sensory Features of Expected Rewards , 2017, Neuron.

[75]  C. Stern,et al.  An fMRI Study of the Role of the Medial Temporal Lobe in Implicit and Explicit Sequence Learning , 2003, Neuron.

[76]  R. Morris,et al.  Memory consolidation. , 2015, Cold Spring Harbor perspectives in biology.

[77]  B. McNaughton,et al.  Reactivation of hippocampal ensemble memories during sleep. , 1994, Science.

[78]  Li Su,et al.  A Toolbox for Representational Similarity Analysis , 2014, PLoS Comput. Biol..

[79]  Dharshan Kumaran,et al.  What representations and computations underpin the contribution of the hippocampus to generalization and inference? , 2012, Front. Hum. Neurosci..

[80]  J. O’Neill,et al.  The reorganization and reactivation of hippocampal maps predict spatial memory performance , 2010, Nature Neuroscience.

[81]  Richard S. Sutton,et al.  Learning to predict by the methods of temporal differences , 2004, Machine Learning.

[82]  G. Dragoi,et al.  Preplay of future place cell sequences by hippocampal cellular assemblies , 2011, Nature.

[83]  Alison R Preston,et al.  Hippocampal contribution to the novel use of relational information in declarative memory , 2004, Hippocampus.

[84]  Margaret L. Schlichting,et al.  The hippocampus and inferential reasoning: building memories to navigate future decisions , 2012, Front. Hum. Neurosci..

[85]  Nikolaus Kriegeskorte,et al.  Frontiers in Systems Neuroscience Systems Neuroscience , 2022 .

[86]  Alcino J. Silva,et al.  A shared neural ensemble links distinct contextual memories encoded close in time , 2016, Nature.

[87]  Hyungwon Choi,et al.  Moving beyond P values: data analysis with estimation graphics , 2019, Nature Methods.

[88]  H. Eichenbaum,et al.  Critical role of the hippocampus in memory for sequences of events , 2002, Nature Neuroscience.

[89]  G. Winocur,et al.  Higher-Order Conditioning Is Impaired by Hippocampal Lesions , 2014, Current Biology.

[90]  G. Schoenbaum,et al.  Dopamine neuron ensembles signal the content of sensory prediction errors , 2019, eLife.

[91]  H. Eichenbaum,et al.  Memory, amnesia, and the hippocampal system , 1993 .

[92]  Dorothy Tse,et al.  References and Notes Supporting Online Material Materials and Methods Figs. S1 to S5 Tables S1 to S3 Electron Impact (ei) Mass Spectra Chemical Ionization (ci) Mass Spectra References Schemas and Memory Consolidation Research Articles Research Articles Research Articles Research Articles , 2022 .

[93]  David J. Foster.  Replay Comes of Age. , 2017, Annual review of neuroscience.

[94]  E. Tolman.  Cognitive maps in rats and men. , 1948, Psychological review.

[95]  M. Shapiro,et al.  Prospective and Retrospective Memory Coding in the Hippocampus , 2003, Neuron.

[96]  M. Wilson,et al.  VTA neurons coordinate with the hippocampal reactivation of spatial experience , 2015, eLife.

[97]  A. Sirota,et al.  The hippocampus: hub of brain network communication for memory , 2011, Trends in Cognitive Sciences.

[98]  Jessica D. Payne,et al.  Human relational memory requires time and sleep , 2007, Proceedings of the National Academy of Sciences.