In Search of Lost Time A computational model of the representations and dynamics of episodic memory

[1]  S. Becker.  A computational principle for hippocampal learning and neurogenesis , 2005, Hippocampus.

[2]  Andrew G. Barto,et al.  Reinforcement learning , 1998 .

[3]  Ronald J. Williams,et al.  Gradient-based learning algorithms for recurrent networks and their computational complexity , 1995 .

[4]  M. Moser,et al.  Pattern Separation in the Dentate Gyrus and CA3 of the Hippocampus , 2007, Science.

[5]  David J. Foster,et al.  Reverse replay of behavioural sequences in hippocampal place cells during the awake state , 2006, Nature.

[6]  Jeffrey L. Elman,et al.  Finding Structure in Time , 1990, Cogn. Sci..

[7]  M. Hasselmo,et al.  The hippocampus as an associator of discontiguous events , 1998, Trends in Neurosciences.

[8]  Matthijs A. A. van der Meer,et al.  Hippocampal Replay Is Not a Simple Function of Experience , 2010, Neuron.

[9]  Chris Eliasmith,et al.  A Unified Approach to Building and Controlling Spiking Attractor Networks , 2005, Neural Computation.

[10]  Peter Dayan,et al.  Hippocampal Contributions to Control: The Third Way , 2007, NIPS.

[11]  D. Touretzky,et al.  Cognitive maps beyond the hippocampus , 1997, Hippocampus.

[12]  James Martens,et al.  Deep learning via Hessian-free optimization , 2010, ICML.

[13]  G. Buzsáki,et al.  Forward and reverse hippocampal place-cell sequences during ripples , 2007, Nature Neuroscience.

[14]  L. Nadel,et al.  The Hippocampus as a Cognitive Map , 1978 .

[15]  Matthijs A. A. van der Meer,et al.  Expectancies in Decision Making, Reinforcement Learning, and Ventral Striatum , 2009, Frontiers in neuroscience.

[16]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[17]  D. Hassabis,et al.  Patients with hippocampal amnesia cannot imagine new experiences , 2007, Proceedings of the National Academy of Sciences.

[18]  G. Buzsáki,et al.  Distinct Representations and Theta Dynamics in Dorsal and Ventral Hippocampus , 2010, The Journal of Neuroscience.

[19]  Emilio Kropff,et al.  Place cells, grid cells, and the brain's spatial representation system. , 2008, Annual review of neuroscience.

[20]  L. Squire.  Memory systems of the brain: A brief history and current perspective , 2004, Neurobiology of Learning and Memory.

[21]  Janet Wiles,et al.  Computational Influence of Adult Neurogenesis on Memory Encoding , 2009, Neuron.

[22]  Matthijs A. A. van der Meer,et al.  Frontiers in Integrative Neuroscience Integrative Neuroscience Covert Expectation-of-reward in Rat Ventral Striatum at Decision Points , 2022 .

[23]  N. Burgess,et al.  The hippocampus and memory: insights from spatial processing , 2008, Nature Reviews Neuroscience.

[24]  John A. King,et al.  Memory for events and their spatial context: models and experiments. , 2001, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[25]  G. Einevoll,et al.  From grid cells to place cells: A mathematical model , 2006, Hippocampus.

[26]  Lisa M. Giocomo,et al.  Grid cell firing may arise from interference of theta frequency membrane potential oscillations in single neurons , 2007, Hippocampus.

[27]  P Alvarez,et al.  Memory consolidation and the medial temporal lobe: a simple network model. , 1994, Proceedings of the National Academy of Sciences of the United States of America.

[28]  R. O’Reilly,et al.  Contextual fear conditioning, conjunctive representations, pattern completion, and the hippocampus. , 1999, Behavioral neuroscience.

[29]  D J Willshaw,et al.  An assessment of Marr's theory of the hippocampus as a temporary memory store. , 1990, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[30]  R. Kesner,et al.  The role of the CA3 subregion of the dorsal hippocampus in spatial pattern completion in the rat , 2005, Hippocampus.

[31]  J. White.  Neural engineering , 2007, Annals of Biomedical Engineering.

[32]  James L. McClelland,et al.  Why there are complementary learning systems in the hippocampus and neocortex: insights from the successes and failures of connectionist models of learning and memory. , 1995, Psychological review.

[33]  A. David Redish,et al.  Hippocampal replay contributes to within session learning in a temporal difference reinforcement learning model , 2005, Neural Networks.

[34]  Lisa M. Giocomo,et al.  Temporal Frequency of Subthreshold Oscillations Scales with Entorhinal Grid Cell Field Spacing , 2007, Science.

[35]  Ila R Fiete,et al.  What Grid Cells Convey about Rat Location , 2008, The Journal of Neuroscience.

[36]  Pineda,et al.  Generalization of back-propagation to recurrent neural networks. , 1987, Physical review letters.

[37]  Barak A. Pearlmutter.  Fast Exact Multiplication by the Hessian , 1994, Neural Computation.

[38]  Yoshua Bengio,et al.  Learning long-term dependencies with gradient descent is difficult , 1994, IEEE Trans. Neural Networks.

[39]  E. Tulving.  Elements of episodic memory , 1983 .

[40]  L. Nadel,et al.  Précis of O'Keefe & Nadel's The hippocampus as a cognitive map , 1979, Behavioral and Brain Sciences.

[41]  R. O’Reilly,et al.  Computational principles of learning in the neocortex and hippocampus , 2000, Hippocampus.

[42]  A. Treves,et al.  What is the mammalian dentate gyrus good for? , 2008, Neuroscience.

[43]  William B. Levy,et al.  Interpreting hippocampal function as recoding and forecasting , 2005, Neural Networks.

[44]  J. Shewchuk.  An Introduction to the Conjugate Gradient Method Without the Agonizing Pain , 1994 .

[45]  Christopher M. Bishop,et al.  Neural networks for pattern recognition , 1995 .

[46]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[47]  W. Scoville,et al.  LOSS OF RECENT MEMORY AFTER BILATERAL HIPPOCAMPAL LESIONS , 1957, Journal of neurology, neurosurgery, and psychiatry.

[48]  Paul J. Werbos,et al.  Backpropagation Through Time: What It Does and How to Do It , 1990, Proc. IEEE.

[49]  P. Dayan,et al.  Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control , 2005, Nature Neuroscience.

[50]  Chris Eliasmith,et al.  A Controlled Attractor Network Model of Path Integration in the Rat , 2005, Journal of Computational Neuroscience.

[51]  T. Bliss,et al.  The Hippocampus Book , 2006 .

[52]  Lucia M. Vaina,et al.  From the Retina to the Neocortex , 1991 .

[53]  H. Eichenbaum,et al.  The Hippocampus, Memory, and Place Cells Is It Spatial Memory or a Memory Space? , 1999, Neuron.

[54]  J. O'Keefe,et al.  The hippocampus as a spatial map. Preliminary evidence from unit activity in the freely-moving rat. , 1971, Brain research.

[55]  D. Hassabis,et al.  Decoding Neuronal Ensembles in the Human Hippocampus , 2009, Current Biology.

[56]  T. Hafting,et al.  Microstructure of a spatial map in the entorhinal cortex , 2005, Nature.

[57]  William W Lytton,et al.  Unmasking the CA1 Ensemble Place Code by Exposures to Small and Large Environments: More Place Cells and Multiple, Irregularly Arranged, and Expanded Place Fields in the Larger Space , 2008, The Journal of Neuroscience.

[58]  J. O’Keefe,et al.  An oscillatory interference model of grid cell firing , 2007, Hippocampus.

[59]  B L McNaughton,et al.  Path Integration and Cognitive Mapping in a Continuous Attractor Neural Network Model , 1997, The Journal of Neuroscience.

[60]  Geoffrey E. Hinton,et al.  Learning distributed representations of concepts. , 1989 .

[61]  M. Fyhn,et al.  Spatial Representation in the Entorhinal Cortex , 2004, Science.

[62]  Ilya Sutskever,et al.  Learning Recurrent Neural Networks with Hessian-Free Optimization , 2011, ICML.

[63]  Upinder S. Bhalla,et al.  Representation of Odor Habituation and Timing in the Hippocampus , 2003, The Journal of Neuroscience.

[64]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[65]  H. Eichenbaum,et al.  Hippocampal “Time Cells” Bridge the Gap in Memory for Discontiguous Events , 2011, Neuron.

[66]  J. Altman,et al.  Are New Neurons Formed in the Brains of Adult Mammals? , 1962, Science.

[67]  Richard S. Sutton,et al.  Reinforcement Learning , 1992, Handbook of Machine Learning.

[68]  M. Mishkin,et al.  One-Trial Memory for Object-Place Associations after Separate Lesions of Hippocampus and Posterior Parahippocampal Region in the Monkey , 2003, The Journal of Neuroscience.

[69]  W. Levy,et al.  Synapses as associative memory elements in the hippocampal formation , 1979, Brain Research.

[70]  William B. Levy,et al.  Temporal Sequence Compression by an Integrate-and-Fire Model of Hippocampal Area CA3 , 2004, Journal of Computational Neuroscience.

[71]  Peter Dayan,et al.  Goal-directed control and its antipodes , 2009, Neural Networks.

[72]  M. Moser,et al.  Understanding memory through hippocampal remapping , 2008, Trends in Neurosciences.

[73]  Asohan Amarasingham,et al.  Internally Generated Cell Assembly Sequences in the Rat Hippocampus , 2008, Science.

[74]  B L McNaughton,et al.  Dynamics of the hippocampal ensemble code for space. , 1993, Science.

[75]  Adam Johnson,et al.  Neural Ensembles in CA3 Transiently Encode Paths Forward of the Animal at a Decision Point , 2007, The Journal of Neuroscience.

[76]  T. Ono,et al.  Place‐related neural responses in the monkey hippocampal formation in a virtual space , 2005, Hippocampus.

[77]  J. Disterhoft,et al.  Neurotoxic lesions of the dorsal hippocampus disrupt auditory‐cued trace heart rate (fear) conditioning in rabbits , 2000, Hippocampus.

[78]  M. Wilson,et al.  Coordinated memory replay in the visual cortex and hippocampus during sleep , 2007, Nature Neuroscience.

[79]  Nicol N. Schraudolph,et al.  Fast Curvature Matrix-Vector Products for Second-Order Gradient Descent , 2002, Neural Computation.

[80]  Matthew A. Wilson,et al.  Hippocampal Replay of Extended Experience , 2009, Neuron.

[81]  Arne D. Ekstrom,et al.  Cellular networks underlying human spatial navigation , 2003, Nature.

[82]  D. Schacter,et al.  The cognitive neuroscience of constructive memory: remembering the past and imagining the future , 2007, Philosophical Transactions of the Royal Society B: Biological Sciences.

[83]  P. Dayan,et al.  Off-line replay maintains declarative memories in a model of hippocampal-neocortical interactions , 2004, Nature Neuroscience.

[84]  H. Eichenbaum,et al.  Memory, amnesia, and the hippocampal system , 1993 .

[85]  Margaret F. Carr,et al.  Hippocampal replay in the awake state: a potential substrate for memory consolidation and retrieval , 2011, Nature Neuroscience.

[86]  C. Stark,et al.  Pattern Separation in the Human Hippocampal CA3 and Dentate Gyrus , 2008, Science.

[87]  M. Hasselmo.  How We Remember: Brain Mechanisms of Episodic Memory , 2011 .

[88]  L. Rabiner,et al.  An introduction to hidden Markov models , 1986, IEEE ASSP Magazine.