Machines Learning - Towards a New Synthetic Autobiographical Memory

Autobiographical memory is the organisation of episodes and contextual information from an individual’s experiences into a coherent narrative, which is key to our sense of self. Formation and recall of autobiographical memories is essential for effective, adaptive behaviour in the world, providing contextual information necessary for planning actions and memory functions such as event reconstruction. A synthetic autobiographical memory system would endow intelligent robotic agents with many essential components of cognition through active compression and storage of historical sensorimotor data in an easily addressable manner. Current approaches neither fulfil these functional requirements, nor build upon recent understanding of predictive coding, deep learning, nor the neurobiology of memory. This position paper highlights desiderata for a modern implementation of synthetic autobiographical memory based on human episodic memory, and proposes that a recently developed model of hippocampal memory could be extended as a generalised model of autobiographical memory. Initial implementation will be targeted at social interaction, where current synthetic autobiographical memory systems have had success.

[1]  Alan Baddeley,et al.  Essentials of Human Memory (Classic Edition) , 2013 .

[2]  James L. McClelland,et al.  Why there are complementary learning systems in the hippocampus and neocortex: insights from the successes and failures of connectionist models of learning and memory. , 1995, Psychological review.

[3]  Karl J. Friston,et al.  Predictive coding under the free-energy principle , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[4]  B. Schölkopf,et al.  Modeling Human Motion Using Binary Latent Variables , 2007 .

[5]  Neil Burgess,et al.  Attractor Dynamics in the Hippocampal Representation of the Local Environment , 2005, Science.

[6]  Jonathan D. Spence,et al.  The Memory Palace of Matteo Ricci , 1984 .

[7]  Ha Hong,et al.  Hierarchical Modular Optimization of Convolutional Networks Achieves Representations Similar to Macaque IT and Human Ventral Stream , 2013, NIPS.

[8]  Nathan F. Lepora,et al.  Biomimetic and Biohybrid Systems , 2014, Lecture Notes in Computer Science.

[9]  E. Tulving Elements of episodic memory , 1983 .

[10]  Neil D. Lawrence,et al.  Probabilistic Non-linear Principal Component Analysis with Gaussian Process Latent Variable Models , 2005, J. Mach. Learn. Res..

[11]  A. Borst Seeing smells: imaging olfactory learning in bees , 1999, Nature Neuroscience.

[12]  S. Tonegawa,et al.  Young Dentate Granule Cells Mediate Pattern Separation, whereas Old Granule Cells Facilitate Pattern Completion , 2012, Cell.

[13]  D Marr,et al.  Simple memory: a theory for archicortex. , 1971, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[14]  Eero P. Simoncelli Vision and the statistics of the visual environment , 2003, Current Opinion in Neurobiology.

[15]  Emrah Duzel,et al.  A neoHebbian framework for episodic memory; role of dopamine-dependent late LTP , 2011, Trends in Neurosciences.

[16]  M. Conway Autobiographical Memory: An Introduction , 1990 .

[17]  N. Burgess,et al.  The hippocampus and memory: insights from spatial processing , 2008, Nature Reviews Neuroscience.

[18]  J. D. McGaugh,et al.  False memories in highly superior autobiographical memory individuals , 2013, Proceedings of the National Academy of Sciences.

[19]  Charles Fox,et al.  Maximum utility unitary coherent perception vs. the Bayesian brain , 2012, CogSci.

[20]  Vanessa E. Ghosh,et al.  What is a memory schema? A historical perspective on current neuroscience literature , 2014, Neuropsychologia.

[21]  Tony J. Prescott,et al.  Scaling up a Boltzmann machine model of hippocampus with visual features for mobile robots , 2011, 2011 IEEE International Conference on Robotics and Biomimetics.

[22]  A. Pouget,et al.  Probabilistic brains: knowns and unknowns , 2013, Nature Neuroscience.

[23]  Aaron C. Courville,et al.  The pigeon as particle filter , 2007, NIPS 2007.

[24]  B. Milner,et al.  Further analysis of the hippocampal amnesic syndrome: 14-year follow-up study of H.M.☆ , 1968 .

[25]  Lazaros S. Iliadis,et al.  Artificial Neural Networks - ICANN 2010 - 20th International Conference, Thessaloniki, Greece, September 15-18, 2010, Proceedings, Part I , 2010, International Conference on Artificial Neural Networks.

[26]  Demis Hassabis,et al.  The construction system of the brain , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[27]  Paul Newman,et al.  How was your day? Online visual workspace summaries using incremental clustering in topic space , 2012, 2012 IEEE International Conference on Robotics and Automation.

[28]  Arthur E. Bryson,et al.  OPTIMAL PROGRAMMING PROBLEMS WITH INEQUALITY CONSTRAINTS , 1963 .

[29]  Karl J. Friston The free-energy principle: a unified brain theory? , 2010, Nature Reviews Neuroscience.

[30]  Kevin Gurney,et al.  Optimal decision-making in mammals: insights from a robot study of rodent texture discrimination , 2012, Journal of The Royal Society Interface.

[31]  Yoshua. Bengio,et al.  Learning Deep Architectures for AI , 2007, Found. Trends Mach. Learn..

[32]  Tony J. Prescott,et al.  Learning in a Unitary Coherent Hippocampus , 2010, ICANN.

[33]  Tony Belpaeme,et al.  A review of long-term memory in natural and synthetic systems , 2012, Adapt. Behav..

[34]  Peter Ford Dominey,et al.  The Coordinating Role of Language in Real-Time Multimodal Learning of Cooperative Tasks , 2013, IEEE Transactions on Autonomous Mental Development.

[35]  I. Vernersson Open University Press , 2000 .

[36]  Ulric Neisser,et al.  Chapter 2 – Criteria for an Ecological Self , 1995 .

[37]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[38]  Tony J. Prescott,et al.  Hippocampus as unitary coherent particle filter , 2010, The 2010 International Joint Conference on Neural Networks (IJCNN).

[39]  David C. Rubin,et al.  Understanding Autobiographical Memory: Contents , 2012 .

[40]  G. Miller The cognitive revolution: a historical perspective , 2003, Trends in Cognitive Sciences.

[41]  Peter Ford Dominey,et al.  Embodied Simulation Based on Autobiographical Memory , 2013, Living Machines.

[42]  Neil Burgess,et al.  Forward and Backward Inference in Spatial Cognition , 2013, PLoS Comput. Biol..

[43]  M. Botvinick,et al.  Neural representations of events arise from temporal community structure , 2013, Nature Neuroscience.

[44]  S. Becker,et al.  Remembering the past and imagining the future: a neural model of spatial memory and imagery. , 2007, Psychological review.

[45]  Peter Dayan,et al.  Hippocampal Contributions to Control: The Third Way , 2007, NIPS.

[46]  Michael T. Turvey,et al.  Inadequacies of the Computer Metaphor , 1984 .

[47]  S. Laughlin,et al.  Predictive coding: a fresh view of inhibition in the retina , 1982, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[48]  David C. Rubin,et al.  The Basic-Systems Model of Episodic Memory , 2006, Perspectives on psychological science : a journal of the Association for Psychological Science.

[49]  H. Eichenbaum,et al.  Interplay of Hippocampus and Prefrontal Cortex in Memory , 2013, Current Biology.

[50]  Mark S. Cohen,et al.  Changes in cortical activity during mental rotation. A mapping study using functional MRI. , 1996, Brain : a journal of neurology.

[51]  G. Buzsáki,et al.  Memory, navigation and theta rhythm in the hippocampal-entorhinal system , 2013, Nature Neuroscience.

[52]  A. Clark Whatever next? Predictive brains, situated agents, and the future of cognitive science. , 2013, The Behavioral and brain sciences.

[53]  Neil D. Lawrence,et al.  Deep Gaussian Processes , 2012, AISTATS.

[54]  John R. Anderson ACT: A simple theory of complex cognition. , 1996 .

[55]  Peter Ford Dominey,et al.  Successive Developmental Levels of Autobiographical Memory for Learning Through Social Interaction , 2014, IEEE Transactions on Autonomous Mental Development.

[56]  Paul F. M. J. Verschure,et al.  Neuron Report TheMechanismofRateRemappingintheDentateGyrus , 2010 .