A Dynamic Bayesian Model of Homeostatic Control

This paper shows how a planning as inference framework with discrete latent states can be used to implement homeostatic control by providing an agent with multivariate autonomic set points as goals. Before receiving these goals the agent navigates according to the ‘Prior Dynamics’ which embody a cognitive map of the environment. Given the goals, optimal value functions are implicitly computed using a forward and backward message passing algorithm, which is then used to construct the ‘Posterior Dynamics’. We propose that this formalism provides a useful description of computations in the mammalian Hippocampus.

[1]  R. Passingham The hippocampus as a cognitive map J. O'Keefe & L. Nadel, Oxford University Press, Oxford (1978). 570 pp., £25.00 , 1979, Neuroscience.

[2]  William D. Penny Simultaneous Localisation and Planning , 2014, 2014 4th International Workshop on Cognitive Information Processing (CIP).

[3]  A. David Redish,et al.  Hippocampal replay contributes to within session learning in a temporal difference reinforcement learning model , 2005, Neural Networks.

[4]  P. Sterling Allostasis: A model of predictive regulation , 2012, Physiology & Behavior.

[5]  Neil Burgess,et al.  Forward and Backward Inference in Spatial Cognition , 2013, PLoS Comput. Biol..

[6]  Karl J. Friston,et al.  A free energy principle for the brain , 2006, Journal of Physiology-Paris.

[7]  David J. Foster,et al.  Hippocampal theta sequences , 2007, Hippocampus.

[8]  P. Dayan,et al.  Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control , 2005, Nature Neuroscience.

[9]  Hagai Attias,et al.  Planning by Probabilistic Inference , 2003, AISTATS.

[10]  Boris S. Gutkin,et al.  A Reinforcement Learning Theory for Homeostatic Regulation , 2011, NIPS.

[11]  W. Cannon ORGANIZATION FOR PHYSIOLOGICAL HOMEOSTASIS , 1929 .

[12]  Demis Hassabis,et al.  The construction system of the brain , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[13]  Emanuel Todorov,et al.  Efficient computation of optimal actions , 2009, Proceedings of the National Academy of Sciences.

[14]  Brad E. Pfeiffer,et al.  Hippocampal place cell sequences depict future paths to remembered goals , 2013, Nature.

[15]  R U Muller,et al.  Hippocampal place cells connected by Hebbian synapses can solve spatial problems , 1996, Hippocampus.

[16]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.