A Minimal Active Inference Agent

Research on the so-called "free-energy principle'' (FEP) in cognitive neuroscience is becoming increasingly high-profile. To date, introductions to this theory have proved difficult for many readers to follow, but it depends mainly upon two relatively simple ideas: firstly that normative or teleological values can be expressed as probability distributions (active inference), and secondly that approximate Bayesian reasoning can be effectively performed by gradient descent on model parameters (the free-energy principle). The notion of active inference is of great interest for a number of disciplines including cognitive science and artificial intelligence, as well as cognitive neuroscience, and deserves to be more widely known. This paper attempts to provide an accessible introduction to active inference and informational free-energy, for readers from a range of scientific backgrounds. In this work introduce an agent-based model with an agent trying to make predictions about its position in a one-dimensional discretized world using methods from the FEP.

[1]  Geoffrey E. Hinton,et al.  The Helmholtz Machine , 1995, Neural Computation.

[2]  Karl J. Friston,et al.  Perceptions as Hypotheses: Saccades as Experiments , 2012, Front. Psychology.

[3]  A. Turing On Computable Numbers, with an Application to the Entscheidungsproblem. , 1937 .

[4]  N. Bostrom Anthropic Bias: Observation Selection Effects in Science and Philosophy , 2002 .

[5]  Tom Florian Sterkenburg,et al.  The Foundations of Solomono Prediction , 2013 .

[6]  Ming Li,et al.  An Introduction to Kolmogorov Complexity and Its Applications , 2019, Texts in Computer Science.

[7]  Karl J. Friston,et al.  Variational free energy and the Laplace approximation , 2007, NeuroImage.

[8]  Karl J. Friston,et al.  Active inference and agency: optimal control without cost functions , 2012, Biological Cybernetics.

[9]  Rodney A. Brooks,et al.  Cambrian Intelligence: The Early History of the New AI , 1999 .

[10]  Michael Barr,et al.  The Emperor's New Mind , 1989 .

[11]  Marcus Hutter,et al.  A Philosophical Treatise of Universal Induction , 2011, Entropy.

[12]  K. Gödel Über formal unentscheidbare Sätze der Principia Mathematica und verwandter Systeme I , 1931 .

[13]  Marcus Hutter,et al.  Universal Algorithmic Intelligence: A Mathematical Top→Down Approach , 2007, Artificial General Intelligence.

[14]  Karl J. Friston,et al.  Reinforcement Learning or Active Inference? , 2009, PloS one.

[15]  Karl J. Friston,et al.  A free energy principle for the brain , 2006, Journal of Physiology-Paris.

[16]  Jürgen Schmidhuber,et al.  Algorithmic Theories of Everything , 2000, ArXiv.

[17]  R. Baierlein Probability Theory: The Logic of Science , 2004 .

[18]  R. A. Leibler,et al.  On Information and Sufficiency , 1951 .

[19]  Simon McGregor Algorithmic Information Theory and Novelty Generation , 2007 .

[20]  B. Carter The anthropic principle and its implications for biological evolution , 1983, Philosophical Transactions of the Royal Society of London. Series A, Mathematical and Physical Sciences.

[21]  Ming Li,et al.  Clustering by compression , 2003, IEEE International Symposium on Information Theory, 2003. Proceedings..

[22]  Aron Vallinder Solomonoff Induction: A Solution to the Problem of the Priors? , 2012 .

[23]  P.-M. Binder,et al.  Philosophy of science: Theories of almost everything , 2008, Nature.

[24]  Jürgen Schmidhuber,et al.  The Speed Prior: A New Simplicity Measure Yielding Near-Optimal Computable Predictions , 2002, COLT.

[25]  Kevin T. Kelly Justification as Truth-Finding Efficiency: How Ockham's Razor Works , 2004, Minds and Machines.

[26]  Corso Elvezia,et al.  Discovering Neural Nets with Low Kolmogorov Complexity and High Generalization Capability , 1997 .

[27]  Markus Müller,et al.  Stationary algorithmic probability , 2006, Theor. Comput. Sci..

[28]  Selmer Bringsjord,et al.  Superminds: People Harness Hypercomputation, and More , 2003 .

[29]  J. Lucas Minds, Machines and Gödel , 1961, Philosophy.

[30]  A. Clark Being There: Putting Brain, Body, and World Together Again , 1996 .

[31]  W. Ashby,et al.  Every Good Regulator of a System Must Be a Model of That System , 1970 .

[32]  David H. Wolpert,et al.  Physical limits of inference , 2007, ArXiv.

[33]  N. Chater,et al.  Simplicity: a unifying principle in cognitive science? , 2003, Trends in Cognitive Sciences.

[34]  John R. Searle,et al.  Minds, brains, and programs , 1980, Behavioral and Brain Sciences.

[35]  A. Clark Whatever next? Predictive brains, situated agents, and the future of cognitive science. , 2013, The Behavioral and brain sciences.

[36]  Karl J. Friston Hierarchical Models in the Brain , 2008, PLoS Comput. Biol..

[37]  Karl J. Friston The free-energy principle: a unified brain theory? , 2010, Nature Reviews Neuroscience.

[38]  Marcus Hutter,et al.  Open Problems in Universal Induction & Intelligence , 2009, Algorithms.