Nonmodular Architectures of Cognitive Systems based on Active Inference

In psychology and neuroscience it is common to describe cognitive systems as input/output devices where perceptual and motor functions are implemented in a purely feedforward, open-loop fashion. On this view, perception and action are often seen as encapsulated modules with limited interaction between them. While embodied and enactive approaches to cognitive science have challenged the idealisation of the brain as an input/output device, we argue that even the more recent attempts to model systems using closed-loop architectures still heavily rely on a strong separation between motor and perceptual functions. Previously, we have suggested that the mainstream notion of modularity strongly resonates with the separation principle of control theory. In this work we present a minimal model of a sensorimotor loop implementing an architecture based on the separation principle. We link this to popular formulations of perception and action in the cognitive sciences, and show its limitations when, for instance, external forces are not modelled by an agent. These forces can be seen as variables that an agent cannot directly control, i.e., a perturbation from the environment or an interference caused by other agents. As an alternative approach inspired by embodied cognitive science, we then propose a nonmodular architecture based on active inference. We demonstrate the robustness of this architecture to unknown external inputs and show that the mechanism with which this is achieved in linear models is equivalent to integral control.

[1]  D. Wolpert,et al.  Principles of sensorimotor learning , 2011, Nature Reviews Neuroscience.

[2]  David W. Franklin,et al.  Computational Mechanisms of Sensorimotor Control , 2011, Neuron.

[3]  A. G. Feldman New insights into action–perception coupling , 2009, Experimental Brain Research.

[4]  Karl J. Friston,et al.  DEM: A variational treatment of dynamic systems , 2008, NeuroImage.

[5]  E. Todorov Optimality principles in sensorimotor control , 2004, Nature Neuroscience.

[6]  Adam Binch,et al.  Perception as Bayesian Inference , 2014 .

[7]  Christopher L. Buckley,et al.  A Probabilistic Interpretation of PID Controllers Using Active Inference , 2018, SAB.

[8]  Anne K. Churchland,et al.  Perceptual Decision-Making: A Field in the Midst of a Transformation , 2018, Neuron.

[9]  Giovanni Pezzulo,et al.  Model-Based Approaches to Active Perception and Control , 2017, Entropy.

[10]  Wanja Wiese,et al.  Action Is Enabled by Systematic Misrepresentations , 2017 .

[11]  R A Brooks,et al.  New Approaches to Robotics , 1991, Science.

[12]  David W. Franklin,et al.  When Optimal Feedback Control Is Not Enough: Feedforward Strategies Are Required for Optimal Control with Active Sensing , 2016, PLoS Comput. Biol..

[13]  Susan Hurley,et al.  Perception And Action: Alternative Views , 2001, Synthese.

[14]  Tai Sing Lee,et al.  Hierarchical Bayesian inference in the visual cortex. , 2003, Journal of the Optical Society of America. A, Optics, image science, and vision.

[15]  Margaret Wilson,et al.  Six views of embodied cognition , 2002, Psychonomic bulletin & review.

[16]  Michael I. Jordan,et al.  Optimal feedback control as a theory of motor coordination , 2002, Nature Neuroscience.

[17]  Christopher L. Buckley,et al.  The modularity of action and perception revisited using control theory and active inference , 2018, ALIFE.

[18]  Karl J. Friston,et al.  Free-Energy Minimization and the Dark-Room Problem , 2012, Front. Psychology.

[19]  Karl J. Friston,et al.  Action and behavior: a free-energy formulation , 2010, Biological Cybernetics.

[20]  W. T. Powers Behavior, the control of perception , 1973 .

[21]  G. Gottlieb,et al.  A Computational Model of the Simplest Motor Program. , 1993, Journal of motor behavior.

[22]  Konrad P. Körding,et al.  Bayesian Integration and Non-Linear Feedback Control in a Full-Body Motor Task , 2009, PLoS Comput. Biol..

[23]  E. Ahissar,et al.  Perception as a closed-loop convergence process , 2016, eLife.

[24]  M. A. MacIver,et al.  Neuroscience Needs Behavior: Correcting a Reductionist Bias , 2017, Neuron.

[25]  Karl J. Friston The free-energy principle: a unified brain theory? , 2010, Nature Reviews Neuroscience.

[26]  Karl J. Friston,et al.  From cognitivism to autopoiesis: towards a computational framework for the embodied mind , 2016, Synthese.

[27]  A. Clark Being There: Putting Brain, Body, and World Together Again , 1996 .

[28]  Karl J. Friston,et al.  Active inference, sensory attenuation and illusions , 2013, Cognitive Processing.

[29]  Emanuel Todorov,et al.  Iterative Linear Quadratic Regulator Design for Nonlinear Biological Movement Systems , 2004, ICINCO.

[30]  Robert F. Stengel,et al.  Optimal Control and Estimation , 1994 .

[31]  Dennis S. Bernstein,et al.  Naive control of the double integrator , 2001 .

[32]  W. Wonham On the Separation Theorem of Stochastic Control , 1968 .

[33]  J. Doyle,et al.  Robust perfect adaptation in bacterial chemotaxis through integral feedback control. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[34]  Karl J. Friston What Is Optimal about Motor Control? , 2011, Neuron.

[35]  Karl J. Friston Hierarchical Models in the Brain , 2008, PLoS Comput. Biol..

[36]  E. Holst,et al.  Das Reafferenzprinzip , 2004, Naturwissenschaften.

[37]  J. Fodor The Modularity of mind. An essay on faculty psychology , 1986 .

[38]  Anatol G Feldman,et al.  Active sensing without efference copy: referent control of perception. , 2016, Journal of neurophysiology.

[39]  Viktor Mikhaĭlovich Glushkov,et al.  An Introduction to Cybernetics , 1957, The Mathematical Gazette.

[40]  M. Hoagland,et al.  Feedback Systems An Introduction for Scientists and Engineers SECOND EDITION , 2015 .

[41]  Simon McGregor,et al.  The free energy principle for action and perception: A mathematical review , 2017, 1705.09156.

[42]  Taro Toyoizumi,et al.  A theory of how active behavior stabilises neural activity: Neural gain modulation by closed-loop environmental feedback , 2018, PLoS Comput. Biol..

[43]  Zoubin Ghahramani,et al.  Computational principles of movement neuroscience , 2000, Nature Neuroscience.

[44]  Eduardo D. Sontag,et al.  Adaptation and regulation with signal detection implies internal model , 2003, Syst. Control. Lett..

[45]  Jessica A. Cardin,et al.  Sensation during Active Behaviors , 2017, The Journal of Neuroscience.

[46]  A. Clark Radical predictive processing , 2015 .

[47]  Christopher L. Buckley,et al.  An active inference implementation of phototaxis , 2017, ECAL.

[48]  B. Anderson,et al.  Optimal control: linear quadratic methods , 1990 .

[49]  Michael J. Frank,et al.  A Control Theoretic Model of Adaptive Learning in Dynamic Environments , 2018, Journal of Cognitive Neuroscience.

[50]  Xabier E. Barandiaran,et al.  Sensorimotor Life: An enactive proposal , 2017 .

[51]  Allen Newell,et al.  Human Problem Solving. , 1973 .

[52]  Mitsuo Kawato,et al.  Internal models for motor control and trajectory planning , 1999, Current Opinion in Neurobiology.

[53]  Rajesh P. N. Rao,et al.  Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive-field effects. , 1999 .

[54]  M. Nour Surfing Uncertainty: Prediction, Action, and the Embodied Mind. , 2017, British Journal of Psychiatry.