The modularity of action and perception revisited using control theory and active inference

The assumption that action and perception can be investigated independently is entrenched in theories, models and experimental approaches across the brain and mind sciences. In cognitive science, this has been a central point of contention between computationalist and 4Es (enactive, embodied, extended and embedded) theories of cognition, with the former embracing the "classical sandwich", modular, architecture of the mind and the latter actively denying this separation can be made. In this work we suggest that the modular independence of action and perception strongly resonates with the separation principle of control theory and furthermore that this principle provides formal criteria within which to evaluate the implications of the modularity of action and perception. We will also see that real-time feedback with the environment, often considered necessary for the definition of 4Es ideas, is not however a sufficient condition to avoid the "classical sandwich". Finally, we argue that an emerging framework in the cognitive and brain sciences, active inference, extends ideas derived from control theory to the study of biological systems while disposing of the separation principle, describing non-modular models of behaviour strongly aligned with 4Es theories of cognition.

[1]  Raymond A. de Callafon,et al.  Optimal trade-off between exploration and exploitation , 2008, 2008 American Control Conference.

[2]  D. Knill,et al.  The Bayesian brain: the role of uncertainty in neural coding and computation , 2004, Trends in Neurosciences.

[3]  Karl J. Friston The free-energy principle: a unified brain theory? , 2010, Nature Reviews Neuroscience.

[4]  A. Borst Seeing smells: imaging olfactory learning in bees , 1999, Nature Neuroscience.

[5]  David W. Franklin,et al.  Computational Mechanisms of Sensorimotor Control , 2011, Neuron.

[6]  R. Bellman Dynamic programming. , 1957, Science.

[7]  Emanuel Todorov,et al.  Optimal Control Theory , 2006 .

[8]  Margaret Wilson,et al.  Six views of embodied cognition , 2002, Psychonomic bulletin & review.

[9]  Pawel Gladziejewski,et al.  Predictive coding and representationalism , 2016, Synthese.

[10]  D M Wolpert,et al.  Multiple paired forward and inverse models for motor control , 1998, Neural Networks.

[11]  Xabier E. Barandiaran,et al.  Sensorimotor Life: An enactive proposal , 2017 .

[12]  M. L. Chambers The Mathematical Theory of Optimal Processes , 1965 .

[13]  Zoubin Ghahramani,et al.  Computational principles of movement neuroscience , 2000, Nature Neuroscience.

[14]  J. Hohwy The Predictive Mind , 2013 .

[15]  A. Clark Surfing Uncertainty: Prediction, Action, and the Embodied Mind , 2015 .

[16]  Karl J. Friston,et al.  Action and behavior: a free-energy formulation , 2010, Biological Cybernetics.

[17]  Susan Hurley,et al.  Perception And Action: Alternative Views , 2001, Synthese.

[18]  A. Jazwinski Stochastic Processes and Filtering Theory , 1970 .

[19]  A. Clark Radical predictive processing , 2015 .

[20]  Karl J. Friston Life as we know it , 2013, Journal of The Royal Society Interface.

[21]  Hagai Attias,et al.  Planning by Probabilistic Inference , 2003, AISTATS.

[22]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[23]  Hiroyuki Iizuka,et al.  How (not) to model autonomous behaviour , 2008, Biosyst..

[24]  D. Zahavi Brain, Mind, World: Predictive Coding, Neo-Kantianism, and Transcendental Idealism , 2017, Husserl Studies.

[25]  Simon McGregor,et al.  The free energy principle for action and perception: A mathematical review , 2017, 1705.09156.

[26]  M. Sommer,et al.  Corollary discharge across the animal kingdom , 2008, Nature Reviews Neuroscience.

[27]  E. Robinson Cybernetics, or Control and Communication in the Animal and the Machine , 1963 .

[28]  Konrad Paul Kording,et al.  Decision Theory: What "Should" the Nervous System Do? , 2007, Science.

[29]  R. E. Kalman,et al.  Contributions to the Theory of Optimal Control , 1960 .

[30]  Marina Basu The Embodied Mind: Cognitive Science and Human Experience , 2004 .

[31]  H. Theil A Note on Certainty Equivalence in Dynamic Planning , 1957 .

[32]  K. Cullen Sensory signals during active versus passive movement , 2004, Current Opinion in Neurobiology.

[33]  Randall D. Beer,et al.  Information Processing and Dynamics in Minimally Cognitive Agents , 2015, Cogn. Sci..

[34]  Konrad Paul Kording,et al.  Review TRENDS in Cognitive Sciences Vol.10 No.7 July 2006 Special Issue: Probabilistic models of cognition Bayesian decision theory in sensorimotor control , 2022 .

[35]  Jan C. Willems,et al.  300 years of optimal control: From the brachystochrone to the maximum principle , 1997 .

[36]  Erik Rietveld,et al.  The anticipating brain is not a scientist: the free-energy principle from an ecological-enactive perspective , 2016, Synthese.

[37]  A. G. Feldman New insights into action–perception coupling , 2009, Experimental Brain Research.

[38]  A. Clark Whatever next? Predictive brains, situated agents, and the future of cognitive science. , 2013, The Behavioral and brain sciences.

[39]  Max Coltheart,et al.  Modularity and cognition , 1999, Trends in Cognitive Sciences.

[40]  Hiroyuki Iizuka,et al.  Simulating autonomous coupling in discrimination of light frequencies , 2004, Connect. Sci..

[41]  Emanuel Todorov,et al.  General duality between optimal control and estimation , 2008, 2008 47th IEEE Conference on Decision and Control.

[42]  Anil K. Seth,et al.  The cybernetic Bayesian brain: from interoceptive inference to sensorimotor contingencies , 2014 .

[43]  Karl J. Friston What Is Optimal about Motor Control? , 2011, Neuron.

[44]  E. Holst,et al.  Das Reafferenzprinzip , 2004, Naturwissenschaften.

[45]  H. Barrett,et al.  Modularity in cognition: framing the debate. , 2006, Psychological review.

[46]  Randall D. Beer,et al.  The Dynamics of Active Categorical Perception in an Evolved Model Agent , 2003, Adapt. Behav..

[47]  Viktor Mikhaĭlovich Glushkov,et al.  An Introduction to Cybernetics , 1957, The Mathematical Gazette.

[48]  Hans Straka,et al.  A New Perspective on Predictive Motor Signaling , 2018, Current Biology.

[49]  E. Todorov Optimality principles in sensorimotor control , 2004, Nature Neuroscience.

[50]  Wanja Wiese,et al.  Action Is Enabled by Systematic Misrepresentations , 2017 .

[51]  W. Richards,et al.  Perception as Bayesian Inference , 2008 .

[52]  H. Kappen Optimal control theory and the linear bellman equation , 2011 .

[53]  Giovanni Pezzulo,et al.  Model-Based Approaches to Active Perception and Control , 2017, Entropy.

[54]  L. S. Pontryagin,et al.  Mathematical Theory of Optimal Processes , 1962 .

[55]  Karl J. Friston,et al.  From cognitivism to autopoiesis: towards a computational framework for the embodied mind , 2016, Synthese.

[56]  Karl J. Friston,et al.  The pragmatic turn : toward action-oriented views in cognitive science , 2016 .

[57]  W. Wonham On the Separation Theorem of Stochastic Control , 1968 .

[58]  M. Hoagland,et al.  Feedback Systems An Introduction for Scientists and Engineers SECOND EDITION , 2015 .

[59]  Norbert Wiener,et al.  Cybernetics: Control and Communication in the Animal and the Machine. , 1949 .

[60]  J. Fodor The Modularity of mind. An essay on faculty psychology , 1986 .

[61]  H. Simon,et al.  Dynamic Programming Under Uncertainty with a Quadratic Criterion Function , 1956 .

[62]  Anatol G Feldman,et al.  Active sensing without efference copy: referent control of perception. , 2016, Journal of neurophysiology.

[63]  Tryphon T. Georgiou,et al.  The Separation Principle in Stochastic Control, Redux , 2011, IEEE Transactions on Automatic Control.

[64]  H. Sorenson Least-squares estimation: from Gauss to Kalman , 1970, IEEE Spectrum.

[65]  Mitsuo Kawato,et al.  Internal models for motor control and trajectory planning , 1999, Current Opinion in Neurobiology.

[66]  T. Başar Contributions to the Theory of Optimal Control , 2001 .

[67]  K. Åström Introduction to Stochastic Control Theory , 1970 .

[68]  A. Clark Being There: Putting Brain, Body, and World Together Again , 1996 .

[69]  Tom Froese,et al.  The brain is not an isolated "black box," nor is its goal to become one. , 2013, The Behavioral and brain sciences.

[70]  Stefan Schaal,et al.  The Role of Measurement Uncertainty in Optimal Control for Contact Interactions , 2016 .

[71]  Karl J. Friston,et al.  A Free Energy Principle for Biological Systems. , 2012, Entropy.

[72]  A. Clark,et al.  Getting ahead: forward models and their place in cognitive architecture , 2014, Trends in Cognitive Sciences.

[73]  Inman Harvey,et al.  Evolutionary Robotics: A New Scientific Tool for Studying Cognition , 2005, Artificial Life.