What do predictive coders want?

The so-called “dark room problem” makes vivd the challenges that purely predictive models face in accounting for motivation. I argue that the problem is a serious one. Proposals for solving the dark room problem via predictive coding architectures are either empirically inadequate or computationally intractable. The Free Energy principle might avoid the problem, but only at the cost of setting itself up as a highly idealized model, which is then literally false to the world. I draw at least one optimistic conclusion, however. Real-world, real-time systems may embody motivational states in a variety of ways consistent with idealized principles like FEP, including ways that are intuitively embodied and extended. This may allow predictive coding theorists to reconcile their account with embodied principles, even if it ultimately undermines loftier ambitions.

[1]  Anil K. Seth,et al.  The cybernetic Bayesian brain: from interoceptive inference to sensorimotor contingencies , 2014 .

[2]  Colin Klein,et al.  What the Body Commands: The Imperative Theory of Pain , 2015 .

[3]  R. D. Gray,et al.  Developmental Systems and Evolutionary Explanation , 1994 .

[4]  W. Ashby,et al.  An Introduction to Cybernetics , 1957 .

[5]  W. Ashby,et al.  Every Good Regulator of a System Must Be a Model of That System , 1970 .

[6]  H. Putnam 17. The Nature of Mental States , 1975 .

[7]  Peter Elias,et al.  Predictive coding-I , 1955, IRE Trans. Inf. Theory.

[8]  Marvin Minsky,et al.  Computation : finite and infinite machines , 2016 .

[9]  Andy Gardner,et al.  Sex and Death: The Effects of Innate Immune Factors on the Sexual Reproduction of Malaria Parasites , 2011, PLoS pathogens.

[10]  Rajesh P. N. Rao,et al.  Predictive Coding , 2019, A Blueprint for the Hard Problem of Consciousness.

[11]  Rajesh P. N. Rao,et al.  Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive-field effects. , 1999 .

[12]  F. Perkins Haplosporidian And Haplosporidian-Like Diseases Of Shellfish , 1979 .

[13]  H. Simon,et al.  The sciences of the artificial (3rd ed.) , 1996 .

[14]  C. Klein An ideal solution to disputes about multiply realized kinds , 2008 .

[15]  P. Wall,et al.  Pain mechanisms: a new theory. , 1965, Science.

[16]  Erik Larson,et al.  The Devil in the White City: Murder, Magic, and Madness at the Fair That Changed America , 2003 .

[17]  Curtis M. Lively,et al.  SEX AND DEATH , 1991 .

[18]  Jacob Feldman,et al.  Tuning Your Priors to the World , 2013, Top. Cogn. Sci..

[19]  Bryce Huebner Surprisal and Valuation in the Predictive Brain , 2012, Front. Psychology.

[20]  R. Goebel,et al.  Local Discriminability Determines the Strength of Holistic Processing for Faces in the Fusiform Face Area , 2013, Front. Psychology.

[21]  J. Woodward Making Things Happen: A Theory of Causal Explanation , 2003 .

[22]  C. Craver Explaining the Brain: Mechanisms and the Mosaic Unity of Neuroscience , 2007 .

[23]  A. Seth Interoceptive inference: from decision-making to organism integrity , 2014 .

[24]  A. Gawande,et al.  The Checklist Manifesto: How to Get Things Right , 2011 .

[25]  A. Clark Whatever next? Predictive brains, situated agents, and the future of cognitive science. , 2013, The Behavioral and brain sciences.

[26]  Karl J. Friston Active inference and agency , 2014, Cognitive neuroscience.

[27]  Karl J. Friston The free-energy principle: a unified brain theory? , 2010, Nature Reviews Neuroscience.

[28]  David Mumford,et al.  On the computational architecture of the neocortex , 2004, Biological Cybernetics.

[29]  P. Godfrey‐Smith Darwinian populations and natural selection , 2009 .

[30]  F. Galimberti,et al.  Extreme polygyny among southern elephant seals on Sea Lion Island, Falkland Islands , 2004 .

[31]  Michael L. Anderson,et al.  The problem with brain GUTs: conflation of different senses of "prediction" threatens metaphysical disaster. , 2013, The Behavioral and brain sciences.

[32]  J. Hohwy The Predictive Mind , 2013 .

[33]  Herbert A. Simon,et al.  The Sciences of the Artificial , 1970 .

[34]  Karl J. Friston,et al.  Free-Energy Minimization and the Dark-Room Problem , 2012, Front. Psychology.

[35]  A. Clark Surfing Uncertainty: Prediction, Action, and the Embodied Mind , 2015 .

[36]  Ronald Melzack,et al.  From the gate to the neuromatrix , 1999, Pain.

[37]  Karl J. Friston,et al.  Active inference and agency: optimal control without cost functions , 2012, Biological Cybernetics.

[38]  Andy Clark,et al.  Are we predictive engines? Perils, prospects, and the puzzle of the porous perceiver. , 2013, The Behavioral and brain sciences.

[39]  Karl J. Friston Active inference and free energy. , 2013, The Behavioral and brain sciences.