A nice surprise? Predictive processing and the active pursuit of novelty

Recent work in cognitive and computational neuroscience depicts human brains as devices that minimize prediction error signals: signals that encode the difference between actual and expected sensory stimulations. This raises a series of puzzles whose common theme concerns a potential misfit between this bedrock informationtheoretic vision and familiar facts about the attractions of the unexpected. We humans often seem to actively seek out surprising events, deliberately harvesting novel and exciting streams of sensory stimulation. Conversely, we often experience some wellexpected sensations as unpleasant and to-be-avoided. In this paper, I explore several core and variant forms of this puzzle, using them to display multiple interacting elements that together deliver a satisfying solution. That solution requires us to go beyond the discussion of simple information-theoretic imperatives (such as 'minimize long-term prediction error') and to recognize the essential role of species-specific prestructuring, epistemic foraging, and cultural practices in shaping the restless, curious, novelty-seeking human mind.

[1]  HighWire Press Philosophical Transactions of the Royal Society of London , 1781, The London Medical Journal.

[2]  Myron Tribus,et al.  Thermostatics and thermodynamics : an introduction to energy, information and states of matter, with engineering applications , 1961 .

[3]  L. Brown A Complete Class Theorem for Statistical Problems with Finite Sample Spaces , 1981 .

[4]  J. Elman Distributed Representations, Simple Recurrent Networks, And Grammatical Structure , 1991 .

[5]  J. Elman Learning and development in neural networks: the importance of starting small , 1993, Cognition.

[6]  W. Singer,et al.  Dynamic predictions: Oscillations and synchrony in top–down processing , 2001, Nature Reviews Neuroscience.

[7]  Karl J. Friston,et al.  PHRENOLOGY : What Can Neuroimaging Tell Us About Distributed Circuitry ? , 2005 .

[8]  Stefan L. Frank,et al.  Learn more by training less: systematicity in sentence processing by recurrent networks , 2006, Connect. Sci..

[9]  R. Montague Why Choose This Book?: How We Make Decisions , 2006 .

[10]  Edwin Hutchins,et al.  The role of cultural practices in the emergence of modern human intelligence , 2008, Philosophical Transactions of the Royal Society B: Biological Sciences.

[11]  Karl J. Friston,et al.  Frontiers in Neuroinformatics , 2022 .

[12]  Moshe Bar,et al.  See it with feeling: affective predictions during object perception , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[13]  Karl J. Friston The free-energy principle: a unified brain theory? , 2010, Nature Reviews Neuroscience.

[14]  Karl J. Friston,et al.  Attention, Uncertainty, and Free-Energy , 2010, Front. Hum. Neurosci..

[15]  Karl J. Friston,et al.  Action and behavior: a free-energy formulation , 2010, Biological Cybernetics.

[16]  Karl J. Friston Embodied Inference : or “ I think therefore I am , if I am what I think ” , 2010 .

[17]  Karl J. Friston What Is Optimal about Motor Control? , 2011, Neuron.

[18]  Karl J. Friston,et al.  Perceptions as Hypotheses: Saccades as Experiments , 2012, Front. Psychology.

[19]  Ana B. Chica,et al.  Attentional Routes to Conscious Perception , 2012, Front. Psychology.

[20]  Cecilia Heyes,et al.  New thinking: the evolution of human cognition , 2012, Philosophical Transactions of the Royal Society B: Biological Sciences.

[21]  Cecilia Heyes,et al.  Grist and mills: on the cultural origins of cultural learning , 2012, Philosophical Transactions of the Royal Society B: Biological Sciences.

[22]  Karl J. Friston Policies and Priors , 2012 .

[23]  Samuel D. Gosling,et al.  Evolution and the Mechanisms of Decision Making , 2012 .

[24]  Richard N. Aslin,et al.  The Goldilocks Effect: Human Infants Allocate Attention to Visual Sequences That Are Neither Too Simple Nor Too Complex , 2012, PloS one.

[25]  Karl J. Friston,et al.  Free-Energy Minimization and the Dark-Room Problem , 2012, Front. Psychology.

[26]  M. Seligman,et al.  Navigating Into the Future or Driven by the Past , 2013, Perspectives on psychological science : a journal of the Association for Psychological Science.

[27]  A. Maslow A Theory of Human Motivation , 1943 .

[28]  Shaun Gallagher,et al.  The brain as part of an enactive system , 2013, Behavioral and Brain Sciences.

[29]  Raymond J. Dolan,et al.  Exploration, novelty, surprise, and free energy minimization , 2013, Front. Psychol..

[30]  William A Phillips Neuronal inference must be local, selective, and coordinated. , 2013, The Behavioral and brain sciences.

[31]  A. Clark Whatever next? Predictive brains, situated agents, and the future of cognitive science. , 2013, The Behavioral and brain sciences.

[32]  Andy Clark,et al.  Are we predictive engines? Perils, prospects, and the puzzle of the porous perceiver. , 2013, The Behavioral and brain sciences.

[33]  J. Hohwy The Predictive Mind , 2013 .

[34]  Michael L. Anderson,et al.  The problem with brain GUTs: conflation of different senses of "prediction" threatens metaphysical disaster. , 2013, The Behavioral and brain sciences.

[35]  Tom Froese,et al.  The brain is not an isolated "black box," nor is its goal to become one. , 2013, The Behavioral and brain sciences.

[36]  A. Clark Expecting the World: Perception, Prediction, and the Origins of Human Knowledge , 2013 .

[37]  A. Seth Interoceptive inference, emotion, and the embodied self , 2013, Trends in Cognitive Sciences.

[38]  Daniel Ying-Jeh Little,et al.  Maximal mutual information, not minimal entropy, for escaping the "Dark Room". , 2013, The Behavioral and brain sciences.

[39]  Zoe Drayson,et al.  The Personal/Subpersonal Distinction , 2014 .

[40]  Erik Rietveld,et al.  A Rich Landscape of Affordances , 2014 .

[41]  A. Craig How Do You Feel?: An Interoceptive Moment with Your Neurobiological Self , 2014 .

[42]  Darran Yates,et al.  Sensory neurons: The sense in reprogramming , 2014, Nature Reviews Neuroscience.

[43]  L. Pessoa Understanding brain networks and brain organization. , 2014, Physics of life reviews.

[44]  Giovanni Pezzulo,et al.  Why do you fear the bogeyman? An embodied predictive coding model of perceptual inference , 2013, Cognitive, Affective, & Behavioral Neuroscience.

[45]  W. K. Simmons,et al.  Interoceptive predictions in the brain , 2015, Nature Reviews Neuroscience.

[46]  Michael Madary,et al.  Extending the Explanandum for Predictive Processing , 2015 .

[47]  Karl J. Friston,et al.  Cerebral hierarchies: predictive processing, precision and the pulvinar , 2015, Philosophical Transactions of the Royal Society B: Biological Sciences.

[48]  A. Clark,et al.  Words and the World , 2015 .

[49]  A. Clark Surfing Uncertainty: Prediction, Action, and the Embodied Mind , 2015 .

[50]  Karl J. Friston,et al.  Neuroscience and Biobehavioral Reviews , 2022 .

[51]  Pierre-Yves Oudeyer,et al.  How Evolution May Work Through Curiosity-Driven Developmental Process , 2016, Top. Cogn. Sci..

[52]  Erik Rietveld,et al.  The anticipating brain is not a scientist: the free-energy principle from an ecological-enactive perspective , 2016, Synthese.