The predictive brain in action: Involuntary actions reduce body prediction errors

The perception of our body in space is flexible and manipulable. The predictive brain hypothesis explains this malleability as a consequence of the interplay between incoming sensory information and our body expectations. However, given the interaction between perception and action, we might also expect that actions would arise due to prediction errors, especially in conflicting situations. Here we describe a computational model, based on the free-energy principle, that forecasts involuntary movements in sensorimotor conflicts. We experimentally confirm those predictions in humans by means of a virtual reality rubber-hand illusion. Participants generated movements (forces) towards the virtual hand, regardless of its location with respect to the real arm, with little to no forces produced when the virtual hand overlaid their physical hand. The congruency of our model predictions and human observations shows that the brain-body is generating actions to reduce the prediction error between the expected arm location and the new visual arm. This observed unconscious mechanism is an empirical validation of the perception-action duality in body adaptation to uncertain situations and evidence of the active component of predictive processing. Author Summary Humans’ capacity to perceive and control their body in space is central in awareness, adaptation and safe interaction. From low-level body perception to body-ownership, discovering how the brain represents the body and generates actions is of major importance for cognitive science and also for robotics and artificial intelligence. The present study shows that humans move their body to match the expected location according to other (visual) sensory input, which corresponds to reducing the prediction error. This means that the brain adapts to conflicting or uncertain information from the senses by unconsciously acting in the world.

[1]  Hong Yu Wong,et al.  Mind the Body: An Exploration of Bodily Self-Awareness, Frédérique de Vignemont , 2020, Mind.

[2]  M. Tsakiris,et al.  The free-energy self: A predictive coding account of self-recognition , 2014, Neuroscience & Biobehavioral Reviews.

[3]  Marjolein P. M. Kammers,et al.  The rubber hand illusion in action , 2009, Neuropsychologia.

[4]  Daniel M. Wolpert,et al.  A modular planar robotic manipulandum with end-point torque control , 2009, Journal of Neuroscience Methods.

[5]  H. Ehrsson,et al.  Moving a Rubber Hand that Feels Like Your Own: A Dissociation of Ownership and Agency , 2012, Front. Hum. Neurosci..

[6]  E. Todorov Optimality principles in sensorimotor control , 2004, Nature Neuroscience.

[7]  B. Hommel,et al.  Body-ownership for actively operated non-corporeal objects , 2015, Consciousness and Cognition.

[8]  D. Carey,et al.  Do action systems resist visual illusions? , 2001, Trends in Cognitive Sciences.

[9]  Gordon Cheng,et al.  Robot self/other distinction: active inference meets neural networks learning in a mirror , 2020, ECAI.

[10]  Rafal Bogacz,et al.  A tutorial on the free-energy framework for modelling perception and learning , 2017, Journal of mathematical psychology.

[11]  F. Vignemont,et al.  Beyond differences between the body schema and the body image: insights from body hallucinations , 2017, Consciousness and Cognition.

[12]  Jonathan D. Cohen,et al.  Rubber hands ‘feel’ touch that eyes see , 1998, Nature.

[13]  Karl J. Friston,et al.  Variational free energy and the Laplace approximation , 2007, NeuroImage.

[14]  Martin V. Butz,et al.  Rubber Hand Illusion Affects Joint Angle Perception , 2014, PloS one.

[15]  V. Gallese,et al.  The bodily self as power for action , 2010, Neuropsychologia.

[16]  M. Sigman,et al.  Statistical inference of body representation in the macaque brain , 2019, Proceedings of the National Academy of Sciences.

[17]  Raymond J. Dolan,et al.  Dopamine, Affordance and Active Inference , 2012, PLoS Comput. Biol..

[18]  Sylvia Weir,et al.  Action perception , 1974 .

[19]  J. Hohwy The Predictive Mind , 2013 .

[20]  H. Ehrsson,et al.  Behavioural Brain Research , 1999 .

[21]  D. Herman,et al.  Tactile object localization by anticipatory whisker motion. , 2015, Journal of neurophysiology.

[22]  Tuo-Hung Hou,et al.  SLIM: Simultaneous Logic-in-Memory Computing Exploiting Bilayer Analog OxRAM Devices , 2018, Scientific Reports.

[23]  L. Buxbaum,et al.  The Role of the Dynamic Body Schema in Praxis: Evidence from Primary Progressive Apraxia , 2000, Brain and Cognition.

[24]  Pablo Lanillos,et al.  End-to-End Pixel-Based Deep Active Inference for Body Perception and Action , 2020, 2020 Joint IEEE 10th International Conference on Development and Learning and Epigenetic Robotics (ICDL-EpiRob).

[25]  Herta Flor,et al.  Perceptual drifts of real and artificial limbs in the rubber hand illusion , 2016, Scientific Reports.

[26]  D. Wolpert,et al.  Abnormalities in the awareness and control of action. , 2000, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[27]  P. Sachs,et al.  SMARCAD1 ATPase activity is required to silence endogenous retroviruses in embryonic stem cells , 2019, Nature Communications.

[28]  Karl J. Friston,et al.  Active inference, sensory attenuation and illusions , 2013, Cognitive Processing.

[29]  W. Prinz A common-coding approach to perception and action , 1990 .

[30]  David W. Franklin,et al.  Computational Mechanisms of Sensorimotor Control , 2011, Neuron.

[31]  S. Glover,et al.  Separate visual representations in the planning and control of action , 2004, Behavioral and Brain Sciences.

[32]  R. Sperry [Neurology and the mind-brain problem]. , 2008, Vertex.

[33]  Gian Domenico Iannetti,et al.  An Action Field Theory of Peripersonal Space , 2018, Trends in Cognitive Sciences.

[34]  Massimiliano Di Luca,et al.  The Rubber Hand Illusion: Feeling of Ownership and Proprioceptive Drift Do Not Go Hand in Hand , 2011, PloS one.

[35]  G. Aschersleben,et al.  The Theory of Event Coding (TEC): a framework for perception and action planning. , 2001, The Behavioral and brain sciences.

[36]  Rajesh P. N. Rao,et al.  Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive-field effects. , 1999 .

[37]  Tomohisa Asai,et al.  Illusory body-ownership entails automatic compensative movement: for the unified representation between body and action , 2015, Experimental Brain Research.

[38]  M. Botvinick,et al.  Planning as inference , 2012, Trends in Cognitive Sciences.

[39]  Mar Gonzalez-Franco,et al.  The Self-Avatar Follower Effect in Virtual Reality , 2020, 2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VR).

[40]  Karl J. Friston,et al.  Dynamic causal modeling of touch-evoked potentials in the rubber hand illusion , 2016, NeuroImage.

[41]  Anil K. Seth,et al.  Learning action-oriented models through active inference , 2019, bioRxiv.

[42]  J. Paillard,et al.  BODY SCHEMA AND BODY IMAGE - A DOUBLE DISSOCIATION , 1999 .

[43]  G. Calvert Crossmodal processing in the human brain: insights from functional neuroimaging studies. , 2001, Cerebral cortex.

[44]  A. Noë,et al.  A sensorimotor account of vision and visual consciousness. , 2001, The Behavioral and brain sciences.

[45]  Karl J. Friston The free-energy principle: a unified brain theory? , 2010, Nature Reviews Neuroscience.

[46]  J. Maunsell,et al.  Touching a Rubber Hand: Feeling of Body Ownership Is Associated with Activity in Multisensory Brain Areas , 2005, The Journal of Neuroscience.

[47]  Charles Spence,et al.  Reaching with alien limbs: Visual exposure to prosthetic hands in a mirror biases proprioception without accompanying illusions of ownership , 2006, Perception & psychophysics.

[48]  C. Gross,et al.  Coding of visual space by premotor neurons. , 1994, Science.

[49]  Rajesh P. N. Rao,et al.  Bayesian brain : probabilistic approaches to neural coding , 2006 .

[50]  H. Helmholtz Handbuch der physiologischen Optik , 2015 .

[51]  H. Ehrsson,et al.  Body ownership determines the attenuation of self-generated tactile sensations , 2017, Proceedings of the National Academy of Sciences.

[52]  H. Ehrsson The Experimental Induction of Out-of-Body Experiences , 2007, Science.

[53]  Michael I. Jordan,et al.  Optimal feedback control as a theory of motor coordination , 2002, Nature Neuroscience.

[54]  Karl J. Friston,et al.  Action and behavior: a free-energy formulation , 2010, Biological Cybernetics.

[55]  Alessandro Farnè,et al.  Peripersonal Space and Body Schema: Two Labels for the Same Concept? , 2009, Brain Topography.

[56]  M. Goodale,et al.  The visual brain in action , 1995 .

[57]  Gordon Cheng,et al.  Active inference body perception and action for humanoid robots , 2019, ArXiv.

[58]  N. Bolognini,et al.  Action Shapes the Sense of Body Ownership Across Human Development , 2018, Front. Psychol..

[59]  T. Metzinger,et al.  Video Ergo Sum: Manipulating Bodily Self-Consciousness , 2007, Science.

[60]  A. Seth Interoceptive inference, emotion, and the embodied self , 2013, Trends in Cognitive Sciences.

[61]  M. Tsakiris My body in the brain: A neurocognitive model of body-ownership , 2010, Neuropsychologia.

[62]  Greg Wayne,et al.  Hierarchical motor control in mammals and machines , 2019, Nature Communications.

[63]  Y. Ohki,et al.  Spontaneous imitative movements induced by an illusory embodied fake hand , 2018, Neuropsychologia.

[64]  Karl J. Friston,et al.  Active inference under visuo-proprioceptive conflict: Simulation and empirical results , 2020, Scientific Reports.

[65]  C. Frith The self in action: Lessons from delusions of control , 2005, Consciousness and Cognition.

[66]  Simon McGregor,et al.  The free energy principle for action and perception: A mathematical review , 2017, 1705.09156.

[67]  F. Pavani,et al.  Are perception and action affected differently by the Titchener circles illusion? , 1999, Experimental Brain Research.

[68]  Gordon Cheng,et al.  Adaptive Robot Body Learning and Estimation Through Predictive Coding , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[69]  Maria V. Sanchez-Vives,et al.  Towards a Digital Body: The Virtual Arm Illusion , 2008, Frontiers in human neuroscience.

[70]  Albert Jin Chung,et al.  Perception of Body Ownership Is Driven by Bayesian Sensory Inference , 2015, PloS one.

[71]  Gordon Cheng,et al.  Drifting perceptual patterns suggest prediction errors fusion rather than hypothesis selection: replicating the rubber-hand illusion on a robot , 2018, 2018 Joint IEEE 8th International Conference on Development and Learning and Epigenetic Robotics (ICDL-EpiRob).

[72]  P. Haggard,et al.  The rubber hand illusion revisited: visuotactile integration and self-attribution. , 2005, Journal of experimental psychology. Human perception and performance.

[73]  M. Goodale,et al.  Size-contrast illusions deceive the eye but not the hand , 1995, Current Biology.

[74]  R. Passingham,et al.  That's My Hand! Activity in Premotor Cortex Reflects Feeling of Ownership of a Limb , 2004, Science.