Action understanding and active inference

We have suggested that the mirror-neuron system might be usefully understood as implementing Bayes-optimal perception of actions emitted by oneself or others. To substantiate this claim, we present neuronal simulations that show the same representations can prescribe motor behavior and encode motor intentions during action–observation. These simulations are based on the free-energy formulation of active inference, which is formally related to predictive coding. In this scheme, (generalised) states of the world are represented as trajectories. When these states include motor trajectories they implicitly entail intentions (future motor states). Optimizing the representation of these intentions enables predictive coding in a prospective sense. Crucially, the same generative models used to make predictions can be deployed to predict the actions of self or others by simply changing the bias or precision (i.e. attention) afforded to proprioceptive signals. We illustrate these points using simulations of handwriting to illustrate neuronally plausible generation and recognition of itinerant (wandering) motor trajectories. We then use the same simulations to produce synthetic electrophysiological responses to violations of intentional expectations. Our results affirm that a Bayes-optimal approach provides a principled framework, which accommodates current thinking about the mirror-neuron system. Furthermore, it endorses the general formulation of action as active inference.

[1]  Shigeru Sato,et al.  Effect of motion smoothness on brain activity while observing a dance: An fMRI study using a humanoid robot , 2010, Social neuroscience.

[2]  Karl J. Friston The free-energy principle: a rough guide to the brain? , 2009, Trends in Cognitive Sciences.

[3]  S. Blakemore,et al.  Motor activation prior to observation of a predicted movement , 2004, Nature Neuroscience.

[4]  E. Procyk,et al.  Brain activity during observation of actions. Influence of action content and subject's strategy. , 1997, Brain : a journal of neurology.

[5]  Kamran Diba,et al.  Temporal delays among place cells determine the frequency of population theta oscillations in the hippocampus , 2010, Proceedings of the National Academy of Sciences.

[6]  G. Rizzolatti,et al.  Neurophysiological mechanisms underlying the understanding and imitation of action , 2001, Nature Reviews Neuroscience.

[7]  M. Arbib From grasp to language: Embodied concepts and the challenge of abstraction , 2008, Journal of Physiology-Paris.

[8]  Louise S. Delicato,et al.  Acetylcholine contributes through muscarinic receptors to attentional modulation in V1 , 2008, Nature.

[9]  Paul F. M. J. Verschure,et al.  Environmentally mediated synergy between perception and behaviour in mobile robots , 2003, Nature.

[10]  Carlos M. Gómez,et al.  P3a and P3b components associated to the neurocognitive evaluation of invalidly cued targets , 2008, Neuroscience Letters.

[11]  I. Winkler,et al.  ‘Primitive intelligence’ in the auditory cortex , 2001, Trends in Neurosciences.

[12]  G. Buzsáki,et al.  Temporal Encoding of Place Sequences by Hippocampal Cell Assemblies , 2006, Neuron.

[13]  B. Bertenthal,et al.  Does Perception of Biological Motion Rely on Specific Brain Regions? , 2001, NeuroImage.

[14]  Gilles Laurent,et al.  Transient Dynamics for Neural Processing , 2008, Science.

[15]  J. O’Keefe Do hippocampal pyramidal cells signal non‐spatial as well as spatial information? , 1999, Hippocampus.

[16]  M Tsodyks,et al.  Attractor neural network models of spatial maps in hippocampus , 1999, Hippocampus.

[17]  Stefan Schaal,et al.  Dynamics systems vs. optimal control--a unifying view. , 2007, Progress in brain research.

[18]  S. Small,et al.  IMITATE: An intensive computer-based treatment for aphasia based on action observation and imitation , 2010, Aphasiology.

[19]  B. McNaughton,et al.  Local Sensory Cues and Place Cell Directionality: Additional Evidence of Prospective Coding in the Hippocampus , 2004, The Journal of Neuroscience.

[20]  Florentin Wörgötter,et al.  Isotropic Sequence Order Learning , 2003, Neural Computation.

[21]  R. Gregory Perceptions as hypotheses. , 1980, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[22]  Jun Tani,et al.  Learning to imitate stochastic time series in a compositional way by chaos , 2008, Neural Networks.

[23]  G. Rizzolatti,et al.  Understanding motor events: a neurophysiological study , 2004, Experimental Brain Research.

[24]  Karl J. Friston,et al.  The mirror-neuron system: a Bayesian perspective. , 2007, Neuroreport.

[25]  G. Geffen,et al.  Catecholamines and the covert orientation of attention in humans , 1989, Neuropsychologia.

[26]  Karl J. Friston,et al.  Predictive coding: an account of the mirror neuron system , 2007, Cognitive Processing.

[27]  Thomas E. Hazy,et al.  Towards an executive without a homunculus: computational models of the prefrontal cortex/basal ganglia system , 2007, Philosophical Transactions of the Royal Society B: Biological Sciences.

[28]  J. Coull Neural correlates of attention and arousal: insights from electrophysiology, functional neuroimaging and psychopharmacology , 1998, Progress in Neurobiology.

[29]  S. Hillyard,et al.  Modulations of sensory-evoked brain potentials indicate changes in perceptual processing during visual-spatial priming. , 1991, Journal of experimental psychology. Human perception and performance.

[30]  E. Donchin,et al.  Is the P300 component a manifestation of context updating? , 1988, Behavioral and Brain Sciences.

[31]  A. G. Feldman New insights into action–perception coupling , 2009, Experimental Brain Research.

[32]  Stefan Wermter,et al.  A hybrid generative and predictive model of the motor cortex , 2006, Neural Networks.

[33]  G. Rizzolatti,et al.  The mirror-neuron system. , 2004, Annual review of neuroscience.

[34]  K. Doya,et al.  A unifying computational framework for motor control and social interaction. , 2003, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[35]  Marieke Longcamp,et al.  The imprint of action: Motor cortex involvement in visual perception of handwritten letters , 2006, NeuroImage.

[36]  A. Goldman,et al.  Mirror neurons and the simulation theory of mind-reading , 1998, Trends in Cognitive Sciences.

[37]  T. Sejnowski,et al.  Book Review: Gain Modulation in the Central Nervous System: Where Behavior, Neurophysiology, and Computation Meet , 2001, The Neuroscientist : a review journal bringing neurobiology, neurology and psychiatry.

[38]  John J. Foxe,et al.  Determinants and mechanisms of attentional modulation of neural processing. , 2001, Frontiers in Bioscience.

[39]  ML Voytko,et al.  Basal forebrain lesions in monkeys disrupt attention but not learning and memory [published erratum appears in J Neurosci 1995 Mar;15(3): following table of contents] , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[40]  R. Gregory,et al.  Perceptual illusions and brain models , 1968, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[41]  R. Blake,et al.  Brain Areas Involved in Perception of Biological Motion , 2000, Journal of Cognitive Neuroscience.

[42]  Michael I. Jordan,et al.  An internal model for sensorimotor integration. , 1995, Science.

[43]  M. Graziano Where is my arm? The relative role of vision and proprioception in the neuronal representation of limb position. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[44]  Livia Colle,et al.  The neural basis for understanding non-intended actions , 2007, NeuroImage.

[45]  D. Mumford On the computational architecture of the neocortex , 2004, Biological Cybernetics.

[46]  Geoffrey E. Hinton,et al.  The Helmholtz Machine , 1995, Neural Computation.

[47]  R. Huerta,et al.  Winnerless competition principle and prediction of the transient dynamics in a Lotka-Volterra model. , 2008, Chaos.

[48]  R. Miall,et al.  Connecting mirror neurons and forward models. , 2003, Neuroreport.

[49]  M. Del Giudice,et al.  Programmed to learn? The ontogeny of mirror neurons. , 2009, Developmental science.

[50]  Karl J. Friston,et al.  Frontiers in Neuroinformatics , 2022 .

[51]  R. Desimone,et al.  Neural mechanisms of selective visual attention. , 1995, Annual review of neuroscience.

[52]  M. Graziano The organization of behavioral repertoire in motor cortex. , 2006, Annual review of neuroscience.

[53]  Jun Nakanishi,et al.  Movement imitation with nonlinear dynamical systems in humanoid robots , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[54]  R. Johansson,et al.  Prediction Precedes Control in Motor Learning , 2003, Current Biology.

[55]  D. Friedman,et al.  The novelty P3: an event-related brain potential (ERP) sign of the brain's evaluation of novelty , 2001, Neuroscience & Biobehavioral Reviews.

[56]  Yoram Singer,et al.  Dynamical encoding of cursive handwriting , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[57]  Dimitrios Pantazis,et al.  Coherent neural representation of hand speed in humans revealed by MEG imaging , 2007, Proceedings of the National Academy of Sciences.

[58]  M. Davidson,et al.  Local infusion of scopolamine into intraparietal cortex slows covert orienting in rhesus monkeys. , 2000, Journal of neurophysiology.

[59]  Yoshiro Okubo,et al.  Enhanced activation in the extrastriate body area by goal‐directed actions , 2008, Psychiatry and clinical neurosciences.

[60]  G. Rizzolatti,et al.  Parietal Lobe: From Action Organization to Intention Understanding , 2005, Science.

[61]  Christian Keysers,et al.  Somatosensation in social perception , 2010, Nature Reviews Neuroscience.

[62]  Jun Tani,et al.  Learning to generate articulated behavior through the bottom-up and the top-down interaction processes , 2003, Neural Networks.

[63]  Geoffrey E. Hinton,et al.  Parallel visual computation , 1983, Nature.

[64]  Karl J. Friston,et al.  Attention, Uncertainty, and Free-Energy , 2010, Front. Hum. Neurosci..

[65]  Scott T. Grafton,et al.  Goal Representation in Human Anterior Intraparietal Sulcus , 2006, The Journal of Neuroscience.

[66]  A. Borst Seeing smells: imaging olfactory learning in bees , 1999, Nature Neuroscience.

[67]  D. Perrett,et al.  Responses of Anterior Superior Temporal Polysensory (STPa) Neurons to Biological Motion Stimuli , 1994, Journal of Cognitive Neuroscience.

[68]  M. Butz,et al.  Oscillatory coupling in writing and writer’s cramp , 2006, Journal of Physiology-Paris.

[69]  Michael A. Arbib,et al.  Mirror system activity for action and language is embedded in the integration of dorsal and ventral pathways , 2010, Brain and Language.

[70]  Emanuel Todorov,et al.  From task parameters to motor synergies: A hierarchical framework for approximately optimal control of redundant manipulators , 2005, J. Field Robotics.

[71]  Karl J. Friston,et al.  Recognizing Sequences of Sequences , 2009, PLoS Comput. Biol..

[72]  R. Desimone,et al.  The Effects of Visual Stimulation and Selective Visual Attention on Rhythmic Neuronal Synchronization in Macaque Area V4 , 2008, The Journal of Neuroscience.

[73]  Karl J. Friston,et al.  Action and behavior: a free-energy formulation , 2010, Biological Cybernetics.

[74]  T. Robbins,et al.  Distinct Changes in Cortical Acetylcholine and Noradrenaline Efflux during Contingent and Noncontingent Performance of a Visual Attentional Task , 2001, The Journal of Neuroscience.

[75]  D. Heeger,et al.  The Normalization Model of Attention , 2009, Neuron.

[76]  G. Rizzolatti,et al.  I Know What You Are Doing A Neurophysiological Study , 2001, Neuron.

[77]  M. Arbib,et al.  Grasping objects: the cortical mechanisms of visuomotor transformation , 1995, Trends in Neurosciences.

[78]  S. Hillyard,et al.  Modulations of sensory-evoked brain potentials indicate changes in perceptual processing during visual-spatial priming. , 1991, Journal of experimental psychology. Human perception and performance.

[79]  Karl J. Friston Hierarchical Models in the Brain , 2008, PLoS Comput. Biol..

[80]  D. Perrett,et al.  Opinion TRENDS in Cognitive Sciences Vol.8 No.11 November 2004 Demystifying social cognition: a Hebbian perspective , 2022 .

[81]  A. Murata,et al.  Largely segregated parietofrontal connections linking rostral intraparietal cortex (areas AIP and VIP) and the ventral premotor cortex (areas F5 and F4) , 1999, Experimental Brain Research.

[82]  Florentin Wörgötter,et al.  Temporal Sequence Learning, Prediction, and Control: A Review of Different Models and Their Relation to Biological Mechanisms , 2005, Neural Computation.

[83]  D Mumford,et al.  On the computational architecture of the neocortex. II. The role of cortico-cortical loops. , 1992, Biological cybernetics.

[84]  C. Frith,et al.  Interacting minds--a biological basis. , 1999, Science.

[85]  Michael J. Frank,et al.  Understanding decision-making deficits in neurological conditions: insights from models of natural action selection , 2007, Philosophical Transactions of the Royal Society B: Biological Sciences.

[86]  Karl J. Friston,et al.  Reinforcement Learning or Active Inference? , 2009, PloS one.

[87]  Karl J. Friston,et al.  A free energy principle for the brain , 2006, Journal of Physiology-Paris.

[88]  Lisa M. Giocomo,et al.  Cholinergic modulation of cortical function , 2007, Journal of Molecular Neuroscience.

[89]  Kevin N. Gurney,et al.  The Basal Ganglia and Cortex Implement Optimal Decision Making Between Alternative Actions , 2007, Neural Computation.

[90]  T. Allison,et al.  Social perception from visual cues: role of the STS region , 2000, Trends in Cognitive Sciences.

[91]  G. Rizzolatti,et al.  Action recognition in the premotor cortex. , 1996, Brain : a journal of neurology.

[92]  Jun Tani,et al.  Self-organization of distributedly represented multiple behavior schemata in a mirror system: reviews of robot experiments using RNNPB , 2004, Neural Networks.

[93]  Scott T. Grafton,et al.  Evidence for a distributed hierarchy of action representation in the brain. , 2007, Human movement science.

[94]  J. O’Keefe,et al.  An oscillatory interference model of grid cell firing , 2007, Hippocampus.