A Predictive Processing Model of Perception and Action for Self-Other Distinction

During interaction with others, we perceive and produce social actions in close temporal distance or even simultaneously. It has been argued that the motor system is involved in perception and action, playing a fundamental role in the handling of actions produced by oneself and by others. But how does it distinguish in this processing between self and other, thus contributing to self-other distinction? In this paper we propose a hierarchical model of sensorimotor coordination based on principles of perception-action coupling and predictive processing in which self-other distinction arises during action and perception. For this we draw on mechanisms assumed for the integration of cues for a sense of agency, i.e., the sense that an action is self-generated. We report results from simulations of different scenarios, showing that the model is not only able to minimize free energy during perception and action, but also showing that the model can correctly attribute sense of agency to own actions.

[1]  Patrick Haggard,et al.  Sense of control depends on fluency of action selection, not motor performance , 2012, Cognition.

[2]  Karl J. Friston,et al.  The graphical brain: Belief propagation and active inference , 2017, Network Neuroscience.

[3]  P. Haggard,et al.  Intentional action: Conscious experience and neural prediction , 2003, Consciousness and Cognition.

[4]  W. Prinz Perception and Action Planning , 1997 .

[5]  Karl J. Friston What Is Optimal about Motor Control? , 2011, Neuron.

[6]  Malin Björnsdotter,et al.  Patterns of neural activity in the human ventral premotor cortex reflect a whole-body multisensory percept , 2015, NeuroImage.

[7]  A. Borst Seeing smells: imaging olfactory learning in bees , 1999, Nature Neuroscience.

[8]  Scott T. Grafton,et al.  Evidence for a distributed hierarchy of action representation in the brain. , 2007, Human movement science.

[9]  F. Overwalle Social cognition and the brain: a meta-analysis. , 2009 .

[10]  D. Wegner,et al.  Modulating the sense of agency with external cues , 2009, Consciousness and Cognition.

[11]  M. Wallace,et al.  Developmental changes in the multisensory temporal binding window persist into adolescence. , 2012, Developmental science.

[12]  M S Graziano,et al.  Coding the location of the arm by sight. , 2000, Science.

[13]  F. Van Overwalle Social cognition and the brain: A meta‐analysis , 2009, Human brain mapping.

[14]  M. Hallett,et al.  The neural processes underlying self-agency. , 2011, Cerebral cortex.

[15]  Karl J. Friston,et al.  The Computational Anatomy of Psychosis , 2013, Front. Psychiatry.

[16]  D. Wegner,et al.  Apparent mental causation. Sources of the experience of will. , 1999, The American psychologist.

[17]  Karl J. Friston,et al.  Deep temporal models and active inference , 2017, Neuroscience & Biobehavioral Reviews.

[18]  P. Haggard,et al.  Voluntary action and conscious awareness , 2002, Nature Neuroscience.

[19]  J. Nadel,et al.  Does the brain know who is at the origin of what in an imitative interaction? , 2012, Front. Hum. Neurosci..

[20]  P. Haggard,et al.  From action intentions to action effects: how does the sense of agency come about? , 2014, Front. Hum. Neurosci..

[21]  Manos Tsakiris,et al.  The Experience of Agency , 2009 .

[22]  Leonardo Fogassi,et al.  Motor functions of the parietal lobe , 2005, Current Opinion in Neurobiology.

[23]  D. Wegner,et al.  Apparent mental causation , 1999 .

[24]  P. W. Lamberti,et al.  Detecting dynamical changes in time series by using the Jensen Shannon divergence. , 2017, Chaos.

[25]  A. Kiesel,et al.  Was it me when it happened too early? Experience of delayed effects shapes sense of agency , 2015, Cognition.

[26]  Jean-Louis Vercher,et al.  The contribution of proprioceptive feedback to sensorimotor adaptation , 2006, Experimental Brain Research.

[27]  G. Rizzolatti,et al.  Action recognition in the premotor cortex. , 1996, Brain : a journal of neurology.

[28]  Paul B. Johnson,et al.  Premotor and parietal cortex: corticocortical connectivity and combinatorial computations. , 1997, Annual review of neuroscience.

[29]  M. Voss,et al.  The experience of agency: an interplay between prediction and postdiction , 2013, Front. Psychol..

[30]  N. V. Haren,et al.  Self–other integration and distinction in schizophrenia: A theoretical analysis and a review of the evidence , 2015, Neuroscience & Biobehavioral Reviews.

[31]  Stefan Kopp,et al.  Embodied Gesture Processing: Motor-Based Integration of Perception and Action in Social Artificial Agents , 2010, Cognitive Computation.

[32]  Adnan Darwiche,et al.  Modeling and Reasoning with Bayesian Networks , 2009 .

[33]  Karl J. Friston,et al.  Canonical Microcircuits for Predictive Coding , 2012, Neuron.

[34]  James B. Rowe,et al.  The medial frontal-prefrontal network for altered awareness and control of action in corticobasal syndrome , 2013, Brain : a journal of neurology.

[35]  C. Galletti,et al.  Behavioral Investigation on the Frames of Reference Involved in Visuomotor Transformations during Peripheral Arm Reaching , 2012, PloS one.

[36]  K. Vogeley,et al.  The “sense of agency” and its underlying cognitive and neural mechanisms , 2008, Consciousness and Cognition.

[37]  Jun Nakanishi,et al.  Dynamical Movement Primitives: Learning Attractor Models for Motor Behaviors , 2013, Neural Computation.

[38]  A. Clark Whatever next? Predictive brains, situated agents, and the future of cognitive science. , 2013, The Behavioral and brain sciences.

[39]  Karl J. Friston,et al.  Action understanding and active inference , 2011, Biological Cybernetics.

[40]  P. Fletcher,et al.  Sense of agency in health and disease: A review of cue integration approaches☆ , 2012, Consciousness and Cognition.

[41]  Marieke Rohde,et al.  Time, agency, and sensory feedback delays during action , 2016, Current Opinion in Behavioral Sciences.

[42]  Jeffrey M. Zacks,et al.  Event perception: a mind-brain perspective. , 2007, Psychological bulletin.

[43]  Michael I. Jordan,et al.  Optimal feedback control as a theory of motor coordination , 2002, Nature Neuroscience.

[44]  Karl J. Friston,et al.  Action and behavior: a free-energy formulation , 2010, Biological Cybernetics.

[45]  Karl J. Friston,et al.  Active inference, sensory attenuation and illusions , 2013, Cognitive Processing.

[46]  Martin V. Butz,et al.  A Computational Model for the Dynamical Learning of Event Taxonomies , 2017, CogSci.

[47]  A. Newen,et al.  Beyond the comparator model: A multifactorial two-step account of agency , 2008, Consciousness and Cognition.

[48]  Patrick Haggard,et al.  Priming of actions increases sense of control over unexpected outcomes , 2013, Consciousness and Cognition.

[49]  Karl J. Friston,et al.  Predictive coding: an account of the mirror neuron system , 2007, Cognitive Processing.

[50]  G. S. Russo,et al.  Neurons in the supplementary eye field of rhesus monkeys code visual targets and saccadic eye movements in an oculocentric coordinate system. , 1996, Journal of neurophysiology.

[51]  Alexander Münchau,et al.  The pathophysiology of echopraxia/echolalia: Relevance to Gilles De La Tourette syndrome , 2012, Movement disorders : official journal of the Movement Disorder Society.

[52]  D. Wolpert,et al.  Abnormalities in the awareness and control of action. , 2000, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[53]  Carmen Weiss,et al.  The Self in Social Interactions: Sensory Attenuation of Auditory Action Effects Is Stronger in Interactions with Others , 2011, PloS one.

[54]  Stefan Kopp,et al.  Towards a Model of the Interplay of Mentalizing and Mirroring in Embodied Communication , 2015, EAPCogSci.

[55]  Stefan Schaal,et al.  Biologically-inspired dynamical systems for movement generation: Automatic real-time goal adaptation and obstacle avoidance , 2009, 2009 IEEE International Conference on Robotics and Automation.

[56]  P. Haggard,et al.  Self and Other in the Human Motor System , 2006, Current Biology.

[57]  A. Diederich,et al.  Multisensory Interaction in Saccadic Reaction Time: A Time-Window-of-Integration Model , 2004, Journal of Cognitive Neuroscience.

[58]  Mitsuo Kawato,et al.  Internal models for motor control and trajectory planning , 1999, Current Opinion in Neurobiology.

[59]  M. Nour Surfing Uncertainty: Prediction, Action, and the Embodied Mind. , 2017, British Journal of Psychiatry.

[60]  Stefan Treue,et al.  Feature-based attention influences motion processing gain in macaque visual cortex , 1999, Nature.

[61]  J. Smallwood,et al.  Illuminating the dark matter of social neuroscience: Considering the problem of social interaction from philosophical, psychological, and neuroscientific perspectives , 2012, Front. Hum. Neurosci..

[62]  J. F. Soechting,et al.  Oculocentric frames of reference for limb movement. , 2002, Archives italiennes de biologie.

[63]  A. G. Feldman,et al.  The origin and use of positional frames of reference in motor control , 1995, Behavioral and Brain Sciences.

[64]  D. Cunningham,et al.  Sensorimotor Adaptation to Violations of Temporal Contiguity , 2001, Psychological science.

[65]  K. Doya,et al.  A unifying computational framework for motor control and social interaction. , 2003, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[66]  Marta I. Garrido,et al.  Timing in Predictive Coding: The Roles of Task Relevance and Global Probability , 2017, Journal of Cognitive Neuroscience.