Predictive joint-action model: A hierarchical predictive approach to human cooperation

Research in a number of related fields has recently begun to focus on the perceptual, cognitive, and motor workings of cooperative behavior. There appears to be enough coherence in these efforts to refer to the study of the mechanisms underlying human cooperative behavior as the field of joint-action (Knoblich, Butterfill, & Sebanz, 2011; Sebanz, Bekkering, & Knoblich, 2006). Yet, the development of theory in this field has not kept pace with the proliferation of research findings. We propose a hierarchical predictive framework for the study of joint-action that we call the predictive joint-action model (PJAM). The presentation of this theoretical framework is organized into three sections. In the first section, we summarize hierarchical predictive principles and discuss their application to joint-action. In the second section, we juxtapose PJAM’s assumptions with empirical evidence from the current literature on joint-action. In the third section, we discuss the overall success of the hierarchical predictive approach to account for the burgeoning empirical literature on joint-action research. Finally, we consider the model’s capacity to generate novel and testable hypotheses about joint-action. This is done with the larger goal of uncovering the empirical and theoretical pieces that are still missing in a comprehensive understanding of joint action.

[1]  J. R. Simon,et al.  Reactions toward the source of stimulation. , 1969, Journal of experimental psychology.

[2]  J R Simon,et al.  Effects of an irrelevant auditory stimulus on visual choice reaction time. , 1970, Journal of experimental psychology.

[3]  Robert A. Baron,et al.  Interviewer's Moods and Reactions to Job Applicants: The Influence of Affective States on Applied Social Judgments1 , 1987 .

[4]  A. Osman,et al.  Dimensional overlap: cognitive basis for stimulus-response compatibility--a model and taxonomy. , 1990, Psychological review.

[5]  Herbert H. Clark,et al.  Grounding in communication , 1991, Perspectives on socially shared cognition.

[6]  Michael E. Bratman,et al.  Shared Cooperative Activity , 1991 .

[7]  Michael I. Jordan,et al.  An internal model for sensorimotor integration. , 1995, Science.

[8]  Daniel M. Wolpert,et al.  Forward Models for Physiological Motor Control , 1996, Neural Networks.

[9]  D. Wolpert Computational approaches to motor control , 1997, Trends in Cognitive Sciences.

[10]  D M Wolpert,et al.  Predicting the Consequences of Our Own Actions: The Role of Sensorimotor Context Estimation , 1998, The Journal of Neuroscience.

[11]  A. Kingstone,et al.  The eyes have it! Reflexive orienting is triggered by nonpredictive gaze , 1998 .

[12]  Joseph P. Forgas,et al.  On feeling good and getting your way: mood effects on negotiator cognition and bargaining strategies. , 1998, Journal of personality and social psychology.

[13]  Riitta Salmelin,et al.  Subject's own speech reduces reactivity of the human auditory cortex , 1999, Neuroscience Letters.

[14]  D. Wolpert,et al.  Spatio-Temporal Prediction Modulates the Perception of Self-Produced Stimuli , 1999, Journal of Cognitive Neuroscience.

[15]  V. Bruce,et al.  You must see the point: automatic processing of cues to the direction of social attention. , 2000, Journal of experimental psychology. Human perception and performance.

[16]  D. Wolpert,et al.  Explaining the symptoms of schizophrenia: Abnormalities in the awareness of action , 2000, Brain Research Reviews.

[17]  D. Wolpert,et al.  Why can't you tickle yourself? , 2000, Neuroreport.

[18]  A. Williams,et al.  Please Scroll down for Article Journal of Sports Sciences Visual Search, Anticipation and Expertise in Soccer Goalkeepers Visual Search, Anticipation and Expertise in Soccer Goalkeepers , 2022 .

[19]  G. Rizzolatti,et al.  Motor and cognitive functions of the ventral premotor cortex , 2002, Current Opinion in Neurobiology.

[20]  K. Doya,et al.  A unifying computational framework for motor control and social interaction. , 2003, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[21]  Karl J. Friston Learning and inference in the brain , 2003, Neural Networks.

[22]  R. Johansson,et al.  Action plans used in action observation , 2003, Nature.

[23]  Daniel M. Wolpert,et al.  Hierarchical MOSAIC for movement generation , 2003 .

[24]  C. Frith,et al.  Self-awareness and action , 2003, Current Opinion in Neurobiology.

[25]  W. Prinz,et al.  Representing others' actions: just like one's own? , 2003, Cognition.

[26]  G. Knoblich,et al.  Action coordination in groups and individuals: learning anticipatory control. , 2003, Journal of experimental psychology. Learning, memory, and cognition.

[27]  R. Johansson,et al.  Prediction Precedes Control in Motor Learning , 2003, Current Biology.

[28]  E. Todorov Optimality principles in sensorimotor control , 2004, Nature Neuroscience.

[29]  B. Sparrow,et al.  Vicarious agency: experiencing control over the movements of others. , 2004, Journal of personality and social psychology.

[30]  H. Bekkering,et al.  Modulation of activity in medial frontal and motor cortices during error observation , 2004, Nature Neuroscience.

[31]  R. Miall,et al.  A system in the human brain for predicting the actions of others , 2004, Nature Neuroscience.

[32]  G. Knoblich,et al.  The case for motor involvement in perceiving conspecifics. , 2005, Psychological bulletin.

[33]  W. Prinz,et al.  How two share a task: corepresenting stimulus-response mappings. , 2005, Journal of experimental psychology. Human perception and performance.

[34]  Peter Neri,et al.  Meaningful interactions can enhance visual discrimination of human agents , 2006, Nature Neuroscience.

[35]  Wolfgang Prinz,et al.  Twin Peaks: An ERP Study of Action Planning and Control in Coacting Individuals , 2006, Journal of Cognitive Neuroscience.

[36]  Wen-Jui Kuo,et al.  A common coding framework in self–other interaction: evidence from joint action task , 2006, Experimental Brain Research.

[37]  H. Bekkering,et al.  Joint action: bodies and minds moving together , 2006, Trends in Cognitive Sciences.

[38]  Günther Knoblich,et al.  The Social Nature of Perception and Action , 2006 .

[39]  Wolfgang Prinz,et al.  Predicting point-light actions in real-time , 2007, NeuroImage.

[40]  M. Kawato,et al.  Bodily bonds: effects of social context on ideomotor movements , 2007 .

[41]  B. Repp,et al.  Pianists duet better when they play with themselves: On the possible role of action simulation in synchronization , 2007, Consciousness and Cognition.

[42]  Karl J. Friston Hierarchical Models in the Brain , 2008, PLoS Comput. Biol..

[43]  W. Prinz,et al.  Ideomotor action in cooperative and competitive settings , 2008, Social neuroscience.

[44]  Harold Bekkering,et al.  Fast responders have blinders on: ERP correlates of response inhibition in competition , 2008, Cortex.

[45]  Wolfgang Prinz,et al.  Please Scroll down for Article Social Neuroscience Action Co-representation: the Joint Snarc Effect Action Co-representation: the Joint Snarc Effect , 2022 .

[46]  Atsushi Sato Action observation modulates auditory perception of the consequence of others’ actions , 2008, Consciousness and Cognition.

[47]  M. Tomasello Why We Cooperate , 2009 .

[48]  Rebecca J. Compton,et al.  Perceived similarity and neural mirroring: Evidence from vicarious error processing , 2009, Social neuroscience.

[49]  C. Palmer,et al.  Synchronization of Timing and Motion 435 , 2022 .

[50]  M. Shiffrar,et al.  Detecting deception in a bluffing body: The role of expertise , 2009, Psychonomic bulletin & review.

[51]  Natalie Sebanz,et al.  Prediction in Joint Action: What, When, and Where , 2009, Top. Cogn. Sci..

[52]  Leonie Koban,et al.  When your errors make me lose or win: Event-related potentials to observed errors of cooperators and competitors , 2010, Social neuroscience.

[53]  Günther Knoblich,et al.  Favouritism in the motor system: social interaction modulates action simulation , 2010, Biology Letters.

[54]  Markus A. Maier,et al.  The role of positive and negative affect in the “mirroring” of other persons' actions , 2010 .

[55]  Alison L. Chasteen,et al.  Your mistakes are mine: Self-other overlap predicts neural response to observed errors , 2010 .

[56]  U. Castiello,et al.  Toward You , 2010 .

[57]  Michael Tomasello with Carol Dweck, Joan Silk, Brian Skryms, and Elizabeth Spelke (2009). Why We Cooperate. Cambridge, MA: MIT Press. 208 pages , 2010 .

[58]  Cordula Vesper,et al.  A minimal architecture for joint action , 2010, Neural Networks.

[59]  Sukhvinder S. Obhi,et al.  Moving together: toward understanding the mechanisms of joint action , 2011, Experimental Brain Research.

[60]  Wolfgang Prinz,et al.  Covert motor activity on NoGo trials in a task sharing paradigm: evidence from the lateralized readiness potential , 2011, Experimental Brain Research.

[61]  Sina Radke,et al.  Mistakes that affect others: An fMRI study on processing of own errors in a social context , 2011, Experimental Brain Research.

[62]  U. Castiello,et al.  Cues to intention: The role of movement information , 2011, Cognition.

[63]  Elisabeth Pacherie,et al.  Framing Joint Action , 2011 .

[64]  Wolfgang Prinz,et al.  What is Shared in Joint Action? Issues of Co-representation, Response Conflict, and Agent Identification , 2011 .

[65]  P. Keller,et al.  The role of temporal prediction abilities in interpersonal sensorimotor synchronization , 2010, Experimental Brain Research.

[66]  Wolfgang Prinz,et al.  How two share two tasks: evidence of a social psychological refractory period effect , 2011, Experimental Brain Research.

[67]  Günther Knoblich,et al.  The joint flanker effect: sharing tasks with real and imagined co-actors , 2011, Experimental Brain Research.

[68]  R. Nicoletti,et al.  The role of group membership on the modulation of joint action , 2011, Experimental Brain Research.

[69]  Cordula Vesper,et al.  Making oneself predictable: reduced temporal variability facilitates joint action coordination , 2011, Experimental Brain Research.

[70]  N. Sebanz,et al.  Psychological research on joint action: Theory and data , 2011 .

[71]  Karl J. Friston,et al.  Action understanding and active inference , 2011, Biological Cybernetics.

[72]  Sukhvinder S. Obhi,et al.  Sense of agency and intentional binding in joint action , 2011, Experimental Brain Research.

[73]  Giacomo Novembre,et al.  Distinguishing self and other in joint action. Evidence from a musical paradigm. , 2012, Cerebral cortex.

[74]  Thierry Chaminade,et al.  An fMRI study of joint action–varying levels of cooperation correlates with activity in control networks , 2012, Front. Hum. Neurosci..

[75]  Anne Springer,et al.  Before, during and after you disappear: aspects of timing and dynamic updating of the real-time action simulation of human motions , 2011, Psychological research.

[76]  Natalie Sebanz,et al.  The sense of agency during skill learning in individuals and dyads , 2012, Consciousness and Cognition.

[77]  On capturing the essence of self-generated action: A reply to Obhi (2012) , 2012, Consciousness and Cognition.

[78]  Sukhvinder Obhi,et al.  Automatic imitation is automatic, but less so for narcissists , 2013, Experimental Brain Research.

[79]  B. Hommel,et al.  Up to “Me” or Up to “Us”? The Impact of Self-Construal Priming on Cognitive Self-Other Integration , 2012, Front. Psychology.

[80]  M. Shiffrar,et al.  Expecting to lift a box together makes the load look lighter , 2011, Psychological research.

[81]  The troublesome distinction between self-generated and externally triggered action: A commentary on Schüür and Haggard , 2012, Consciousness and Cognition.

[82]  Bernhard Hommel,et al.  Loving-kindness brings loving-kindness: The impact of Buddhism on cognitive self–other integration , 2012, Psychonomic bulletin & review.

[83]  Elisabeth Pacherie,et al.  The Phenomenology of Joint Action: Self-Agency vs. Joint-Agency , 2012 .

[84]  Emily S. Cross,et al.  Simulating and predicting others’ actions , 2012, Psychological research.

[85]  Anne Springer,et al.  Predicting others’ actions: evidence for a constant time delay in action simulation , 2012, Psychological research.

[86]  K. Verfaillie,et al.  Time Will Show: Real Time Predictions during Interpersonal Action Perception , 2013, PloS one.

[87]  Karl J. Friston,et al.  Active inference, sensory attenuation and illusions , 2013, Cognitive Processing.

[88]  A. Clark Whatever next? Predictive brains, situated agents, and the future of cognitive science. , 2013, The Behavioral and brain sciences.

[89]  Verónica C. Ramenzoni,et al.  Scaling-up Perception-Action Links: Evidence from Synchronization with Individual and Joint Action , 2013, CogSci.

[90]  Janeen D. Loehr,et al.  Monitoring Individual and Joint Action Outcomes in Duet Music Performance , 2013, Journal of Cognitive Neuroscience.

[91]  Cordula Vesper,et al.  Are you ready to jump? Predictive mechanisms in interpersonal coordination. , 2013, Journal of experimental psychology. Human perception and performance.

[92]  Wolfgang Prinz,et al.  The (not so) social Simon effect: a referential coding account. , 2013, Journal of experimental psychology. Human perception and performance.

[93]  Gary Stix,et al.  The "it" factor. , 2014, Scientific American.

[94]  A. Clark,et al.  Getting ahead: forward models and their place in cognitive architecture , 2014, Trends in Cognitive Sciences.

[95]  Michael Inzlicht,et al.  Power changes how the brain responds to others. , 2014, Journal of experimental psychology. General.

[96]  G. Gredebäck,et al.  Eye Movements During Action Observation , 2015, Perspectives on psychological science : a journal of the Association for Psychological Science.

[97]  Karl J. Friston,et al.  Active inference, communication and hermeneutics , 2015, Cortex.

[98]  Karl J. Friston,et al.  A Duet for one , 2015, Consciousness and Cognition.

[99]  Peter E. Keller,et al.  Musical ensemble performance : representing self, other, and joint action outcomes , 2016 .

[100]  Janeen D. Loehr,et al.  The sound of you and me: Novices represent shared goals in joint action , 2016, Quarterly journal of experimental psychology.