Ontogenetic Ritualization of Primate Gesture as a Case Study in Dyadic Brain Modeling

This paper introduces dyadic brain modeling – the simultaneous, computational modeling of the brains of two interacting agents – to explore ways in which our understanding of macaque brain circuitry can ground new models of brain mechanisms involved in ape interaction. Specifically, we assess a range of data on gestural communication of great apes as the basis for developing an account of the interactions of two primates engaged in ontogenetic ritualization, a proposed learning mechanism through which a functional action may become a communicative gesture over repeated interactions between two individuals (the ‘dyad’). The integration of behavioral, neural, and computational data in dyadic (or, more generally, social) brain modeling has broad application to comparative and evolutionary questions, particularly for the evolutionary origins of cognition and language in the human lineage. We relate this work to the neuroinformatics challenges of integrating and sharing data to support collaboration between primatologists, neuroscientists and modelers that will help speed the emergence of what may be called comparative neuro-primatology.

[1]  Michael A. Arbib,et al.  Schema design and implementation of the grasp-related mirror neuron system , 2002, Biological Cybernetics.

[2]  R. Andersen,et al.  A neural representation of sequential states within an instructed task. , 2010, Journal of neurophysiology.

[3]  K. Laland,et al.  Identification of the Social and Cognitive Processes Underlying Human Cumulative Culture , 2012, Science.

[4]  M. Platt,et al.  Neural Correlates of Social Target Value in Macaque Parietal Cortex , 2008, Current Biology.

[5]  S. Suomi,et al.  Reciprocal Face-to-Face Communication between Rhesus Macaque Mothers and Their Newborn Infants , 2009, Current Biology.

[6]  N. Reissland From Hand to Mouth: The Origins of Language , 2006 .

[7]  G. Rizzolatti,et al.  Understanding motor events: a neurophysiological study , 2004, Experimental Brain Research.

[8]  M. E. Laidre,et al.  The Gestural Communication of Apes and Monkeys, Josep Call, Michael Tomasello (Eds.). Erlbaum, Mahwah, New Jersey (2007), Pp. viii + 256. Price $34.95. , 2009 .

[9]  R. Byrne,et al.  Gestural communication of the gorilla (Gorilla gorilla): repertoire, intentionality and possible origins , 2009, Animal Cognition.

[10]  J. Kalaska,et al.  Neural mechanisms for interacting with a world full of action choices. , 2010, Annual review of neuroscience.

[11]  Michael Tomasello,et al.  Gestural communication of orangutans (Pongo pygmaeus) , 2006 .

[12]  R. Byrne Culture in great apes: using intricate complexity in feeding skills to trace the evolutionary origin of human technical prowess , 2007, Philosophical Transactions of the Royal Society B: Biological Sciences.

[13]  Ashwin G Ramayya,et al.  A DTI investigation of neural substrates supporting tool use. , 2010, Cerebral cortex.

[14]  M. Arbib From monkey-like action recognition to human language: An evolutionary framework for neurolinguistics , 2005, Behavioral and Brain Sciences.

[15]  Michael A. Arbib,et al.  Synthetic event-related potentials: A computational bridge between neurolinguistic models and experiments , 2013, Neural Networks.

[16]  Toshisada Nishida,et al.  The leaf-clipping display: A newly-discovered expressive gesture in wild chimpanzees , 1980 .

[17]  S. Grossberg,et al.  Neural dynamics of planned arm movements: emergent invariants and speed-accuracy properties during trajectory formation. , 1988, Psychological review.

[18]  Michael A. Arbib,et al.  Extending the mirror neuron system model, II: what did I just do? A new role for mirror neurons , 2010, Biological Cybernetics.

[19]  Patrick R Hof,et al.  Broca's area homologue in chimpanzees (Pan troglodytes): probabilistic mapping, asymmetry, and comparison to humans. , 2009, Cerebral cortex.

[20]  Philippe Gaussier,et al.  Emergent imitative behavior on a robotic arm based on visuo-motor associative memories , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[21]  Timothy E. J. Behrens,et al.  The evolution of the arcuate fasciculus revealed with comparative DTI , 2008, Nature Neuroscience.

[22]  Michael Tomasello,et al.  Gestural communication in subadult bonobos (Pan paniscus): Repertoire and use , 2005, American journal of primatology.

[23]  J. Rilling,et al.  Process versus product in social learning: comparative diffusion tensor imaging of neural systems for action execution-observation matching in macaques, chimpanzees, and humans. , 2013, Cerebral cortex.

[24]  Atsushi Iriki,et al.  Social state representation in prefrontal cortex , 2009, Social neuroscience.

[25]  Michael Tomasello,et al.  Use of gesture sequences in chimpanzees , 2004, American journal of primatology.

[26]  J L Andersson,et al.  Social Network Size Affects Neural Circuits in Macaques , 2011, Science.

[27]  E. Rolls,et al.  A Neurodynamical cortical model of visual attention and invariant object recognition , 2004, Vision Research.

[28]  Peter Ford Dominey,et al.  A Model of Corticostriatal Plasticity for Learning Oculomotor Associations and Sequences , 1995, Journal of Cognitive Neuroscience.

[29]  Michael A. Arbib,et al.  Multiple levels of spatial organization: World Graphs and spatial difference learning , 2012, Adapt. Behav..

[30]  Angela Sirigu,et al.  Modulation of value representation by social context in the primate orbitofrontal cortex , 2012, Proceedings of the National Academy of Sciences.

[31]  Michael A. Arbib,et al.  Synthetic brain imaging: grasping, mirror neurons and imitation , 2000, Neural Networks.

[32]  K. Berridge Motivation concepts in behavioral neuroscience , 2004, Physiology & Behavior.

[33]  Michael A. Arbib,et al.  Affordances. Motivations, and the World Graph Theory , 1998, Adapt. Behav..

[34]  M. Tomasello,et al.  Methodological Challenges in the Study of Primate Cognition , 2011, Science.

[35]  Kazuo Hiraki,et al.  Event-related potentials in response to subjects’ own names , 2011, Communicative & integrative biology.

[36]  B. Galef Social Learning in Animals , 2006 .

[37]  G. Rizzolatti,et al.  Action recognition in the premotor cortex. , 1996, Brain : a journal of neurology.

[38]  Robin I. M. Dunbar Social Brain Hypothesis , 1998, Encyclopedia of Evolutionary Psychological Science.

[39]  D. Parisi,et al.  TRoPICALS: a computational embodied neuroscience model of compatibility effects. , 2010, Psychological review.

[40]  Michael A. Arbib,et al.  The NeuroHomology database , 2001, Neurocomputing.

[41]  M. Walton,et al.  A Role for the Macaque Anterior Cingulate Gyrus in Social Valuation , 2006, Science.

[42]  G. Rizzolatti,et al.  Neurons related to goal-directed motor acts in inferior area 6 of the macaque monkey , 2004, Experimental Brain Research.

[43]  D. Barraclough,et al.  Learning and decision making in monkeys during a rock-paper-scissors game. , 2005, Brain research. Cognitive brain research.

[44]  Masaki Tomonaga,et al.  How chimpanzees look at pictures: a comparative eye-tracking study , 2009, Proceedings of the Royal Society B: Biological Sciences.

[45]  R. Byrne,et al.  The gestural repertoire of the wild chimpanzee , 2011, Animal Cognition.

[46]  Masataka Watanabe,et al.  Role of anticipated reward in cognitive behavioral control , 2007, Current Opinion in Neurobiology.

[47]  R. Adolphs Conceptual Challenges and Directions for Social Neuroscience , 2010, Neuron.

[48]  Michelle Y. Merrill,et al.  Orangutan Cultures and the Evolution of Material Culture , 2003, Science.

[49]  L. Steels Evolving grounded communication for robots , 2003, Trends in Cognitive Sciences.

[50]  Apostolos P Georgopoulos,et al.  Cognitive motor control: spatial and temporal aspects , 2003, Current Opinion in Neurobiology.

[51]  K. Laland,et al.  Social Learning in Animals: Empirical Studies and Theoretical Models , 2005 .

[52]  Masaki Tomonaga,et al.  Differential prefrontal white matter development in chimpanzees and humans. , 2011, Current biology : CB.

[53]  M. Botvinick,et al.  Hierarchically organized behavior and its neural foundations: A reinforcement learning perspective , 2009, Cognition.

[54]  G. Rizzolatti,et al.  Hearing Sounds, Understanding Actions: Action Representation in Mirror Neurons , 2002, Science.

[55]  D. Wolpert,et al.  Mental state inference using visual control parameters. , 2005, Brain research. Cognitive brain research.

[56]  Paul Cisek,et al.  Cortical mechanisms of action selection: the affordance competition hypothesis , 2007, Philosophical Transactions of the Royal Society B: Biological Sciences.

[57]  J. Gavin Bremner,et al.  Blackwell handbook of infant development , 2004 .

[58]  J. Tanji,et al.  Numerical representation for action in the parietal cortex of the monkey , 2002, Nature.

[59]  R. Byrne,et al.  Priming primates: Human and otherwise , 1998, Behavioral and Brain Sciences.

[60]  Michael Tomasello,et al.  Gestural communication in young gorillas (Gorilla gorilla): Gestural repertoire, learning, and use , 2003, American journal of primatology.

[61]  Michael L. Platt,et al.  Monkeys Pay Per View: Adaptive Valuation of Social Images by Rhesus Macaques , 2005, Current Biology.

[62]  A. Whiten,et al.  CHARTING CULTURAL VARIATION IN CHIMPANZEES , 2001 .

[63]  Kazuo Hiraki,et al.  Auditory ERPs to Stimulus Deviance in an Awake Chimpanzee (Pan troglodytes): Towards Hominid Cognitive Neurosciences , 2008, PloS one.

[64]  Matthew F Glasser,et al.  Differences between chimpanzees and bonobos in neural systems supporting social cognition. , 2012, Social cognitive and affective neuroscience.

[65]  L. Buxbaum,et al.  On beyond mirror neurons: internal representations subserving imitation and recognition of skilled object-related actions in humans. , 2005, Brain research. Cognitive brain research.

[66]  Alberto Acerbi,et al.  Modeling imitation and emulation in constrained search spaces , 2011, Learning & behavior.

[67]  M. Arbib,et al.  Primate Vocalization, Gesture, and the Evolution of Human Language , 2008, Current Anthropology.

[68]  M. Arbib From Mirror Neurons to Complex Imitation in the Evolution of Language and Tool Use , 2011 .

[69]  R. Byrne,et al.  Machiavellian intelligence : social expertise and the evolution of intellect in monkeys, apes, and humans , 1990 .

[70]  M. Kawato,et al.  From self-observation to imitation: Visuomotor association on a robotic hand , 2008, Brain Research Bulletin.

[71]  Michael A. Arbib,et al.  Précis of How the brain got language: The Mirror System Hypothesis , 2012, Language and Cognition.

[72]  Michael A. Arbib,et al.  Modeling parietal-premotor interactions in primate control of grasping , 1998, Neural Networks.

[73]  Atsushi Iriki,et al.  Social error monitoring in macaque frontal cortex , 2012, Nature Neuroscience.

[74]  E. Clark Strategies for Communicating. , 1978 .

[75]  HighWire Press Philosophical Transactions of the Royal Society of London , 1781, The London Medical Journal.

[76]  M. Arbib,et al.  Grasping objects: the cortical mechanisms of visuomotor transformation , 1995, Trends in Neurosciences.

[77]  Steve W. C. Chang,et al.  Neuronal reference frames for social decisions in primate frontal cortex , 2012, Nature Neuroscience.

[78]  J. T. Massey,et al.  Spatial trajectories and reaction times of aimed movements: effects of practice, uncertainty, and change in target location. , 1981, Journal of neurophysiology.

[79]  Chrystopher L. Nehaniv,et al.  Imitation as a Dual-Route Process Featuring Predictive and Learning Components: A Biologically Plausible Computational Model , 2002 .

[80]  Michael Tomasello,et al.  Primate Cognition , 2010, Top. Cogn. Sci..

[81]  Michael Tomasello,et al.  A Comparison of the Gestural Communication of Apes and Human Infants , 1997 .

[82]  Scott T. Grafton,et al.  Synthetic PET: Analyzing large‐scale properties of neural networks , 1994 .

[83]  C. Frith,et al.  Meeting of minds: the medial frontal cortex and social cognition , 2006, Nature Reviews Neuroscience.

[84]  Michael Deppe,et al.  Variability and asymmetry of the sulcal contours defining Broca's area homologue in the chimpanzee brain , 2012, The Journal of comparative neurology.

[85]  Marcus Perlman,et al.  A mother gorilla’s variable use of touch to guide her infant , 2012 .

[86]  Michael A. Arbib,et al.  CHAPTER 23 – Mirror Neurons and Language , 2008 .

[87]  K. Heilman,et al.  A Cognitive Neuropsychological Model of Limb Praxis , 1991 .

[88]  Jacqueline Nadel,et al.  Anatomical Connectivity Influences both Intra- and Inter-Brain Synchronizations , 2012, PloS one.

[89]  F. Aboitiz Gestures, Vocalizations, and Memory in Language Origins , 2011, Front. Evol. Neurosci..

[90]  Masataka Watanabe,et al.  Integration of cognitive and motivational context information in the primate prefrontal cortex. , 2007, Cerebral cortex.

[91]  Katja Liebal,et al.  Developments in primate gesture research , 2012 .

[92]  H. Seo,et al.  Lateral Intraparietal Cortex and Reinforcement Learning during a Mixed-Strategy Game , 2009, Journal of Neuroscience.

[93]  William D. Hopkins,et al.  Chimpanzee Vocal Signaling Points to a Multimodal Origin of Human Language , 2011, PloS one.

[94]  M. A. Arbib,et al.  Models of Trajectory Formation and Temporal Interaction of Reach and Grasp. , 1993, Journal of motor behavior.

[95]  Michael A. Arbib,et al.  Affordances, effectivities, and assisted imitation: Caregivers and the directing of attention , 2007, Neurocomputing.

[96]  Stephen Grossberg,et al.  A neural model of sequential movement planning and control of eye movements: Item-Order-Rank working memory and saccade selection by the supplementary eye fields , 2012, Neural Networks.

[97]  Atsushi Iriki,et al.  Representation of Others' Action by Neurons in Monkey Medial Frontal Cortex , 2011, Current Biology.

[98]  J. -F. Mangin,et al.  Observer-independent characterization of sulcal landmarks and depth asymmetry in the central sulcus of the chimpanzee brain , 2010, Neuroscience.

[99]  A. Georgopoulos,et al.  Parietal cortex neurons of the monkey related to the visual guidance of hand movement , 1990, Experimental Brain Research.

[100]  D. Perrett,et al.  From single cells to social perception , 2011, Philosophical Transactions of the Royal Society B: Biological Sciences.

[101]  Susan Bowsfield The Symbolic Species: The Co-Evolution of Language and the Brain , 2004 .

[102]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[103]  Michael Tomasello,et al.  Introduction: Intentional Communication in Nonhuman Primates , 2007 .

[104]  Robert O Deaner,et al.  Mirroring of attention by neurons in macaque parietal cortex , 2009, Proceedings of the National Academy of Sciences.

[105]  A. Billard,et al.  Apraxia: a review. , 2007, Progress in brain research.

[106]  K. Vogeley,et al.  Toward a second-person neuroscience 1 , 2013, Behavioral and Brain Sciences.

[107]  L. Parr,et al.  Face Processing in the Chimpanzee Brain , 2009, Current Biology.

[108]  H. Seo,et al.  Temporal Filtering of Reward Signals in the Dorsal Anterior Cingulate Cortex during a Mixed-Strategy Game , 2007, The Journal of Neuroscience.

[109]  Jonathan D. Cohen,et al.  Prefrontal cortex and flexible cognitive control: rules without symbols. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[110]  Michael Tomasello,et al.  To move or not to move: How apes adjust to the attentional state of others , 2004 .

[111]  Catherine Hobaiter,et al.  Able-Bodied Wild Chimpanzees Imitate a Motor Procedure Used by a Disabled Individual to Overcome Handicap , 2010, PloS one.

[112]  M. Arbib From grasp to language: Embodied concepts and the challenge of abstraction , 2008, Journal of Physiology-Paris.

[113]  Michael Arbib,et al.  Extending the mirror neuron system model, I. Audible actions and invisible grasps. , 2007, Biological cybernetics.

[114]  Erica A. Cartmill Gestural communication in orangutans (Pongo pygmaeus and Pongo abelii) : a cognitive approach , 2009 .

[115]  Michael J. Frank,et al.  Making Working Memory Work: A Computational Model of Learning in the Prefrontal Cortex and Basal Ganglia , 2006, Neural Computation.

[116]  Bruno B Averbeck,et al.  Parallel processing of serial movements in prefrontal cortex , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[117]  A. Whiten,et al.  Cultures in chimpanzees , 1999, Nature.