Dorsal and ventral streams in the evolution of the language-ready brain: Linking language to the world

Abstract Many studies in neurolinguistics focus on the dorsal and ventral streams of the auditory system in language comprehension, but few address the production of language (whether spoken or signed). Moreover, almost no neurolinguistic studies addresses how language use is situated with respect to our perception of and action in the world around us, functions which depend (in part) on the dorsal and ventral streams of the visual system. The aim of this paper is to lay the foundations for an integrated account of situated language processing in the human brain that incorporates the dorsal and ventral streams for both vision and audition. Our further aim is to do so in a way which lays bare the challenges of offering an account of brain evolution in which the macaque brain is used as a surrogate for the brain of LCA-m (the last common ancestor of human and macaque). In particular, we assess the challenges to the mirror system hypothesis (MSH) of the evolution of the language-ready brain when data on auditory dorsal and ventral streams are taken into account. To this end, we compare two accounts of language comprehension and one account of language production (for the special case of describing a visual scene). It will be argued that much of syntactic and semantic processing is fed by ventral processes, that both operate at the level of words-as-signifiers, and that the dorsal path and its role in the perception and production of words-as-articulatory actions plays only a secondary role in such processing.

[1]  J. Rauschecker Cortical processing of complex sounds , 1998, Current Opinion in Neurobiology.

[2]  T. Deacon The Evolution of Language Systems in the Human Brain , 2007 .

[3]  Anne L. Foundas,et al.  Speech and gesture are mediated by independent systems , 2005, Behavioral and Brain Sciences.

[4]  Michael A. Arbib,et al.  Describing visual scenes: Towards a neurolinguistics based on construction grammar , 2008, Brain Research.

[5]  Volkmar Glauche,et al.  Ventral and dorsal pathways for language , 2008, Proceedings of the National Academy of Sciences.

[6]  C. Petkov,et al.  Birds, primates, and spoken language origins: behavioral phenotypes and neurobiological substrates , 2012, Front. Evol. Neurosci..

[7]  D. Poeppel,et al.  The cortical organization of speech processing , 2007, Nature Reviews Neuroscience.

[8]  G. Altmann,et al.  Discourse-mediation of the mapping between language and the visual world: Eye movements and mental representation , 2009, Cognition.

[9]  M. Schlesewsky,et al.  Reconciling time, space and function: A new dorsal–ventral stream model of sentence comprehension , 2013, Brain and Language.

[10]  A. Caramazza,et al.  Dissociation of algorithmic and heuristic processes in language comprehension: Evidence from aphasia , 1976, Brain and Language.

[11]  Matthias Schlesewsky,et al.  The extended argument dependency model: a neurocognitive approach to sentence comprehension across languages. , 2006, Psychological review.

[12]  David Gil,et al.  Creoles, Complexity and Riau Indonesian. , 2001 .

[13]  D. McNeill Gesture and Thought , 2005 .

[14]  M. Arbib From monkey-like action recognition to human language: An evolutionary framework for neurolinguistics , 2005, Behavioral and Brain Sciences.

[15]  J. Ewert Neuroethology of releasing mechanisms: Prey-catching in toads , 1987, Behavioral and Brain Sciences.

[16]  K. Doya,et al.  A unifying computational framework for motor control and social interaction. , 2003, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[17]  Ina Bornkessel-Schlesewsky,et al.  The Role of Prominence Information in the Real-Time Comprehension of Transitive Constructions: A Cross-Linguistic Approach , 2009, Lang. Linguistics Compass.

[18]  M. Jeannerod,et al.  Impairment of grasping movements following a bilateral posterior parietal lesion , 1994, Neuropsychologia.

[19]  Michael A. Arbib,et al.  Perceptual Structures and Distributed Motor Control , 1981 .

[20]  Ina Bornkessel-Schlesewsky,et al.  A modality-independent, neurobiological grounding for the combinatory capacity of the language-ready brain: Comment on "Towards a Computational Comparative Neuroprimatology: Framing the language-ready brain" by Michael A. Arbib. , 2016, Physics of life reviews.

[21]  Lori L. Holt,et al.  Reflections on mirror neurons and speech perception , 2009, Trends in Cognitive Sciences.

[22]  Rajesh P. N. Rao,et al.  Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive-field effects. , 1999 .

[23]  D. Ingle,et al.  Visually Elicited Evasive Behavior in FrogsGiving memory research an ethological context , 1990 .

[24]  M. Arbib Aphasia, apraxia and the evolution of the language-ready brain , 2006 .

[25]  J. Call,et al.  Word Learning in a Domestic Dog: Evidence for "Fast Mapping" , 2004, Science.

[26]  M. Arbib,et al.  Language within our grasp , 1998, Trends in Neurosciences.

[27]  R. Andersen,et al.  Responses to auditory stimuli in macaque lateral intraparietal area. I. Effects of training. , 1999, Journal of neurophysiology.

[28]  Matthew W. Crocker,et al.  The Coordinated Interplay of Scene, Utterance, and World Knowledge: Evidence From Eye Tracking , 2006, Cogn. Sci..

[29]  F. Aboitiz Gestures, Vocalizations, and Memory in Language Origins , 2011, Front. Evol. Neurosci..

[30]  L. Fogassi,et al.  The extended features of mirror neurons and the voluntary control of vocalization in the pathway to language , 2013, Language and Cognition.

[31]  A. Kendon Gesture: Visible Action as Utterance , 2004 .

[32]  W. Fitch The evolution of speech: a comparative review , 2000, Trends in Cognitive Sciences.

[33]  James K. Rilling,et al.  Comparative primate neurobiology and the evolution of brain language systems , 2014, Current Opinion in Neurobiology.

[34]  Michael A. Arbib,et al.  Recognizing speech in a novel accent: the motor theory of speech perception reframed , 2013, Biological Cybernetics.

[35]  D. Bickerton Language and Human Behavior , 1996 .

[36]  Peter F. MacNeilage,et al.  The frame/content theory of evolution of speech: A comparison with a gestural-origins alternative , 2005 .

[37]  J. D. Miller,et al.  Speech perception by the chinchilla: voiced-voiceless distinction in alveolar plosive consonants , 1975, Science.

[38]  Michael A. Arbib,et al.  Extending the mirror neuron system model, I , 2007, Biological Cybernetics.

[39]  M. Mishkin,et al.  Dual streams of auditory afferents target multiple domains in the primate prefrontal cortex , 1999, Nature Neuroscience.

[40]  P. Marler,et al.  Monkey responses to three different alarm calls: evidence of predator classification and semantic communication. , 1980, Science.

[41]  M. Arbib,et al.  Neural expectations : A possible evolutionary path from manual skills to language , 1996 .

[42]  Michael Arbib,et al.  Dyadic brain modelling, mirror systems and the ontogenetic ritualization of ape gesture , 2014, Philosophical Transactions of the Royal Society B: Biological Sciences.

[43]  C. Sherrington,et al.  OBSERVATIONS ON THE EXCITABLE CORTEX OF THE CHIMPANZEE, ORANG‐UTAN, AND GORILLA , 1917 .

[44]  Terrence W. Deacon,et al.  The neural circuitry underlying primate calls and human language , 1989 .

[45]  R Lara,et al.  A global model of the neural mechanisms responsible for visuomotor coordination in toads. , 1984, Journal of theoretical biology.

[46]  Michael A. Arbib,et al.  Depth and detours: an essay on visually guided behavior , 1990 .

[47]  Francisco Aboitiz,et al.  The Phonological Loop , 2010, Current Anthropology.

[48]  T. Rogers,et al.  Lichtheim 2: Synthesizing Aphasia and the Neural Basis of Language in a Neurocomputational Model of the Dual Dorsal-Ventral Language Pathways , 2011, Neuron.

[49]  J. Rilling,et al.  Process versus product in social learning: comparative diffusion tensor imaging of neural systems for action execution-observation matching in macaques, chimpanzees, and humans. , 2013, Cerebral cortex.

[50]  K. Emmorey Language, Cognition, and the Brain: Insights From Sign Language Research , 2001 .

[51]  L. Jakobson,et al.  A neurological dissociation between perceiving objects and grasping them , 1991, Nature.

[52]  A. Friederici The cortical language circuit: from auditory perception to sentence comprehension , 2012, Trends in Cognitive Sciences.

[53]  E. Visalberghi,et al.  Characteristics of hammer stones and anvils used by wild bearded capuchin monkeys (Cebus libidinosus) to crack open palm nuts. , 2007, American journal of physical anthropology.

[54]  M. Arbib,et al.  Grasping objects: the cortical mechanisms of visuomotor transformation , 1995, Trends in Neurosciences.

[55]  M. Arbib Complex imitation and the language-ready brain , 2013, Language and Cognition.

[56]  G. Rizzolatti,et al.  Neural Circuits Involved in the Recognition of Actions Performed by Nonconspecifics: An fMRI Study , 2004, Journal of Cognitive Neuroscience.

[57]  Leslie G. Ungerleider Two cortical visual systems , 1982 .

[58]  Michael A. Arbib,et al.  How to Bootstrap a Human Communication System , 2013, Cogn. Sci..

[59]  P. Grobstein,et al.  The organization of descending tectofugal pathways underlying orienting in the frog, Rana pipiens , 2004, Experimental Brain Research.

[60]  Michael A. Arbib,et al.  Modeling parietal-premotor interactions in primate control of grasping , 1998, Neural Networks.

[61]  Michael A. Arbib,et al.  Schema design and implementation of the grasp-related mirror neuron system , 2002, Biological Cybernetics.

[62]  F. Aboitiz How did vocal behavior “take over” the gestural communication system? , 2013, Language and Cognition.

[63]  G. Coudé On the role of emerging voluntary control of vocalization in language evolution: Comment on "Towards a Computational Comparative Neuroprimatology: Framing the language-ready brain" by Michael A. Arbib. , 2016, Physics of life reviews.

[64]  T. Collett Stereopsis in toads , 1977, Nature.

[65]  P. Marler,et al.  Vervet monkey alarm calls: Semantic communication in a free-ranging primate , 1980, Animal Behaviour.

[66]  A. Wray Protolanguage as a holistic system for social interaction , 1998 .

[67]  Marta Kutas,et al.  Different mechanisms for role relations versus verb-action congruence effects: evidence from ERPs in picture-sentence verification. , 2014, Acta psychologica.

[68]  N. Tinbergen On aims and methods of Ethology , 2010 .

[69]  Giosuè Baggio,et al.  The balance between memory and unification in semantics: A dynamic account of the N400 , 2011 .

[70]  Leonardo Fogassi,et al.  Mirror neurons, gestures and language evolution , 2004 .

[71]  David Ingle,et al.  Locating and identifying: Two modes of visual processing , 1967 .

[72]  Michael A. Arbib,et al.  Précis of How the brain got language: The Mirror System Hypothesis , 2012, Language and Cognition.

[73]  R. G. Kent,et al.  Language: Its Nature, Development, and Origin , 1923 .

[74]  Dwight J. Kravitz,et al.  A new neural framework for visuospatial processing , 2011, Nature Reviews Neuroscience.

[75]  U. Jürgens,et al.  The neural control of vocalization in mammals: a review. , 2009, Journal of voice : official journal of the Voice Foundation.

[76]  D. Poeppel,et al.  Dorsal and ventral streams: a framework for understanding aspects of the functional anatomy of language , 2004, Cognition.

[77]  J. Rauschecker,et al.  Neurobiological roots of language in primate audition: common computational properties , 2015, Trends in Cognitive Sciences.

[78]  Michael A. Arbib,et al.  Mirror system activity for action and language is embedded in the integration of dorsal and ventral pathways , 2010, Brain and Language.

[79]  D. Hubel,et al.  Ferrier lecture - Functional architecture of macaque monkey visual cortex , 1977, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[80]  Daniel M. Wolpert,et al.  Hierarchical MOSAIC for movement generation , 2003 .

[81]  Jinyong Lee,et al.  Template Construction Grammar: From Visual Scene Description to Language Comprehension and Agrammatism , 2013, Neuroinformatics.

[82]  G. Hickok A cortical circuit for voluntary laryngeal control: Implications for the evolution language , 2017, Psychonomic bulletin & review.

[83]  M. Arbib Towards a Computational Comparative Neuroprimatology: Framing the language-ready brain. , 2016, Physics of life reviews.

[84]  B. Stein,et al.  The Merging of the Senses , 1993 .

[85]  Cornelius Weiller,et al.  Please don’t underestimate the ventral pathway in language , 2009, Trends in Cognitive Sciences.

[86]  U. Jürgens Neural pathways underlying vocal control , 2002, Neuroscience & Biobehavioral Reviews.

[87]  Julie C. Sedivy,et al.  Subject Terms: Linguistics Language Eyes & eyesight Cognition & reasoning , 1995 .

[88]  G. Hickok Computational neuroanatomy of speech production , 2012, Nature Reviews Neuroscience.

[89]  Michael A. Arbib,et al.  Interweaving protosign and protospeech: Further developments beyond the mirror , 2005 .

[90]  Michael A. Arbib,et al.  Vision and Action in the Language-Ready Brain: From Mirror Neurons to SemRep , 2007, BVAI.

[91]  Adam M. Gifford,et al.  Neural correlates of auditory scene analysis and perception. , 2015, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[92]  Michael A Arbib,et al.  Primates, computation, and the path to language: Reply to comments on "Towards a Computational Comparative Neuroprimatology: Framing the language-ready brain". , 2016, Physics of life reviews.

[93]  J. Rilling,et al.  Continuity, Divergence, and the Evolution of Brain Language Pathways , 2011, Front. Evol. Neurosci..

[94]  L. Fogassi,et al.  Audiovisual mirror neurons and action recognition , 2003, Experimental Brain Research.

[95]  Monica Maranesi,et al.  Neurons Controlling Voluntary Vocalization in the Macaque Ventral Premotor Cortex , 2011, PloS one.

[96]  C. Larson,et al.  Neocortical and limbic lesion effects on primate phonation. , 1974, Brain research.

[97]  A Cobas,et al.  Prey-catching and predator-avoidance in frog and toad: defining the schemas. , 1992, Journal of theoretical biology.

[98]  M. Arbib,et al.  Primate Vocalization, Gesture, and the Evolution of Human Language , 2008, Current Anthropology.

[99]  Walter Bisang,et al.  Precategoriality and syntax-based parts of speech: The case of Late Archaic Chinese , 2008 .

[100]  L. Petitto How the brain begets language , 2005 .