How hierarchical is language use?

It is generally assumed that hierarchical phrase structure plays a central role in human language. However, considerations of simplicity and evolutionary continuity suggest that hierarchical structure should not be invoked too hastily. Indeed, recent neurophysiological, behavioural and computational studies show that sequential sentence structure has considerable explanatory power and that hierarchical processing is often not involved. In this paper, we review evidence from the recent literature supporting the hypothesis that sequential structure may be fundamental to the comprehension, production and acquisition of human language. Moreover, we provide a preliminary sketch outlining a non-hierarchical model of language use and discuss its implications and testable predictions. If linguistic phenomena can be explained by sequential rather than hierarchical structure, this will have considerable impact in a wide range of fields, such as linguistics, ethology, cognitive neuroscience, psychology and computer science.

[1]  C. Habel,et al.  Language , 1931, NeuroImage.

[2]  G. Altmann,et al.  The time-course of prediction in incremental sentence processing: Evidence from anticipatory eye-movements , 2003 .

[3]  Richard A. Williams,et al.  Communication systems analysis and design , 1987 .

[4]  Fernanda Ferreira,et al.  The 'Good Enough' Approach to Language Comprehension , 2007, Lang. Linguistics Compass.

[5]  Thomas G. Bever,et al.  Sentence Comprehension: The Integration of Habits and Rules , 2001 .

[6]  Constance Scharff,et al.  FOXP2 as a molecular window into speech and language. , 2009, Trends in genetics : TIG.

[7]  Lubica Benuskova,et al.  Mapping sensorimotor sequences to word sequences: A connectionist model of language acquisition and sentence generation , 2012, Cognition.

[8]  S. Levinson,et al.  The myth of language universals: language diversity and its importance for cognitive science. , 2009, The Behavioral and brain sciences.

[9]  S. Crain,et al.  Structure dependence in grammar formation , 1987 .

[10]  Morten H. Christiansen,et al.  Processing multiple non-adjacent dependencies: evidence from sequence learning , 2012, Philosophical Transactions of the Royal Society B: Biological Sciences.

[11]  Stefan Knecht,et al.  Electrical Stimulation of Broca's Area Enhances Implicit Learning of an Artificial Grammar , 2010, Journal of Cognitive Neuroscience.

[12]  H. Fitz Statistical Learning of Complex Questions , 2010 .

[13]  Noam Chomsky,et al.  Lectures on Government and Binding , 1981 .

[14]  Christopher M. Conway,et al.  Implicit statistical learning in language processing: Word predictability is the key , 2010, Cognition.

[15]  Shravan Vasishth,et al.  Locality in German , 2011, Dialogue Discourse.

[16]  F. Pulvermüller Brain embodiment of syntax and grammar: Discrete combinatorial mechanisms spelt out in neuronal circuits , 2010, Brain and Language.

[17]  K. Rayner,et al.  Making and correcting errors during sentence comprehension: Eye movements in the analysis of structurally ambiguous sentences , 1982, Cognitive Psychology.

[18]  I. Rooij,et al.  Connectionist semantic systematicity , 2009, Cognition.

[19]  Paul M. Pietroski,et al.  Nature, Nurture And Universal Grammar , 2001 .

[20]  Philip Koehn,et al.  Statistical Machine Translation , 2010, EAMT.

[21]  Morten H. Christiansen,et al.  A Usage-Based Approach to Recursion in Sentence Processing , 2009 .

[22]  Neal J. Pearlmutter,et al.  Hierarchy and scope of planning in subject–verb agreement production , 2011, Cognition.

[23]  Peter Hagoort,et al.  Implicit Acquisition of Grammars With Crossed and Nested Non-Adjacent Dependencies: Investigating the Push-Down Stack Model , 2012, Cogn. Sci..

[24]  Nick Chater,et al.  Language Acquisition Meets Language Evolution , 2010, Cogn. Sci..

[25]  G. Kempen,et al.  Syntactic structure assembly in human parsing: a computational model based on competitive inhibition and a lexicalist grammar , 2000, Cognition.

[26]  M. Baltin,et al.  The Mental representation of grammatical relations , 1985 .

[27]  Morten H. Christiansen,et al.  Impaired artificial grammar learning in agrammatism , 2010, Cognition.

[28]  Y. Grodzinsky The neurology of syntax: Language use without Broca's area , 2000, Behavioral and Brain Sciences.

[29]  Morten H. Christiansen,et al.  Learning Simple Statistics for Language Comprehension and Production: The CAPPUCCINO Model , 2011, CogSci.

[30]  Julia Fischer,et al.  Animal Thinking: Contemporary Issues in Comparative Cognition , 2011 .

[31]  P. Johnson-Laird Mental models , 1989 .

[32]  Aniruddh D. Patel,et al.  Musical syntactic processing in agrammatic Broca's aphasia , 2008 .

[33]  Morten H. Christiansen,et al.  Language as an adaptation to the cognitive niche , 2003 .

[34]  Shravan Vasishth,et al.  Processing grammatical and ungrammatical center embeddings in English and German: A computational model , 2009 .

[35]  Ronald W. Langacker Day after Day after Day , 2008 .

[36]  Gabriella Vigliocco,et al.  Lexical surprisal as a general predictor of reading time , 2012, EACL.

[37]  Morten H. Christiansen,et al.  Learning Recursion: Multiple Nested and Crossed Dependencies , 2011, Biolinguistics.

[38]  J. Fodor,et al.  The Language of Thought , 1980 .

[39]  Christopher M. Conway,et al.  Neurocognitive Basis of Implicit Learning of Sequential Structure and Its Relation to Language Processing , 2008, Annals of the New York Academy of Sciences.

[40]  Daniel Jurafsky,et al.  A Probabilistic Model of Lexical and Syntactic Access and Disambiguation , 1996, Cogn. Sci..

[41]  K. Wexler Very early parameter setting and the unique checking constraint: a new explanation of the optional infinitive stage: a new explanation of the optional infinitive stage , 1998 .

[42]  Rens Bod,et al.  Empiricist Solutions to Nativist Puzzles by means of Unsupervised TSG , 2012 .

[43]  Colin Bannard,et al.  Stored Word Sequences in Language Learning , 2008, Psychological science.

[44]  Rens Bod,et al.  Children's Grammars Grow More Abstract with Age - Evidence from an Automatic Procedure for Identifying the Productive Units of Language , 2009, Top. Cogn. Sci..

[45]  L. Barsalou,et al.  Whither structured representation? , 1999, Behavioral and Brain Sciences.

[46]  Michael Tomasello,et al.  Ape and Human Cognition , 2010 .

[47]  A. Sanford,et al.  Depth of processing in language comprehension: not noticing the evidence , 2002, Trends in Cognitive Sciences.

[48]  S. Frank,et al.  Insensitivity of the Human Sentence-Processing System to Hierarchical Structure , 2011, Psychological science.

[49]  Nick Chater,et al.  Toward a connectionist model of recursion in human linguistic performance , 1999 .

[50]  Morten H. Christiansen,et al.  Language as shaped by the brain. , 2008, The Behavioral and brain sciences.

[51]  A. Goldberg Constructions at Work: The Nature of Generalization in Language , 2006 .

[52]  Lidiya Tornyova,et al.  Bigrams and the Richness of the Stimulus , 2008, Cogn. Sci..

[53]  Angela D. Friederici,et al.  Hierarchical artificial grammar processing engages Broca's area , 2008, NeuroImage.

[54]  S. Dehaene,et al.  Cortical representation of the constituent structure of sentences , 2011, Proceedings of the National Academy of Sciences.

[55]  S. Levinson Pragmatics and the grammar of anaphora: a partial pragmatic reduction of Binding and Control phenomena , 1987, Journal of Linguistics.

[56]  Y. Grodzinsky,et al.  The battle for Broca’s region , 2008, Trends in Cognitive Sciences.

[57]  J. Saffran Constraints on Statistical Language Learning , 2002 .

[58]  Steven Pinker,et al.  Language learnability and language development , 1985 .

[59]  Denise Brandão de Oliveira e Britto,et al.  The faculty of language , 2007 .

[60]  R. Harald Baayen,et al.  Sidestepping the combinatorial explosion: Towards a processing model based on discriminative learning , 2010 .

[61]  William D. Marslen-Wilson,et al.  Crossed and nested dependencies in German and Dutch , 1986 .

[62]  Simon J. Greenhill,et al.  Evolved structure of language shows lineage-specific trends in word-order universals , 2011, Nature.

[63]  Peter W. Culicover,et al.  The role of linear order in the computation of referential dependencies , 2013 .

[64]  Morten H. Christiansen,et al.  When 'more'in statistical learning means 'less' in language: individual differences in predictive processing of adjacent dependencies , 2010 .

[65]  Stefan Frank,et al.  Early effects of word surprisal on pupil size during reading , 2012, CogSci.

[66]  E. Gibson,et al.  Memory Limitations and Structural Forgetting: The Perception of Complex Ungrammatical Sentences as Grammatical , 1999 .

[67]  Heidi Johansen-Berg,et al.  White matter integrity in the vicinity of Broca's area predicts grammar learning success , 2009, NeuroImage.

[68]  Raymond Pearl,et al.  To begin with , 1976 .

[69]  James R. Glass,et al.  Developments and directions in speech recognition and understanding, Part 1 [DSP Education] , 2009, IEEE Signal Processing Magazine.

[70]  Alexander Clark,et al.  Learning Auxiliary Fronting with Grammatical Inference , 2006, CoNLL.

[71]  Richard L. Lewis,et al.  In search of on-line locality effects in sentence comprehension. , 2011, Journal of experimental psychology. Learning, memory, and cognition.

[72]  Fernand Gobet,et al.  Simulating the Referential Properties of Dutch, German, and English Root Infinitives in MOSAIC , 2009 .

[73]  David Adger,et al.  Core Syntax: A Minimalist Approach , 2003 .

[74]  Kathy Conklin,et al.  Seeing a phrase "time and again" matters: the role of phrasal frequency in the processing of multiword sequences. , 2011, Journal of experimental psychology. Learning, memory, and cognition.

[75]  Neal J Pearlmutter,et al.  Against structural constraints in subject-verb agreement production. , 2013, Journal of experimental psychology. Learning, memory, and cognition.

[76]  S. Dehaene,et al.  Cultural Recycling of Cortical Maps , 2007, Neuron.

[77]  Simon Kirby,et al.  Innateness and culture in the evolution of language , 2006, Proceedings of the National Academy of Sciences.

[78]  Ivan A. Sag,et al.  Syntactic Theory: A Formal Introduction , 1999, Computational Linguistics.

[79]  P. Hagoort,et al.  The inferior frontal cortex in artificial syntax processing: An rTMS study , 2008, Brain Research.

[80]  Robert J. Hartsuiker,et al.  Object Attraction in Subject-Verb Agreement Construction , 2001 .

[81]  Morten H. Christiansen,et al.  Uncovering the Richness of the Stimulus: Structure Dependence and Indirect Statistical Evidence , 2005, Cogn. Sci..

[82]  C. Westbury,et al.  Processing Advantages of Lexical Bundles: Evidence from Self-Paced Reading and Sentence Recall Tasks. , 2011 .

[83]  Morten H. Christiansen,et al.  Sequential Expectations: The Role of Prediction-Based Learning in Language , 2010, Top. Cogn. Sci..

[84]  Pieter A. M. Seuren Western Linguistics: An Historical Introduction , 1998 .

[85]  Daniel C. Richardson,et al.  Effects of merely local syntactic coherence on sentence processing , 2004 .

[86]  P. Hagoort,et al.  What artificial grammar learning reveals about the neurobiology of syntax , 2012, Brain and Language.

[87]  James Glass,et al.  Research Developments and Directions in Speech Recognition and Understanding, Part 1 , 2009 .

[88]  Nick Chater,et al.  Restrictions on biological adaptation in language evolution , 2009, Proceedings of the National Academy of Sciences.

[89]  R. Wallace The Body in the Mind: The Bodily Basis of Meaning, Imagination, and Reason , 1988 .

[90]  Richard L. Lewis,et al.  Short-term forgetting in sentence comprehension: Crosslinguistic evidence from verb-final structures , 2010 .

[91]  Joan L. Bybee 4. Sequentiality as the basis of constituent structure , 2002 .

[92]  Morris Swadesh,et al.  The Linguistic Approach to Salish Prehistory , 1949 .

[93]  Gerard Kempen,et al.  An Incremental Procedural Grammar for Sentence Formulation , 1987, Cogn. Sci..

[94]  N. Snider,et al.  More than words: Frequency effects for multi-word phrases , 2010 .

[95]  Vivien Law,et al.  The History of Linguistics in Europe: A brief overview of linguistics since 1600 , 2003 .

[96]  Angela D. Friederici,et al.  The Neural Basis of Recursion and Complex Syntactic Hierarchy , 2011, Biolinguistics.

[97]  Marte Otten,et al.  Discourse-Based Word Anticipation During Language Processing: Prediction or Priming? , 2008 .

[98]  Noam Chomsky,et al.  The faculty of language: what is it, who has it, and how did it evolve? , 2002, Science.

[99]  S. Crain Language acquisition in the absence of experience , 1991, Behavioral and Brain Sciences.

[100]  Simon Dennis,et al.  A Single Layer Network Model of Sentential Recursive Patterns , 2009 .

[101]  Noam Chomsky,et al.  The Evolution of Human Language: Some simple evo devo theses: how true might they be for language? , 2010 .

[102]  이영식 Communication 으로서의 영어교육 , 1986 .

[103]  Colin M. Brown,et al.  Anticipating upcoming words in discourse: evidence from ERPs and reading times. , 2005, Journal of experimental psychology. Learning, memory, and cognition.

[104]  Morten H. Christiansen,et al.  Similar neural correlates for language and sequential learning: Evidence from event-related brain potentials , 2012, Language and cognitive processes.

[105]  Noam Chomsky Lectures on Government and Binding: The Pisa Lectures , 1993 .