How the brain composes morphemes into meaning

Morphemes (e.g. [tune], [-ful], [-ly]) are the basic blocks with which complex meaning is built. Here, I explore the critical role that morpho-syntactic rules play in forming the meaning of morphologically complex words, from two primary standpoints: (i) how semantically rich stem morphemes (e.g. explode, bake, post) combine with syntactic operators (e.g. -ion, -er, -age) to output a semantically predictable result; (ii) how this process can be understood in terms of mathematical operations, easily allowing the brain to generate representations of novel morphemes and comprehend novel words. With these ideas in mind, I offer a model of morphological processing that incorporates semantic and morpho-syntactic operations in service to meaning composition, and discuss how such a model could be implemented in the human brain. This article is part of the theme issue ‘Towards mechanistic models of meaning composition’.

[1]  M. Sigman,et al.  The neural code for written words: a proposal , 2005, Trends in Cognitive Sciences.

[2]  David Poeppel,et al.  In Spoken Word Recognition, the Future Predicts the Past , 2017, The Journal of Neuroscience.

[3]  William D. Marslen-Wilson,et al.  Real-time Functional Architecture of Visual Word Recognition , 2014, Journal of Cognitive Neuroscience.

[4]  Lorraine K Tyler,et al.  Morphology, language and the brain: the decompositional substrate for language comprehension , 2007, Philosophical Transactions of the Royal Society B: Biological Sciences.

[5]  Regina Barzilay,et al.  Unsupervised Multilingual Learning for Morphological Segmentation , 2008, ACL.

[6]  David Pesetsky,et al.  Zero Syntax: Experiencers and Cascades , 1994 .

[7]  Elizabeth K. Johnson,et al.  Word Segmentation by 8-Month-Olds: When Speech Cues Count More Than Statistics , 2001 .

[8]  S. Gerhand,et al.  Word frequency effects in oral reading are not merely age-of-acquisition effects in disguise. , 1998 .

[9]  Zhou Xiaolin,et al.  The combinatorial lexicon: Priming derivational affixes , 1996 .

[10]  D. Poeppel,et al.  The cortical organization of speech processing , 2007, Nature Reviews Neuroscience.

[11]  Rutvik H. Desai,et al.  Toward a brain-based componential semantic representation , 2016, Cognitive neuropsychology.

[12]  Marco Marelli,et al.  Compositional-ly Derived Representations of Morphologically Complex Words in Distributional Semantics , 2013, ACL.

[13]  A. Marantz,et al.  Non-linear processing of a linear speech stream: The influence of morphological structure on the recognition of spoken Arabic words , 2015, Brain and Language.

[14]  Mariano Sigman,et al.  Hierarchical Coding of Letter Strings in the Ventral Stream: Dissecting the Inner Organization of the Visual Word-Form System , 2007, Neuron.

[15]  Alec Marantz,et al.  Neural correlates of the effects of morphological family frequency and family size: an MEG study , 2004, Cognition.

[16]  Alec Marantz,et al.  Decomposition, lookup, and recombination: MEG evidence for the Full Decomposition model of complex visual word recognition , 2015, Brain and Language.

[17]  R. Lieber.  Deconstructing Morphology: Word Formation in Syntactic Theory , 1992 .

[18]  Morten L. Kringelbach,et al.  Visual word recognition: the first half second , 2004, NeuroImage.

[19]  Liina Pylkkänen,et al.  An MEG Study of Silent Meaning , 2007, Journal of Cognitive Neuroscience.

[20]  L. Gleitman.  The Structural Sources of Verb Meanings , 2020, Sentence First, Arguments Afterward.

[21]  Zellig S. Harris,et al.  Distributional Structure , 1954 .

[22]  Helen L Jamison,et al.  Morphology and the internal structure of words. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[23]  Liina Pylkkänen,et al.  The Representation of Polysemy: MEG Evidence , 2006, Journal of Cognitive Neuroscience.

[24]  Marco Baroni,et al.  Frege in Space: A Program of Compositional Distributional Semantics , 2014 .

[25]  Matthew H. Davis,et al.  Is there a ‘fete’ in ‘fetish’? Effects of orthographic opacity on morpho-orthographic segmentation in visual word recognition , 2008 .

[26]  R N Aslin,et al.  Statistical Learning by 8-Month-Old Infants , 1996, Science.

[27]  S. Dehaene,et al.  Language-specific tuning of visual cortex? Functional properties of the Visual Word Form Area. , 2002, Brain : a journal of neurology.

[28]  M. Coltheart,et al.  ‘Fell’ primes ‘fall’, but does ‘bell’ prime ‘ball’? Masked priming with irregularly-inflected primes , 2010 .

[29]  L. Gleitman,et al.  Language and Experience: Evidence from the Blind Child , 1988 .

[30]  H. Gleitman,et al.  Understanding how input matters: verb learning and the footprint of universal grammar , 2003, Cognition.

[31]  Tal Linzen,et al.  The role of morphology in phoneme prediction: Evidence from MEG , 2014, Brain and Language.

[32]  Alec Marantz,et al.  Disambiguating form and lexical frequency effects in MEG responses using homonyms , 2012 .

[33]  David Poeppel,et al.  Feedforward and feedback in speech perception: Revisiting analysis by synthesis , 2011 .

[34]  E. T. Possing,et al.  Human temporal lobe activation by speech and nonspeech sounds. , 2000, Cerebral cortex.

[35]  Kenneth N. Stevens,et al.  Speech recognition: A model and a program for research , 1962, IRE Trans. Inf. Theory.

[36]  Willem J. M. Levelt,et al.  A theory of lexical access in speech production , 1999, Behavioral and Brain Sciences.

[37]  William D. Marslen-Wilson,et al.  Decompositional Representation of Morphological Complexity: Multivariate fMRI Evidence from Italian , 2016, Journal of Cognitive Neuroscience.

[38]  Kathleen Rastle,et al.  What do fully visible primes and brain potentials reveal about morphological decomposition? , 2011, Psychophysiology.

[39]  A. Friederici.  The cortical language circuit: from auditory perception to sentence comprehension , 2012, Trends in Cognitive Sciences.

[40]  L. Pylkkänen,et al.  Semantics vs. world knowledge in prefrontal cortex , 2009 .

[41]  H. Harley,et al.  DISTRIBUTED MORPHOLOGY , 1999 .

[42]  Jonathan Grainger,et al.  An electrophysiological investigation of early effects of masked morphological priming , 2008, Language and cognitive processes.

[43]  Davide Crepaldi,et al.  Morphological Processing as We Know It: An Analytical Review of Morphological Effects in Visual Word Identification , 2012, Front. Psychology.

[44]  Alec Marantz,et al.  Evidence for Early Morphological Decomposition in Visual Word Recognition , 2010, Journal of Cognitive Neuroscience.

[45]  Zellig S. Harris,et al.  Distributional Structure , 1954 .

[46]  A. Marantz,et al.  Syntactic and semantic restrictions on morphological recomposition: MEG evidence from Greek , 2018, Brain and Language.

[47]  William W. Graves,et al.  Where is the semantic system? A critical review and meta-analysis of 120 functional neuroimaging studies. , 2009, Cerebral cortex.

[48]  Thomas L. Griffiths,et al.  Supplementary Information for Natural Speech Reveals the Semantic Maps That Tile Human Cerebral Cortex , 2022 .

[49]  Guglielmo Cinque,et al.  Restructuring and Functional Heads. The Cartography of Syntactic Structures , 2006 .

[50]  Ebru Arisoy,et al.  Morph-based speech recognition and modeling of out-of-vocabulary words across languages , 2007, TSLP.

[51]  L. Feldman.  Modeling Morphological Processing , 2013 .

[52]  Alec Marantz,et al.  The neural basis of obligatory decomposition of suffixed words , 2011, Brain and Language.

[53]  A. Cutler,et al.  Rhythmic cues to speech segmentation: Evidence from juncture misperception , 1992 .

[54]  Tie-Yan Liu,et al.  Co-learning of Word Representations and Morpheme Representations , 2014, COLING.

[55]  Alessandro Laudanna,et al.  Processing in?ectional and derivational morphology , 1992 .

[56]  Todd B. Parrish,et al.  Neural Correlates of Verb Argument Structure Processing , 2007, Journal of Cognitive Neuroscience.

[57]  Mathias Creutz,et al.  Unsupervised Morpheme Segmentation and Morphology Induction from Text Corpora Using Morfessor 1.0 , 2005 .

[58]  Bruce D. McCandliss,et al.  The visual word form area: expertise for reading in the fusiform gyrus , 2003, Trends in Cognitive Sciences.

[59]  K. Rastle,et al.  Tracking hierarchical processing in morphological decomposition with brain potentials. , 2012, Journal of experimental psychology. Human perception and performance.

[60]  Alec Marantz,et al.  Functional characterisation of letter-specific responses in time, space and current polarity using magnetoencephalography , 2016, NeuroImage.

[61]  Philip J. Monahan,et al.  Sensitivity to morphological composition in spoken word recognition: Evidence from grammatical and lexical identification tasks. , 2015, Journal of experimental psychology. Learning, memory, and cognition.

[62]  Laurence White,et al.  Integration of multiple speech segmentation cues: a hierarchical framework. , 2005, Journal of experimental psychology. General.

[63]  Mirella Lapata,et al.  Composition in Distributional Models of Semantics , 2010, Cogn. Sci..

[64]  Jayaram Chandrashekar,et al.  Sequential Processing of Lexical, Grammatical, and Phonological Information Within Broca's Area , 2009 .

[65]  Ryan Cotterell,et al.  Joint Semantic Synthesis and Morphological Analysis of the Derived Word , 2017, TACL.

[66]  David Poeppel,et al.  Analysis by Synthesis: A (Re-)Emerging Program of Research for Language and Vision , 2010, Biolinguistics.

[67]  R. Baayen,et al.  Putting the bits together: an information theoretical perspective on morphological processing , 2004, Cognition.

[68]  Rutvik H. Desai,et al.  The neurobiology of semantic memory , 2011, Trends in Cognitive Sciences.

[69]  J. R. Firth,et al.  A Synopsis of Linguistic Theory, 1930-1955 , 1957 .

[70]  Radu Soricut,et al.  Unsupervised Morphology Induction Using Word Embeddings , 2015, NAACL.

[71]  M. Taft.  Recognition of affixed words and the word frequency effect , 1979, Memory & cognition.

[72]  W. Levelt,et al.  The spatial and temporal signatures of word production components , 2004, Cognition.

[73]  J. Grainger,et al.  Effects of prime word frequency and cumulative root frequency in masked morphological priming , 2000 .

[74]  Jeffrey Pennington,et al.  GloVe: Global Vectors for Word Representation , 2014, EMNLP.

[75]  A. Marantz,et al.  Morphological representations are extrapolated from morpho-syntactic rules , 2018, Neuropsychologia.

[76]  Christopher D. Manning,et al.  Better Word Representations with Recursive Neural Networks for Morphology , 2013, CoNLL.

[77]  Tomas Mikolov,et al.  Enriching Word Vectors with Subword Information , 2016, TACL.

[78]  Alec Marantz,et al.  No escape from morphemes in morphological processing , 2013 .

[79]  R. Holloway.  The broth in my brother ’ s brothel : Morpho-orthographic segmentation in visual word recognition , 2005 .

[80]  M. de Vega,et al.  Event-related Brain Potentials Elicited by Morphological, Homographic, Orthographic, and Semantic Priming , 2004, Journal of Cognitive Neuroscience.

[81]  C. Pliatsikas,et al.  Morphological processing in the brain: the good (inflection), the bad (derivation) and the ugly (compounding) , 2019, Cortex.

[82]  Brian T. Gold,et al.  Neural Correlates of Morphological Decomposition during Visual Word Recognition , 2007, Journal of Cognitive Neuroscience.

[83]  J. Grainger,et al.  Semantic transparency and masked morphological priming: an ERP investigation. , 2007, Psychophysiology.

[84]  Alec Marantz,et al.  Architecture and Blocking , 2008, Linguistic Inquiry.

[85]  M. Ullman.  Contributions of memory circuits to language: the declarative/procedural model , 2004, Cognition.

[86]  Alec Marantz,et al.  Some key features of distributed morphology , 1994 .

[87]  D. Perani,et al.  Syntax and the Brain: Disentangling Grammar by Selective Anomalies , 2001, NeuroImage.

[88]  Jeffrey R. Binder,et al.  Tuning of the human left fusiform gyrus to sublexical orthographic structure , 2006, NeuroImage.

[89]  Matthew H. Davis,et al.  Morphological decomposition based on the analysis of orthography , 2008 .

[90]  David Poeppel,et al.  Compound words and structure in the lexicon , 2007 .

[91]  Morris Halle,et al.  Distributed morphology and the pieces of inflection , 1993 .

[92]  A. Caramazza.  How many levels of processing are there in lexical access , 1997 .