Emotional Valence Precedes Semantic Maturation of Words: A Longitudinal Computational Study of Early Verbal Emotional Anchoring

We present a longitudinal computational study on the connection between emotional and amodal word representations from a developmental perspective. In this study, children's and adult word representations were generated using the latent semantic analysis (LSA) vector space model and Word Maturity methodology. Some children's word representations were used to set a mapping function between amodal and emotional word representations with a neural network model using ratings from 9-year-old children. The neural network was trained and validated in the child semantic space. Then, the resulting neural network was tested with adult word representations using ratings from an adult data set. Samples of 1210 and 5315 words were used in the child and the adult semantic spaces, respectively. Results suggested that the emotional valence of words can be predicted from amodal vector representations even at the child stage, and accurate emotional propagation was found in the adult word vector representations. In this way, different propagative processes were observed in the adult semantic space. These findings highlight a potential mechanism for early verbal emotional anchoring. Moreover, different multiple linear regression and mixed-effect models revealed moderation effects for the performance of the longitudinal computational model. First, words with early maturation and subsequent semantic definition promoted emotional propagation. Second, an interaction effect between age of acquisition and abstractness was found to explain model performance. The theoretical and methodological implications are discussed.

[1]  Marco Marelli,et al.  Words with Consistent Diachronic Usage Patterns are Learned Earlier: A Computational Analysis Using Temporally Aligned Word Embeddings , 2021, Cogn. Sci..

[2]  Jamie Ward,et al.  Synaesthesia: The Prevalence of Atypical Cross-Modal Experiences , 2006, Perception.

[3]  Steve R. Howell,et al.  A Model of Grounded Language Acquisition: Sensorimotor Features Improve Lexical and Grammatical Learning. , 2005 .

[4]  Laurent Grégoire,et al.  Fear of the known: semantic generalisation of fear conditioning across languages in bilinguals , 2020, Cognition & emotion.

[5]  Peter Gärdenfors,et al.  Semantics, conceptual spaces, and the meeting of minds , 2013, Synthese.

[6]  John R. Searle,et al.  Minds, brains, and programs , 1980, Behavioral and Brain Sciences.

[7]  Simon Farrell,et al.  Computational Modeling of Cognition and Behavior , 2018 .

[8]  Peter Gärdenfors,et al.  From Sensations to Concepts: a Proposal for Two Learning Processes , 2019 .

[9]  L. Barsalou,et al.  Moving beyond the distinction between concrete and abstract concepts , 2018, Philosophical Transactions of the Royal Society B: Biological Sciences.

[10]  Ricardo Olmos,et al.  Bridging the theoretical gap between semantic representation models without the pressure of a ranking: some lessons learnt from LSA , 2019, Cognitive Processing.

[11]  Yves Bestgen,et al.  Checking and bootstrapping lexical norms by means of word similarity indexes , 2012, Behavior Research Methods.

[12]  Alessandro Lenci,et al.  Distributional semantics in linguistic and cognitive research , 2008 .

[13]  C. Davis,et al.  BuscaPalabras: A program for deriving orthographic and phonological neighborhood statistics and other psycholinguistic indices in Spanish , 2005, Behavior research methods.

[14]  P. Pexman,et al.  Development of Embodied Word Meanings: Sensorimotor Effects in Children’s Lexical Processing , 2016, Front. Psychol..

[15]  David A. Medler,et al.  Distinct Brain Systems for Processing Concrete and Abstract Concepts , 2005, Journal of Cognitive Neuroscience.

[16]  M. Marelli,et al.  Semantic transparency is not invisibility: A computational model of perceptually-grounded conceptual combination in word processing , 2020, Journal of Memory and Language.

[17]  Gabriel Recchia,et al.  Reproducing affective norms with lexical co-occurrence statistics: Predicting valence, arousal, and dominance , 2015, Quarterly journal of experimental psychology.

[18]  I. Fraga,et al.  EmoFinder: The meeting point for Spanish emotional words , 2018, Behavior research methods.

[19]  I. Good THE POPULATION FREQUENCIES OF SPECIES AND THE ESTIMATION OF POPULATION PARAMETERS , 1953 .

[20]  Rolf A. Zwaan,et al.  Language Encodes Geographical Information , 2009, Cogn. Sci..

[21]  Ricardo Olmos,et al.  Predicting Word Maturity from Frequency and Semantic Diversity: A Computational Study , 2017 .

[22]  Lawrence W. Barsalou,et al.  Language and simulation in conceptual processing , 2008 .

[23]  E. H. Simpson Measurement of Diversity , 1949, Nature.

[24]  Marco Marelli,et al.  Vector-Space Models of Semantic Representation From a Cognitive Perspective: A Discussion of Common Misconceptions , 2019, Perspectives on psychological science : a journal of the Association for Psychological Science.

[25]  Gabriella Vigliocco,et al.  Reconciling Embodied and Distributional Accounts of Meaning in Language , 2014, Top. Cogn. Sci..

[26]  Christian Biemann,et al.  Simple Co-Occurrence Statistics Reproducibly Predict Association Ratings , 2018, Cogn. Sci..

[27]  James L. McClelland,et al.  Concepts, Control, and Context: A Connectionist Account of Normal and Disordered Semantic Cognition , 2018, Psychological review.

[28]  Louise Connell,et al.  What have labels ever done for us? The linguistic shortcut in conceptual processing , 2019 .

[29]  Thomas K. Landauer,et al.  Word Maturity: A New Metric for Word Knowledge , 2011 .

[30]  Curt Burgess,et al.  From simple associations to the building blocks of language: Modeling meaning in memory with the HAL model , 1998 .

[31]  T. Landauer,et al.  A Solution to Plato's Problem: The Latent Semantic Analysis Theory of Acquisition, Induction, and Representation of Knowledge. , 1997 .

[32]  Rolf A. Zwaan,et al.  Spatial iconicity affects semantic relatedness judgments , 2003, Psychonomic bulletin & review.

[33]  Ping Li,et al.  Early lexical development in a self-organizing neural network , 2004, Neural Networks.

[34]  M. Marelli,et al.  Somatic and visceral effects of word valence, arousal and concreteness in a continuum lexical space , 2019, Scientific Reports.

[35]  P. Niedenthal,et al.  Dynamic grounding of emotion concepts , 2018, Philosophical Transactions of the Royal Society B: Biological Sciences.

[36]  Surya Ganguli,et al.  A mathematical theory of semantic development in deep neural networks , 2018, Proceedings of the National Academy of Sciences.

[37]  M. Brysbaert,et al.  Norms of valence and arousal for 14,031 Spanish words , 2016, Behavior Research Methods.

[38]  Max M. Louwerse,et al.  Knowing the Meaning of a Word by the Linguistic and Perceptual Company It Keeps , 2018, Top. Cogn. Sci..

[39]  J. Binder In defense of abstract conceptual representations , 2016, Psychonomic Bulletin & Review.

[40]  D. Marocco,et al.  Manipulating Objects and Telling Words: A Study on Concrete and Abstract Words Acquisition , 2011, Front. Psychology.

[41]  Gabriel Recchia,et al.  In defense of spatial models of semantic representation , 2017, New Ideas in Psychology.

[42]  V. Sloutsky,et al.  Categories, concepts, and conceptual development , 2019, Language, cognition and neuroscience.

[43]  Michael N. Jones,et al.  Redundancy in Perceptual and Linguistic Experience: Comparing Feature-Based and Distributional Models of Semantic Representation , 2010, Top. Cogn. Sci..

[44]  Peter W. Foltz,et al.  Models of Vocabulary Acquisition: Direct Tests and Text-Derived Simulations of Vocabulary Growth , 2014 .

[45]  Eiling Yee,et al.  Abstraction and concepts: when, how, where, what and why? , 2019, Language, Cognition and Neuroscience.

[46]  Penny M. Pexman,et al.  The role of embodiment in conceptual development , 2019 .

[47]  Andy P Field,et al.  The verbal information pathway to fear and heart rate changes in children. , 2007, Journal of child psychology and psychiatry, and allied disciplines.

[48]  F. Binkofski,et al.  The challenge of abstract concepts. , 2017, Psychological bulletin.

[49]  Xiaoping P. Hu,et al.  fMRI evidence for word association and situated simulation in conceptual processing , 2008, Journal of Physiology-Paris.

[50]  I. Johnsrude,et al.  Somatotopic Representation of Action Words in Human Motor and Premotor Cortex , 2004, Neuron.

[51]  Charles P. Davis,et al.  Building semantic memory from embodied and distributional language experience. , 2021, Wiley interdisciplinary reviews. Cognitive science.

[52]  Geoff Hollis,et al.  Extrapolating human judgments from skip-gram vector representations of word meaning , 2017, Quarterly journal of experimental psychology.

[53]  Yoed N. Kenett,et al.  Cognitive Network Science: A Review of Research on Cognition through the Lens of Network Representations, Processes, and Dynamics , 2018, Complex..

[54]  Alessandra Vergallito,et al.  Images of the unseen: extrapolating visual representations for abstract and concrete words in a data-driven computational model. , 2020, Psychological research.

[55]  S. Lewandowsky,et al.  Computational Models as Aids to Better Reasoning in Psychology , 2010 .

[56]  Mahesh Srinivasan,et al.  Quantifying Lexical Ambiguity in Speech To and From English-Learning Children , 2021 .

[57]  Joshua B. Tenenbaum,et al.  The Large-Scale Structure of Semantic Networks: Statistical Analyses and a Model of Semantic Growth , 2001, Cogn. Sci..

[58]  Stevan Harnad,et al.  Symbol grounding problem , 1990, Scholarpedia.

[59]  Matteo Palmonari,et al.  Training Temporal Word Embeddings with a Compass , 2019, AAAI.

[60]  Chris Sinha,et al.  Symbol Grounding or the Emergence of Symbols? Vocabulary Growth in Children and a Connectionist Net , 1992 .

[61]  R. Olmos,et al.  Redundancy, isomorphism, and propagative mechanisms between emotional and amodal representations of words: A computational study , 2020, Memory & Cognition.

[62]  Curt Burgess,et al.  INVITED REPLY Theory and Operational Definitions in Computational Memory Models: A Response to Glenberg and Robertson , 2000 .

[63]  R. Lande Statistics and partitioning of species diversity, and similarity among multiple communities , 1996 .

[64]  Thomas K. Landauer Latent Semantic Analysis (LSA), a disembodied learning machine, acquires human word meaning vicariously from language alone , 1999 .

[65]  Ken McRae,et al.  Abstract Concepts and Pictures of Real-World Situations Activate One Another , 2018, Top. Cogn. Sci..

[66]  Albert Costa,et al.  The effect of foreign language in fear acquisition , 2018, Scientific Reports.

[67]  Jure Leskovec,et al.  Diachronic Word Embeddings Reveal Statistical Laws of Semantic Change , 2016, ACL.

[68]  S. Cappa,et al.  The neural representation of abstract words: the role of emotion. , 2014, Cerebral cortex.

[69]  M. Louwerse,et al.  Neurological Evidence Linguistic Processes Precede Perceptual Simulation in Conceptual Processing , 2012, Front. Psychology.

[70]  Jeffrey L. Elman,et al.  Finding Structure in Time , 1990, Cogn. Sci..

[71]  Dirk U. Wulff,et al.  New Perspectives on the Aging Lexicon , 2019, Trends in Cognitive Sciences.

[72]  Barbara Kaup,et al.  Symbol Grounding Without Direct Experience: Do Words Inherit Sensorimotor Activation From Purely Linguistic Context? , 2018, Cognitive science.

[73]  Falk Huettig,et al.  Six Challenges for Embodiment Research , 2019, Current Directions in Psychological Science.

[74]  Danielle S. McNamara,et al.  Handbook of latent semantic analysis , 2007 .

[75]  J. Elman Learning and development in neural networks: the importance of starting small , 1993, Cognition.

[76]  W. Kintsch The role of knowledge in discourse comprehension: a construction-integration model. , 1988, Psychological review.

[77]  Max M. Louwerse,et al.  Symbol Interdependency in Symbolic and Embodied Cognition , 2011, Top. Cogn. Sci..

[78]  Benoît Lemaire,et al.  Effects of High-Order Co-occurrences on Word Semantic Similarities , 2006, ArXiv.

[79]  Ricardo Olmos,et al.  Word maturity indices with latent semantic analysis: why, when, and where is Procrustes rotation applied? , 2018, Wiley interdisciplinary reviews. Cognitive science.

[80]  I. Fraga,et al.  Spanish affective normative data for 1,406 words rated by children and adolescents (SANDchild) , 2020, Behavior Research Methods.

[81]  Federico Da Rold Defining embodied cognition: The problem of situatedness , 2018 .

[82]  David M. Sidhu,et al.  Sensitivity to emotion information in children’s lexical processing , 2018, Cognition.

[83]  Markus J. Hofmann,et al.  If You Don't Have Valence, Ask Your Neighbor: Evaluation of Neutral Words as a Function of Affective Semantic Associates , 2017, Front. Psychol..

[84]  R. Olmos,et al.  How lexical ambiguity distributes activation to semantic neighbors: Some possible consequences within a computational framework , 2014 .

[85]  Hui Xiong,et al.  Dynamic Word Embeddings for Evolving Semantic Discovery , 2017, WSDM.