Semantic change computation: A successive approach

The prevalence of creativity in the emergent online media language calls for more effective computational approach to semantic change. Two divergent metaphysical understandings are found with the task: juxtaposition-view of change and succession-view of change. This paper argues that the succession-view better reflects the essence of semantic change and proposes a successive framework for automatic semantic change detection. The framework analyzes the semantic change at both the word level and the individual-sense level inside a word by transforming the task into change pattern detection over time series data. At the word level, the framework models the word’s semantic change with S-shaped model and successfully correlates change patterns with classical semantic change categories such as broadening, narrowing, new word coining, metaphorical change, and metonymic change. At the sense level, the framework measures the conventionality of individual senses and distinguishes categories of temporary word usage, basic sense, novel sense and disappearing sense, again with S-shaped model. Experiments at both levels yield increased precision rate as compared with the baseline, supporting the succession-view of semantic change.

[1]  C. D. Broad,et al.  Examination of McTaggart's Philosophy , 1938 .

[2]  Graeme Hirst,et al.  Automatic identification of words with novel but infrequent senses , 2011, PACLIC.

[3]  Eyal Sagi,et al.  Semantic Density Analysis: Comparing Word Meaning across Time and Phonetic Space , 2009 .

[4]  Sabine Ploux,et al.  Using Topic Salience and Connotational Drifts to Detect Candidates to Semantic Change , 2011, IWCS.

[5]  S. Ullmann The principles of semantics , 1959 .

[6]  Thomas Mayer,et al.  Towards Tracking Semantic Change by Visual Analytics , 2011, ACL.

[7]  A. Kroch Reflexes of grammar in patterns of language change , 1989, Language Variation and Change.

[8]  Mark Hale,et al.  Historical Linguistics: Theory and Method , 2007 .

[9]  Zellig S. Harris,et al.  Distributional Structure , 1954 .

[10]  Qiang Dong,et al.  Hownet and the Computation of Meaning: (With CD-ROM) , 2006 .

[11]  R. Darnell Translation , 1873, The Indian medical gazette.

[12]  Benjamin W. Fortson,et al.  An Approach to Semantic Change , 2008 .

[13]  Charles James Nice Bailey Variation and linguistic theory , 1973 .

[14]  J. R. Firth,et al.  A Synopsis of Linguistic Theory, 1930-1955 , 1957 .

[15]  Jean Véronis,et al.  HyperLex: lexical cartography for information retrieval , 2004, Comput. Speech Lang..

[16]  W. Labov Principles of Linguistic Change: Internal Factors , 1994 .

[17]  J. P. Postgate,et al.  Semantics: studies in the science of meaning , 1900 .

[18]  Marco Baroni,et al.  A distributional similarity approach to the detection of semantic change in the Google Books Ngram corpus. , 2011, GEMS.

[19]  David Crystal,et al.  Language and the Internet , 2001 .

[20]  Felix Naumann,et al.  Data fusion , 2009, CSUR.

[21]  C. Paul Cook,et al.  Exploiting Linguistic Knowledge to Infer Properties of Neologisms , 2011 .

[22]  Dirk Geeraerts,et al.  Theories of Lexical Semantics , 2010 .

[23]  Mirella Lapata,et al.  Bayesian Word Sense Induction , 2009, EACL.

[24]  R. Lass Historical linguistics and language change , 1997 .

[25]  Peter Geach Truth, love, and immortality: An introduction to McTaggart's philosophy , 1979 .

[26]  Katrin Erk,et al.  Unknown word sense detection as outlier detection , 2006, NAACL.

[27]  Qiang Dong,et al.  Hownet And The Computation Of Meaning , 2006 .

[28]  Ted Dunning,et al.  Accurate Methods for the Statistics of Surprise and Coincidence , 1993, CL.

[29]  Patrick Pantel,et al.  Discovering word senses from text , 2002, KDD.

[30]  Roberto Navigli,et al.  Word sense disambiguation: A survey , 2009, CSUR.

[31]  Korris Fu-Lai Chung,et al.  Determination of Context Window Size , 2001, Int. J. Comput. Process. Orient. Lang..

[32]  Richard B. Dasher,et al.  Regularity in Semantic Change: Index of languages , 2001 .

[33]  C. Osgood,et al.  Psycholinguistics: A Survey of Theory and Research Problems , 1955 .

[34]  Karin Cavallin Automatic extraction of potential examples of semantic change using lexical sets , 2012, KONVENS.

[35]  Timothy Baldwin,et al.  Word Sense Induction for Novel Sense Detection , 2012, EACL.

[36]  E. Traugott,et al.  Semantic Change: Bleaching, Strengthening, Narrowing, Extension , 2006 .

[37]  Kie Zuraw Probability in Language Change , 2002 .

[38]  Theories of meaning change – an overview , 2022 .

[39]  H. H. Hock Principles of historical linguistics , 1986 .

[40]  Björn-Olav Dozo,et al.  Quantitative Analysis of Culture Using Millions of Digitized Books , 2010 .

[41]  Dirk Geeraerts,et al.  Diachronic Prototype Semantics: A Contribution to Historical Lexicology , 1997 .

[42]  Patrick Pantel,et al.  From Frequency to Meaning: Vector Space Models of Semantics , 2010, J. Artif. Intell. Res..

[43]  H. Haken Synergetics: an Introduction, Nonequilibrium Phase Transitions and Self-organization in Physics, Chemistry, and Biology , 1977 .

[44]  Eve Sweetser,et al.  From Etymology to Pragmatics: Preface , 1990 .

[45]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[46]  K. Matsuda,et al.  Constant Rate Hypothesis , 2006 .

[47]  Hinrich Schütze,et al.  Book Reviews: Foundations of Statistical Natural Language Processing , 1999, CL.

[48]  Hans-Peter Kriegel,et al.  A Density-Based Algorithm for Discovering Clusters in Large Spatial Databases with Noise , 1996, KDD.

[49]  Julie Weeds,et al.  Finding Predominant Word Senses in Untagged Text , 2004, ACL.

[50]  James W. Minett,et al.  Computational Studies of Language Evolution , 2003 .

[51]  Brian D. Joseph,et al.  On Language, Change, and Language Change – Or, Of History, Linguistics, and Historical Linguistics , 2008 .

[52]  Henning Andersen,et al.  Understanding linguistic innovations , 1989 .

[53]  Richard A. Davis,et al.  Introduction to time series and forecasting , 1998 .

[54]  W. Labov,et al.  Empirical foundations for a theory of language change , 2014 .

[55]  Stefan Th. Gries,et al.  Assessing frequency changes in multistage diachronic corpora: Applications for historical corpus linguistics and the study of language acquisition , 2009, Lit. Linguistic Comput..

[56]  M. Engelmann The Philosophical Investigations , 2013 .

[57]  Stéphane Robert,et al.  Words and their meanings: Principles of variation and stabilization , 2008 .