Short-Term Meaning Shift: A Distributional Exploration

We present the first exploration of meaning shift over short periods of time in online communities using distributional representations. We create a small annotated dataset and use it to assess the performance of a standard model for meaning shift detection on short-term meaning shift. We find that the model has problems distinguishing meaning shift from referential phenomena, and propose a measure of contextual variability to remedy this.

[1]  Etienne Wenger,et al.  Communities of Practice: Learning, Meaning, and Identity , 1998 .

[2]  Mirella Lapata,et al.  A Bayesian Model of Diachronic Meaning Change , 2016, TACL.

[3]  P. Werth.  Extended Metaphor—a Text-World Account , 1994 .

[4]  Jon M. Kleinberg,et al.  Competition and Selection Among Conventions , 2017, WWW.

[5]  Dustin Arendt,et al.  Intrinsic and Extrinsic Evaluation of Spatiotemporal Text Representations in Twitter Streams , 2017, Rep4NLP@ACL.

[6]  Marco Baroni,et al.  A distributional similarity approach to the detection of semantic change in the Google Books Ngram corpus. , 2011, GEMS.

[7]  Malvina Nissim,et al.  Tracing Metaphors in Time through Self-Distance in Vector Spaces , 2016, CLiC-it/EVALITA.

[8]  Jacob Eisenstein,et al.  Making "fetch" happen: The influence of social and linguistic context on the success of lexical innovations , 2017, ArXiv.

[9]  Xuri Tang,et al.  A state-of-the-art of semantic change computation , 2018, Natural Language Engineering.

[10]  J. Lemke,et al.  Semantic Variation: Meaning in Society and in Sociolinguistics , 2009 .

[11]  Slav Petrov,et al.  Temporal Analysis of Language through Neural Language Models , 2014, LTCSS@ACL.

[12]  Kevin Duh,et al.  A framework for analyzing semantic change of words across time , 2014, IEEE/ACM Joint Conference on Digital Libraries.

[13]  Zellig S. Harris,et al.  Distributional Structure , 1954 .

[14]  Steven Skiena,et al.  Statistically Significant Detection of Linguistic Change , 2014, WWW.

[15]  付伶俐.  打磨Using Language,倡导新理念 , 2014 .

[16]  Jure Leskovec,et al.  No country for old members: user lifecycle and linguistic change in online communities , 2013, WWW.

[17]  D. Wijaya,et al.  Understanding semantic change of words over centuries , 2011, DETECT '11.

[18]  Maarten Marx,et al.  UvA-DARE (Digital Academic Repository) Words are Malleable: Computing Semantic Shifts in Political and Media Discourse , 2017 .

[19]  Terrence Szymanski,et al.  Temporal Word Analogies: Identifying Lexical Replacement with Diachronic Word Embeddings , 2017, ACL.

[20]  Omer Levy,et al.  Improving Distributional Similarity with Lessons Learned from Word Embeddings , 2015, TACL.

[21]  Ron Artstein,et al.  Survey Article: Inter-Coder Agreement for Computational Linguistics , 2008, CL.

[22]  Raquel Fernández,et al.  Semantic Variation in Online Communities of Practice , 2018, IWCS.

[23]  Jeffrey Dean,et al.  Distributed Representations of Words and Phrases and their Compositionality , 2013, NIPS.

[24]  Jure Leskovec,et al.  Diachronic Word Embeddings Reveal Statistical Laws of Semantic Change , 2016, ACL.

[25]  Erik Velldal,et al.  Diachronic word embeddings and semantic shifts: a survey , 2018, COLING.

[26]  H. H. Clark,et al.  Conceptual pacts and lexical choice in conversation. , 1996, Journal of experimental psychology. Learning, memory, and cognition.

[27]  Raquel Fernández,et al.  The Road to Success: Assessing the Fate of Linguistic Innovations in Online Communities , 2018, COLING.

[28]  Eyal Sagi,et al.  Tracing semantic change with latent semantic analysis , 2011 .