Negated Adjectives and Antonyms in Distributional Semantics: not similar?

We investigate the relation between negated adjectives and antonyms pairs in English (e.g., not cold vs. hot - cold) using Distributional Semantics. We build vector representations of a set of antonyms and their negations on the basis of their contexts of use, and compare the similarities of the negated adjectives to each of the adjective in their antonym pair. We find that in a distributional semantic model a negated adjective (e.g., not cold) is typically more similar to the adjective itself (cold) than to its antonym (hot). The effect is less strong for antonyms that share their lexical root (morphological; e.g., happy - unhappy). No difference is observed between simple and double negations (e.g., not happy, not unhappy), and contrary and contradictory antonyms (e.g., hot - cold, dead - alive). Our results provides insights on negated adjectives, and in general the type of similarity captured by Distributional Semantics.

[1]  Michael Franke,et al.  Not unreasonable: Carving vague dimensions with contraries and contradictions , 2018, CogSci.

[2]  Douwe Kiela,et al.  Learning to Negate Adjectives with Bilinear Models , 2017, EACL.

[3]  Vu,et al.  Building a Dictionary of Affixal Negations , 2016 .

[4]  Raffaella Bernardi,et al.  There Is No Logical Negation Here, But There Are Alternatives: Modeling Conversational Negation with Distributional Semantics , 2016, Computational Linguistics.

[5]  Gemma Boleda,et al.  Formal Distributional Semantics: Introduction to the Special Issue , 2016, CL.

[6]  Ngoc Thang Vu,et al.  Integrating Distributional Lexical Contrast into Word Embeddings for Antonym-Synonym Distinction , 2016, ACL.

[7]  Tim Oates,et al.  A Gold Standard for Scalar Adjectives , 2016, LREC.

[8]  David Abend,et al.  Semantic Relations And The Lexicon Antonymy Synonymy And Other Paradigms , 2016 .

[9]  Bart Geurts,et al.  Scalar Diversity , 2016, J. Semant..

[10]  Angeliki Lazaridou,et al.  A Multitask Objective to Inject Lexical Contrast into Distributional Semantics , 2015, ACL.

[11]  Georgiana Dinu,et al.  Don’t count, predict! A systematic comparison of context-counting vs. context-predicting semantic vectors , 2014, ACL.

[12]  Katrin Erk,et al.  A Formal Approach to Linking Logical Form and Vector-Space Lexical Semantics , 2014 .

[13]  Elia Bruni,et al.  Multimodal Distributional Semantics , 2014, J. Artif. Intell. Res..

[14]  Raffaella Bernardi,et al.  Distributional Semantics: A Montagovian View , 2014, Categories and Types in Logic, Language, and Physics.

[15]  Marco Baroni,et al.  Composition in Distributional Semantics , 2013, Lang. Linguistics Compass.

[16]  Marie-Catherine de Marneffe,et al.  Deriving Adjectival Scales from Continuous Space Word Representations , 2013, EMNLP.

[17]  Christopher Potts,et al.  Recursive Deep Models for Semantic Compositionality Over a Sentiment Treebank , 2013, EMNLP.

[18]  Graeme Hirst,et al.  Computing Lexical Contrast , 2013, CL.

[19]  Phil Blunsom,et al.  “Not not bad” is not “bad”: A distributional account of negation , 2013, CVSM@ACL.

[20]  Sara Berlanda Constructional Intensifying Adjectives in Italian , 2013, MWE@NAACL-HLT.

[21]  Jeffrey Dean,et al.  Efficient Estimation of Word Representations in Vector Space , 2013, ICLR.

[22]  Katrin Erk,et al.  Vector Space Models of Word Meaning and Phrase Meaning: A Survey , 2012, Lang. Linguistics Compass.

[23]  Andrew Y. Ng,et al.  Semantic Compositionality through Recursive Matrix-Vector Spaces , 2012, EMNLP.

[24]  Roser Morante,et al.  Modality and Negation: An Introduction to the Special Issue , 2012, CL.

[25]  Shrikant Joshi Affixal Negation – Direct, Indirect and their Subtypes , 2012 .

[26]  Dietrich Klakow,et al.  A survey on the role of negation in sentiment analysis , 2010, NeSp-NLP@ACL.

[27]  Patrick Pantel,et al.  From Frequency to Meaning: Vector Space Models of Semantics , 2010, J. Artif. Intell. Res..

[28]  Stephen Clark,et al.  Mathematical Foundations for a Compositional Distributional Model of Meaning , 2010, ArXiv.

[29]  Martin Hackl,et al.  On the grammar and processing of proportional quantifiers: most versus more than half , 2009 .

[30]  Silvia Bernardini,et al.  The WaCky wide web: a collection of very large linguistically processed web-crawled corpora , 2009, Lang. Resour. Evaluation.

[31]  Tamar Fraenkel,et al.  The meaning of negated adjectives , 2008 .

[32]  Alessandro Lenci,et al.  Distributional semantics in linguistic and cognitive research , 2008 .

[33]  U. Sauerland,et al.  Presupposition and Implicature in Compositional Semantics , 2007 .

[34]  M. Kritka Negated Antonyms: Creating and Filling the Gap , 2007 .

[35]  R. Giora Anything negatives can do affirmatives can do just as well, except for some metaphors , 2006 .

[36]  Carita Paradis,et al.  Antonymy and negation—The boundedness hypothesis , 2006 .

[37]  Siobhan Chapman Logic and Conversation , 2005 .

[38]  S. Peters,et al.  Word Vectors and Quantum Logic Experiments with negation and disjunction , 2003 .

[39]  Christiane Fellbaum,et al.  Book Reviews: WordNet: An Electronic Lexical Database , 1999, CL.

[40]  E. Clark Conventionality and contrast: Pragmatic principles with lexical consequences. , 1992 .

[41]  Alexis Kalokerinos A natural history of negation , 1991 .

[42]  D. Schiffrin Meaning, form, and use in context : linguistic applications , 1984 .

[43]  Paul Kiparsky,et al.  Word-formation and the lexicon , 1982 .

[44]  Herbert H. Clark,et al.  Semantics and comprehension , 1976 .

[45]  Laurence R. Horn,et al.  On the semantic properties of logical operators in english' reproduced by the indiana university lin , 1972 .

[46]  Otto Jespersen,et al.  The Philosophy of Grammar , 1924 .