Conversational Negation using Worldly Context in Compositional Distributional Semantics

We propose a framework to model an operational conversational negation by applying worldly context (prior knowledge) to logical negation in compositional distributional semantics. Given a word, our framework can create its negation that is similar to how humans perceive negation. The framework corrects logical negation to weight meanings closer in the entailment hierarchy more than meanings further apart. The proposed framework is flexible to accommodate different choices of logical negations, compositions, and worldly context generation. In particular, we propose and motivate a new logical negation using matrix inverse. We validate the sensibility of our conversational negation framework by performing experiments, leveraging density matrices to encode graded entailment information. We conclude that the combination of subtraction negation and phaser in the basis of the negated word yields the highest Pearson correlation of 0.635 with human ratings.

[1]  Laurence R. Horn,et al.  On the semantic properties of logical operators in english' reproduced by the indiana university lin , 1972 .

[2]  Martha Lewis,et al.  Graded hyponymy for compositional distributional semantics , 2018, J. Lang. Model..

[3]  Christiane Fellbaum,et al.  Book Reviews: WordNet: An Electronic Lexical Database , 1999, CL.

[4]  Martha Lewis,et al.  Cats climb entails mammals move: preserving hyponymy in compositional distributional semantics , 2020, ArXiv.

[5]  S. Peters,et al.  Word Vectors and Quantum Logic Experiments with negation and disjunction , 2003 .

[6]  M. Oaksford Contrast classes and matching bias as explanations of the effects of negation on conditional reasoning , 2002 .

[7]  Samson Abramsky,et al.  A categorical semantics of quantum protocols , 2004, Proceedings of the 19th Annual IEEE Symposium on Logic in Computer Science, 2004..

[8]  Ordering quantum states and channels based on positive Bayesian evidence , 2017, 1702.01634.

[9]  Marti A. Hearst Automatic Acquisition of Hyponyms from Large Text Corpora , 1992, COLING.

[10]  John Clibbens,et al.  The Role of Implicit and Explicit Negation in Conditional Reasoning Bias , 1996 .

[11]  Dimitri Kartsaklis,et al.  Open System Categorical Quantum Semantics in Natural Language Processing , 2015, CALCO.

[12]  Bob Coecke,et al.  The Mathematics of Text Structure , 2019, Joachim Lambek: The Interplay of Mathematics, Logic, and Linguistics.

[13]  Martha Lewis,et al.  Compositional Hyponymy with Positive Operators , 2019, RANLP.

[14]  Stephen Roller,et al.  Hearst Patterns Revisited: Automatic Hypernym Detection from Large Text Corpora , 2018, ACL.

[15]  Mehrnoosh Sadrzadeh,et al.  Distributional Sentence Entailment Using Density Matrices , 2015, TTCS.

[16]  Martha Lewis,et al.  Interacting Conceptual Spaces I : Grammatical Composition of Concepts , 2017, Conceptual Spaces: Elaborations and Applications.

[17]  Bob Coecke,et al.  Foundations for Near-Term Quantum Natural Language Processing , 2020, ArXiv.

[18]  Mahmoud Naghibzadeh,et al.  Semantic similarity assessment of words using weighted WordNet , 2014, Int. J. Mach. Learn. Cybern..

[19]  J. Prado,et al.  How reaction times can elucidate matching effects and the processing of negation , 2006 .

[20]  Mehrnoosh Sadrzadeh,et al.  Experimental Support for a Categorical Compositional Distributional Model of Meaning , 2011, EMNLP.

[21]  Bob Coecke,et al.  Meaning updating of density matrices , 2020, FLAP.

[22]  Jordan L. Boyd-Graber,et al.  Adding dense, weighted connections to WordNet , 2005 .

[23]  Martha Lewis,et al.  Towards logical negation for compositional distributional semantics , 2020, FLAP.

[24]  Phil Blunsom,et al.  “Not not bad” is not “bad”: A distributional account of negation , 2013, CVSM@ACL.

[25]  Friedrich Pukelsheim,et al.  Some properties of matrix partial orderings , 1989 .

[26]  Raffaella Bernardi,et al.  There Is No Logical Negation Here, But There Are Alternatives: Modeling Conversational Negation with Distributional Semantics , 2016, Computational Linguistics.

[27]  Jeffrey Pennington,et al.  GloVe: Global Vectors for Word Representation , 2014, EMNLP.

[28]  Stephen Clark,et al.  Mathematical Foundations for a Compositional Distributional Model of Meaning , 2010, ArXiv.