A Knowledge Graph Embedding Approach for Metaphor Processing

Metaphor is a figure of speech that describes one thing (a target) by mentioning another thing (a source) in a way that is not literally true. Metaphor understanding is an interesting but challenging problem in natural language processing. This paper presents a novel method for metaphor processing based on knowledge graph (KG) embedding. Conceptually, we abstract the structure of a metaphor as an attribute-dependent relation between the target and the source. Each specific metaphor can be represented as a metaphor triple $(target, attribute, source)$. Therefore, we can model metaphor triples just like modeling fact triples in a KG and exploit KG embedding techniques to learn better representations of concepts, attributes and concept relations. In this way, metaphor interpretation and generation could be seen as KG completion, while metaphor detection could be viewed as a representation learning enhanced concept pair classification problem. Technically, we build a Chinese metaphor KG in the form of metaphor triples based on simile recognition, and also extract concept-attribute collocations to help describe concepts and measure concept relations. We extend the translation-based and the rotation-based KG embedding models to jointly optimize metaphor KG embedding and concept-attribute collocation embedding. Experimental results demonstrate the effectiveness of our method. Simile recognition is feasible for building the metaphor triple resource. The proposed models improve the performance on metaphor interpretation and generation, and the learned representations also benefit nominal metaphor detection compared with strong baselines.

[1]  Tony Veale,et al.  Comprehending and Generating Apt Metaphors: A Web-driven, Case-based Approach to Figurative Language , 2007, AAAI.

[2]  Rui Mao,et al.  Word Embedding and WordNet Based Metaphor Identification and Interpretation , 2018, ACL.

[3]  Jian-Yun Nie,et al.  RotatE: Knowledge Graph Embedding by Relational Rotation in Complex Space , 2018, ICLR.

[4]  G. Lakoff,et al.  Metaphors We Live by , 1982 .

[5]  Lizhen Liu,et al.  Neural Multitask Learning for Simile Recognition , 2018, EMNLP.

[6]  Jeffrey Dean,et al.  Distributed Representations of Words and Phrases and their Compositionality , 2013, NIPS.

[7]  Jean Maillard,et al.  Black Holes and White Rabbits: Metaphor Identification with Visual Features , 2016, NAACL.

[8]  Michael Mohler,et al.  Semantic Signatures for Example-Based Linguistic Metaphor Detection , 2013 .

[9]  Gerard J. Steen,et al.  A method for linguistic metaphor identification : from MIP to MIPVU , 2010 .

[10]  James H. Martin METABANK: A KNOWLEDGE‐BASE OF METAPHORIC LANGUAGE CONVENTIONS , 1994, Comput. Intell..

[11]  Chang Su,et al.  Automatic detection and interpretation of nominal metaphor based on the theory of meaning , 2017, Neurocomputing.

[12]  Jason Weston,et al.  Translating Embeddings for Modeling Multi-relational Data , 2013, NIPS.

[13]  Kuldip K. Paliwal,et al.  Bidirectional recurrent neural networks , 1997, IEEE Trans. Signal Process..

[14]  Jing Li,et al.  Directional Skip-Gram: Explicitly Distinguishing Left and Right Context for Word Embeddings , 2018, NAACL.

[15]  James H. Martin A Computational Model of Metaphor Interpretation , 1990 .

[16]  Qu Wei-guang,et al.  Computation of Chinese Simile with "Xiang" , 2008 .

[17]  Oren Etzioni,et al.  Identifying Relations for Open Information Extraction , 2011, EMNLP.

[18]  Zhiyuan Liu,et al.  Learning Entity and Relation Embeddings for Knowledge Graph Completion , 2015, AAAI.

[19]  Brian F. Bowdle,et al.  Metaphor is like analogy , 2001 .

[20]  Pawel Dybala,et al.  Semantic Clues for Novel Metaphor Generator , 2013 .

[21]  Marilyn A. Walker,et al.  Automatically Inferring Implicit Properties in Similes , 2016, HLT-NAACL.

[22]  Paul Hekkert,et al.  Source Selection in Product Metaphor Generation: The Effects of Salience and Relatedness , 2014 .

[23]  Yair Neuman,et al.  Literal and Metaphorical Sense Identification through Concrete and Abstract Context , 2011, EMNLP.

[24]  Eunsol Choi,et al.  Neural Metaphor Detection in Context , 2018, EMNLP.

[25]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[26]  Iryna Gurevych,et al.  Token-Level Metaphor Detection using Neural Networks , 2016 .

[27]  Matthew D. Zeiler ADADELTA: An Adaptive Learning Rate Method , 2012, ArXiv.

[28]  Khalid Al-Najjar,et al.  Meta4meaning: Automatic Metaphor Interpretation Using Corpus-Derived Word Associations , 2016, ICCC.

[29]  Cristian Danescu-Niculescu-Mizil,et al.  Brighter than Gold: Figurative Language in User Generated Comparisons , 2014, EMNLP.

[30]  Keiga Abe,et al.  A Computational Model of the Metaphor Generation Process , 2006 .

[31]  Zhiyuan Liu,et al.  OpenKE: An Open Toolkit for Knowledge Embedding , 2018, EMNLP.

[32]  Haixun Wang,et al.  Data-Driven Metaphor Recognition and Explanation , 2013, TACL.

[33]  David Yarowsky,et al.  One Sense per Collocation , 1993, HLT.

[34]  Ekaterina Shutova,et al.  Automatic Metaphor Interpretation as a Paraphrasing Task , 2010, NAACL.

[35]  Yulia Tsvetkov,et al.  Metaphor Detection with Cross-Lingual Model Transfer , 2014, ACL.

[36]  A. Ortony Beyond Literal Similarity , 1979 .

[37]  John Bryant,et al.  Catching Metaphors , 2006 .

[38]  Carolyn Penstein Rosé,et al.  Metaphor Detection in Discourse , 2015, SIGDIAL Conference.

[39]  Ekaterina Shutova,et al.  Grasping the Finer Point: A Supervised Similarity Network for Metaphor Detection , 2017, EMNLP.

[40]  Zhen Wang,et al.  Knowledge Graph Embedding by Translating on Hyperplanes , 2014, AAAI.

[41]  Mark Last,et al.  Metaphor Identification in Large Texts Corpora , 2013, PloS one.

[42]  Anna Korhonen,et al.  Metaphor Identification Using Verb and Noun Clustering , 2010, COLING.

[43]  Victoria Yaneva,et al.  Computational considerations of comparisons and similes , 2013, ACL.

[44]  L. K. Tyler,et al.  Conceptual Structure and the Structure of Concepts: A Distributed Account of Category-Specific Deficits , 2000, Brain and Language.

[45]  Vlad Niculae,et al.  Comparison pattern matching and creative simile recognition , 2013, JSSP.

[46]  Andrew McCallum,et al.  Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data , 2001, ICML.

[47]  Jun Zhao,et al.  Knowledge Graph Embedding via Dynamic Mapping Matrix , 2015, ACL.

[48]  Ming-Wei Chang,et al.  BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding , 2019, NAACL.

[49]  Zhendong Mao,et al.  Knowledge Graph Embedding: A Survey of Approaches and Applications , 2017, IEEE Transactions on Knowledge and Data Engineering.

[50]  Jiebo Luo,et al.  Neural Simile Recognition with Cyclic Multitask Learning and Local Attention , 2019, AAAI.

[51]  Lin Sun,et al.  Unsupervised Metaphor Identification Using Hierarchical Graph Factorization Clustering , 2013, NAACL.

[52]  Dan Fass,et al.  met*: A Method for Discriminating Metonymy and Metaphor by Computer , 1991, CL.