Metaphor Detection using Deep Contextualized Word Embeddings

Metaphors are ubiquitous in natural language, and their detection plays an essential role in many natural language processing tasks, such as language understanding, sentiment analysis, etc. Most existing approaches for metaphor detection rely on complex, hand-crafted and fine-tuned feature pipelines, which greatly limit their applicability. In this work, we present an end-to-end method composed of deep contextualized word embeddings, bidirectional LSTMs and multi-head attention mechanism to address the task of automatic metaphor detection. Our method, unlike many other existing approaches, requires only the raw text sequences as input features to detect the metaphoricity of a phrase. We compare the performance of our method against the existing baselines on two benchmark datasets, TroFi, and MOH-X respectively. Experimental evaluations confirm the effectiveness of our approach.

[1]  George A. Miller,et al.  WordNet: A Lexical Database for English , 1995, HLT.

[2]  Anoop Sarkar,et al.  A Clustering Approach for Nearly Unsupervised Recognition of Nonliteral Language , 2006, EACL.

[3]  Iryna Gurevych,et al.  Token-Level Metaphor Detection using Neural Networks , 2016 .

[4]  Ivan Bondarenko,et al.  Conditional Random Fields for Metaphor Detection , 2018, Fig-Lang@NAACL-HLT.

[5]  Yair Neuman,et al.  Literal and Metaphorical Sense Identification through Concrete and Abstract Context , 2011, EMNLP.

[6]  Luke S. Zettlemoyer,et al.  Deep Contextualized Word Representations , 2018, NAACL.

[7]  Helen Yannakoudakis,et al.  Learning Outside the Box: Discourse-level Features Improve Metaphor Identification , 2019, NAACL.

[8]  Eunsol Choi,et al.  Neural Metaphor Detection in Context , 2018, EMNLP.

[9]  Zachary J. Mason CorMet: A Computational, Corpus-Based Conventional Metaphor Extraction System , 2004, CL.

[10]  Yulia Tsvetkov,et al.  Cross-Lingual Metaphor Detection Using Common Semantic Features , 2013 .

[11]  Ralph Weischedel,et al.  Automatic Extraction of Linguistic Metaphors with LDA Topic Modeling , 2013 .

[12]  Anna Korhonen,et al.  Metaphor Identification Using Verb and Noun Clustering , 2010, COLING.

[13]  Sabine Schulte im Walde,et al.  Improving Verb Metaphor Detection by Propagating Abstractness to Words, Phrases and Individual Senses , 2017 .

[14]  Tsuyoshi Murata,et al.  {m , 1934, ACML.

[15]  G. Lakoff,et al.  Conceptual Metaphor in Everyday Language , 1980, Shaping Entrepreneurship Research.

[16]  John Bryant,et al.  Catching Metaphors , 2006 .

[17]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[18]  Dan Fass,et al.  met*: A Method for Discriminating Metonymy and Metaphor by Computer , 1991, CL.

[20]  Saif Mohammad,et al.  Metaphor as a Medium for Emotion: An Empirical Study , 2016, *SEMEVAL.

[21]  Xiaojin Zhu,et al.  Hunting Elusive Metaphors Using Lexical Resources. , 2007 .

[22]  Mehdi Ghanimifard,et al.  Bigrams and BiLSTMs Two Neural Networks for Sequential Metaphor Detection , 2018, Fig-Lang@NAACL-HLT.

[23]  Beata Beigman Klebanov,et al.  Semantic classifications for detection of verb metaphors , 2016, ACL.

[24]  Chuhan Wu,et al.  Neural Metaphor Detecting with CNN-LSTM Model , 2018, Fig-Lang@NAACL-HLT.

[25]  Anil Kumar Singh,et al.  Di-LSTM Contrast : A Deep Neural Network for Metaphor Detection , 2018, Fig-Lang@NAACL-HLT.

[26]  Jean Maillard,et al.  Black Holes and White Rabbits: Metaphor Identification with Visual Features , 2016, NAACL.

[27]  Zhipeng Xie,et al.  BiLSTM-Based Models for Metaphor Detection , 2017, NLPCC.

[28]  Yulia Tsvetkov,et al.  Metaphor Detection with Cross-Lingual Model Transfer , 2014, ACL.

[29]  Ekaterina Shutova,et al.  Grasping the Finer Point: A Supervised Similarity Network for Metaphor Detection , 2017, EMNLP.

[30]  Ming-Wei Chang,et al.  BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding , 2019, NAACL.