Neural Metaphor Detection with Visibility Embeddings

We present new results for the problem of sequence metaphor labeling, using the recently developed Visibility Embeddings. We show that concatenating such embeddings to the input of a BiLSTM obtains consistent and significant improvements at almost no cost, and we present further improved results when visibility embeddings are combined with BERT.

[1]  Beata Beigman Klebanov,et al.  Go Figure! Multi-task transformer-based architecture for metaphor detection using idioms: ETS team in 2020 metaphor shared task , 2020, FIGLANG.

[2]  Frank Guerin,et al.  End-to-End Sequential Metaphor Identification Inspired by Linguistic Theories , 2019, ACL.

[3]  Min Zhang,et al.  Improving Language Model Size Reduction using Better Pruning Criteria , 2002, ACL.

[4]  Ryan Cotterell,et al.  Metaphor Detection using Context and Concreteness , 2020, FIGLANG.

[5]  Chuhan Wu,et al.  Neural Metaphor Detecting with CNN-LSTM Model , 2018, Fig-Lang@NAACL-HLT.

[6]  Antoni Oliver,et al.  Neural Metaphor Detection with a Residual biLSTM-CRF Model , 2020, Fig-Lang@ACL.

[7]  Chu-Ren Huang,et al.  Using Conceptual Norms for Metaphor Detection , 2020, Fig-Lang@ACL.

[8]  Jinhui Zhang,et al.  ALBERT-BiLSTM for Sequential Metaphor Detection , 2020, Fig-Lang@ACL.

[9]  G. Lakoff,et al.  Metaphors We Live by , 1982 .

[10]  James Pustejovsky,et al.  Improving Neural Metaphor Detection with Visual Datasets , 2020, LREC.

[11]  Pietro Perona,et al.  Microsoft COCO: Common Objects in Context , 2014, ECCV.

[12]  Ekaterina Shutova,et al.  Grasping the Finer Point: A Supervised Similarity Network for Metaphor Detection , 2017, EMNLP.

[13]  Peter Young,et al.  From image descriptions to visual denotations: New similarity metrics for semantic inference over event descriptions , 2014, TACL.

[14]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[15]  A. G. Dorst,et al.  Metaphor in usage , 2010 .

[16]  Fumiyo Fukumoto,et al.  DeepMet: A Reading Comprehension Paradigm for Token-level Metaphor Detection , 2020, FIGLANG.

[17]  Jeffrey Pennington,et al.  GloVe: Global Vectors for Word Representation , 2014, EMNLP.

[18]  Luke S. Zettlemoyer,et al.  Deep Contextualized Word Representations , 2018, NAACL.

[19]  Yair Neuman,et al.  Literal and Metaphorical Sense Identification through Concrete and Abstract Context , 2011, EMNLP.

[20]  Saif Mohammad,et al.  Metaphor as a Medium for Emotion: An Empirical Study , 2016, *SEMEVAL.

[21]  Beata Beigman Klebanov,et al.  A Report on the 2018 VUA Metaphor Detection Shared Task , 2018, Fig-Lang@NAACL-HLT.

[22]  Amy Beth Warriner,et al.  Concreteness ratings for 40 thousand generally known English word lemmas , 2014, Behavior research methods.

[23]  Michael S. Bernstein,et al.  Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotations , 2016, International Journal of Computer Vision.

[24]  Marine Carpuat,et al.  Evaluating a Bi-LSTM Model for Metaphor Detection in TOEFL Essays , 2020, Fig-Lang@ACL.

[25]  Harish Tayyar Madabushi,et al.  Augmenting Neural Metaphor Detection with Concreteness , 2020, FIGLANG.

[26]  Pabitra Mitra,et al.  An LSTM-CRF Based Approach to Token-Level Metaphor Detection , 2018, Fig-Lang@NAACL-HLT.

[27]  James Pustejovsky,et al.  Integrating Vision and Language Datasets to Measure Word Concreteness , 2017, IJCNLP.

[28]  Ming-Wei Chang,et al.  BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding , 2019, NAACL.

[29]  Tarun Kumar,et al.  Character aware models with similarity learning for metaphor detection , 2020, Fig-Lang@ACL.

[30]  Alexander Onysko,et al.  Testing the role of metadata in metaphor identification , 2020, FIGLANG.

[31]  Beata Beigman Klebanov,et al.  A Report on the 2020 VUA and TOEFL Metaphor Detection Shared Task , 2020, FIGLANG.

[32]  Cynthia Rudin,et al.  Metaphor Detection Using Contextual Word Embeddings From Transformers , 2020, Fig-Lang@ACL.

[33]  Eunsol Choi,et al.  Neural Metaphor Detection in Context , 2018, EMNLP.

[34]  Luke S. Zettlemoyer,et al.  AllenNLP: A Deep Semantic Natural Language Processing Platform , 2018, ArXiv.

[35]  Martha Lewis,et al.  Modelling the interplay of metaphor and emotion through multitask learning , 2019, EMNLP.

[36]  Yulia Tsvetkov,et al.  Metaphor Detection with Cross-Lingual Model Transfer , 2014, ACL.

[37]  Malgorzata Marciniak,et al.  Detecting Figurative Word Occurrences Using Recurrent Neural Networks , 2018, Fig-Lang@NAACL-HLT.

[38]  Michael Wilson.  MRC Psycholinguistic Database , 2001 .

[39]  Abdou Youssef,et al.  Metaphor Detection using Ensembles of Bidirectional Recurrent Neural Networks , 2020, Fig-Lang@ACL.

[40]  Alexander Onysko,et al.  Using Language Learner Data for Metaphor Detection , 2018, Fig-Lang@NAACL-HLT.

[41]  Anil Kumar Singh,et al.  Di-LSTM Contrast : A Deep Neural Network for Metaphor Detection , 2018, Fig-Lang@NAACL-HLT.

[42]  Sabine Schulte im Walde,et al.  Improving Verb Metaphor Detection by Propagating Abstractness to Words, Phrases and Individual Senses , 2017 .

[43]  Mehdi Ghanimifard,et al.  Bigrams and BiLSTMs Two Neural Networks for Sequential Metaphor Detection , 2018, Fig-Lang@NAACL-HLT.