Predicting Human Metaphor Paraphrase Judgments with Deep Neural Networks

We propose a new annotated corpus for metaphor interpretation by paraphrase, and a novel DNN model for performing this task. Our corpus consists of 200 sets of 5 sentences, with each set containing one reference metaphorical sentence, and four ranked candidate paraphrases. Our model is trained for a binary classification of paraphrase candidates, and then used to predict graded paraphrase acceptability. It reaches an encouraging 75% accuracy on the binary classification task, and high Pearson (.75) and Spearman (.68) correlations on the gradient judgment prediction task.

[1]  T. Krennmayr.  What Corpus Linguistics Can Tell Us About Metaphor Use In Newspaper Texts , 2015 .

[2]  Jeffrey Dean,et al.  Distributed Representations of Words and Phrases and their Compositionality , 2013, NIPS.

[3]  Saif Mohammad,et al.  Metaphor as a Medium for Emotion: An Empirical Study , 2016, *SEMEVAL.

[4]  Eneko Agirre,et al.  SemEval-2016 Task 1: Semantic Textual Similarity, Monolingual and Cross-Lingual Evaluation , 2016, *SEMEVAL.

[5]  Ekaterina Shutova,et al.  Automatic Metaphor Interpretation as a Paraphrasing Task , 2010, NAACL.

[6]  Shlomo Argamon,et al.  Language-independent ensemble approaches to metaphor identification , 2014, AAAI 2014.

[7]  Jun Zhao,et al.  Recurrent Convolutional Neural Networks for Text Classification , 2015, AAAI.

[8]  Zornitsa Kozareva.  Multilingual Affect Polarity and Valence Prediction in Metaphors , 2015, WASSA@EMNLP.

[9]  Razvan Pascanu,et al.  How to Construct Deep Recurrent Neural Networks , 2013, ICLR.

[10]  Shalom Lappin,et al.  Deep Learning of Binary and Gradient Judgements for Semantic Paraphrase , 2017, IWCS.

[11]  Rodrigo Agerri,et al.  Metaphor in Textual Entailment , 2008, COLING.

[12]  Simone Teufel,et al.  Metaphor Corpus Annotated for Source - Target Domain Mappings , 2010, LREC.

[13]  Tara N. Sainath,et al.  Convolutional, Long Short-Term Memory, fully connected Deep Neural Networks , 2015, 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[14]  Danushka Bollegala,et al.  Metaphor Interpretation Using Paraphrases Extracted from the Web , 2013, PloS one.

[15]  Chris Callison-Burch,et al.  SemEval-2015 Task 1: Paraphrase and Semantic Similarity in Twitter (PIT) , 2015, *SEMEVAL.

[16]  Iasonas Kokkinos,et al.  DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  K. Robert Lai,et al.  Dimensional Sentiment Analysis Using a Regional CNN-LSTM Model , 2016, ACL.