SemEval-2017 Task 7: Detection and Interpretation of English Puns

A pun is a form of wordplay in which a word suggests two or more meanings by exploiting polysemy, homonymy, or phonological similarity to another word, for an intended humorous or rhetorical effect.  Though a recurrent and expected feature in many discourse types, puns stymie traditional approaches to computational lexical semantics because they violate their one-sense-per-context assumption.  This paper describes the first competitive evaluation for the automatic detection, location, and interpretation of puns.  We describe the motivation for these tasks, the evaluation methods, and the manually annotated data set.  Finally, we present an overview and discussion of the participating systems' methodologies, resources, and results.

[1]  Yehoshua Bar-Hillel,et al.  The Present Status of Automatic Translation of Languages , 1960, Adv. Comput..

[2]  Leopold Wurth Das Wortspiel bei Shakspere , 1964 .

[3]  Fred J. Damerau,et al.  A technique for computer detection and correction of spelling errors , 1964, CACM.

[4]  Vladimir I. Levenshtein,et al.  Binary codes capable of correcting deletions, insertions, and reversals , 1965 .

[5]  Klaus Krippendorff,et al.  Content Analysis: An Introduction to Its Methodology , 1980 .

[6]  Victor Raskin,et al.  Semantic mechanisms of humor , 1984 .

[7]  Frankie Rubinstein A Dictionary of Shakespeare's Sexual Puns and Their Significance , 1984 .

[8]  Michael E. Lesk,et al.  Automatic sense disambiguation using machine readable dictionaries: how to tell a pine cone from an ice cream cone , 1986, SIGDOC '86.

[9]  V. Raskin,et al.  Script theory revis(it)ed: joke similarity and joke representation model , 1991 .

[10]  George A. Miller,et al.  A Semantic Concordance , 1993, HLT.

[11]  S. Attardo Linguistic theories of humor , 1994 .

[12]  Kim Binsted,et al.  An Implemented Model of Punning Riddles , 1994, AAAI.

[13]  K. Binsted,et al.  Computational rules for generating punning riddles , 1997 .

[14]  Clifford Nass,et al.  Effects of Humor in Task-Oriented Human-Computer Interaction and Computer-Mediated Communication: A Direct Test of SRCT Theory , 1999, Hum. Comput. Interact..

[15]  T. Yokogawa,et al.  Japanese pun analyzer using articulation similarities , 2002, 2002 IEEE World Congress on Computational Intelligence. 2002 IEEE International Conference on Fuzzy Systems. FUZZ-IEEE'02. Proceedings (Cat. No.02CH37291).

[16]  Christian F. Hempelmann Paronomasic puns: Target recoverability towards automatic generation , 2003 .

[17]  Julia Taylor Rayz,et al.  Computationally Recognizing Wordplay in Jokes , 2004 .

[18]  T. Schröter Shun the Pun, Rescue the Rhyme? : The Dubbing and Subtitling of Language Play in Film , 2005 .

[19]  Hinrich Schütze,et al.  Introduction to information retrieval , 2008 .

[20]  Graeme Ritchie,et al.  Computational Mechanisms for Pun Generation , 2005, ENLG.

[21]  Rebecca J. Passonneau,et al.  Measuring Agreement on Set-valued Items (MASI) for Semantic and Pragmatic Annotation , 2006, LREC.

[22]  Hwee Tou Ng,et al.  Evaluation of WSD Systems , 2007 .

[23]  V. Raskin The Primer of Humor Research , 2008 .

[24]  Christian F. Hempelmann Computational humor: Beyond the pun? , 2008 .

[25]  S. Keller The development of Shakespeare's rhetoric : a study of nine plays , 2009 .

[26]  Ruli Manurung,et al.  Evaluating the STANDUP Pun Generating Software with Children with Cerebral Palsy , 2009, TACC.

[27]  Julia Taylor Rayz,et al.  How to Understand and Assess a Theory: The Evolution of the SSTH into the GTVH and Now into the OSTH , 2009 .

[28]  Ethel Ong,et al.  Automatically Extracting Word Relationships as Templates for Pun Generation , 2009 .

[29]  S. Attardo 2 The Linear Organization of the Joke , 2009 .

[30]  Christopher D. Manning,et al.  Introduction to Information Retrieval , 2010, J. Assoc. Inf. Sci. Technol..

[31]  S. Kawahara Papers on Japanese imperfect puns , 2010 .

[32]  Carlo Strapparava,et al.  Computational Models for Incongruity Detection in Humour , 2010, CICLing.

[33]  Iryna Gurevych,et al.  Automatic disambiguation of English puns , 2015, ACL.

[34]  Roger Levy,et al.  A Computational Model of Linguistic Humor in Puns , 2015, Cogn. Sci..

[35]  Tristan Miller Adjusting Sense Representations for Word Sense Disambiguation and Automatic Pun Interpretation , 2016 .

[36]  Tristan Miller,et al.  Towards the automatic detection and identification of English puns , 2016 .

[37]  Encarna Segarra,et al.  ELiRF-UPV at SemEval-2017 Task 7: Pun Detection and Interpretation , 2017, SemEval@ACL.

[38]  Man Lan,et al.  ECNU at SemEval-2017 Task 7: Using Supervised and Unsupervised Methods to Detect and Locate English Puns , 2017, SemEval@ACL.

[39]  Tony Veale,et al.  Idiom Savant at Semeval-2017 Task 7: Detection and Interpretation of English Puns , 2017, SemEval@ACL.

[40]  Dipankar Das,et al.  JU CSE NLP $@$ SemEval 2017 Task 7: Employing Rules to Detect and Interpret English Puns , 2017, SemEval@ACL.

[41]  Elena Mikhalkova,et al.  PunFields at SemEval-2017 Task 7: Employing Roget's Thesaurus in Automatic Pun Recognition and Interpretation , 2017, SemEval@ACL.

[42]  Dieke Oele,et al.  BuzzSaw at SemEval-2017 Task 7: Global vs. Local Context for Interpreting and Locating Homographic English Puns with Sense Embeddings , 2017, SemEval@ACL.

[43]  Özge Sevgili,et al.  N-Hance at SemEval-2017 Task 7: A Computational Approach using Word Association for Puns , 2017, SemEval@ACL.

[44]  Debra Aarons Puns and Tacit Linguistic Knowledge , 2017 .

[45]  Ankit Vadehra UWAV at SemEval-2017 Task 7: Automated feature-based system for locating puns , 2017, SemEval@ACL.

[46]  Olga Vechtomova UWaterloo at SemEval-2017 Task 7: Locating the Pun Using Syntactic Characteristics and Corpus-based Metrics , 2017, SemEval@ACL.

[47]  Ted Pedersen Duluth at SemEval-2017 Task 7 : Puns Upon a Midnight Dreary, Lexical Semantics for the Weak and Weary , 2017, SemEval@ACL.

[48]  Vijayasaradhi Indurthi,et al.  Fermi at SemEval-2017 Task 7: Detection and Interpretation of Homographic puns in English Language , 2017, SemEval@ACL.

[49]  Christian F. Hempelmann,et al.  Puns : Taxonomy and Phonology , 2017 .