A Pinch of Humor for Short-Text Conversation: An Information Retrieval Approach

The paper describes a work in progress on humorous response generation for short-text conversation using information retrieval approach. We gathered a large collection of funny tweets and implemented three baseline retrieval models: BM25, the query term reweighting model based on syntactic parsing and named entity recognition, and the doc2vec similarity model. We evaluated these models in two ways: in situ on a popular community question answering platform and in laboratory settings. The approach proved to be promising: even simple search techniques demonstrated satisfactory performance. The collection, test questions, evaluation protocol, and assessors’ judgments create a ground for future research towards more sophisticated models.

[1]  Haizhou Li,et al.  Making Social Robots More Attractive: The Effects of Voice Pitch, Humor and Empathy , 2013, Int. J. Soc. Robotics.

[2]  Yuriy Brun,et al.  That's What She Said: Double Entendre Identification , 2011, ACL.

[3]  Stephen E. Robertson,et al.  A probabilistic model of information retrieval: development and comparative experiments - Part 2 , 2000, Inf. Process. Manag..

[4]  Mihai Surdeanu,et al.  The Stanford CoreNLP Natural Language Processing Toolkit , 2014, ACL.

[5]  Julia Taylor Rayz,et al.  Computationally Recognizing Wordplay in Jokes , 2004 .

[6]  Hang Li,et al.  An Information Retrieval Approach to Short Text Conversation , 2014, ArXiv.

[7]  Ethel Ong,et al.  Automatically Extracting Word Relationships as Templates for Pun Generation , 2009 .

[8]  Jerome R. Bellegarda,et al.  Spoken Language Understanding for Natural Interaction: The Siri Experience , 2012, Natural Interaction with Robots, Knowbots and Smartphones, Putting Spoken Dialog Systems into Practice.

[9]  Paolo Rosso,et al.  A multidimensional approach for detecting irony in Twitter , 2013, Lang. Resour. Evaluation.

[10]  Quoc V. Le,et al.  Distributed Representations of Sentences and Documents , 2014, ICML.

[11]  Ari Rappoport,et al.  ICWSM - A Great Catchy Name: Semi-Supervised Recognition of Sarcastic Sentences in Online Product Reviews , 2010, ICWSM.

[12]  Hannu Toivonen,et al.  “Let Everything Turn Well in Your Wife”: Generation of Adult Humor Using Lexical Constraints , 2013, ACL.

[13]  Jaana Kekäläinen,et al.  Cumulated gain-based evaluation of IR techniques , 2002, TOIS.

[14]  Reza Zafarani,et al.  Sarcasm Detection on Twitter: A Behavioral Modeling Approach , 2015, WSDM.

[15]  Lada A. Adamic,et al.  Knowledge sharing and yahoo answers: everyone knows something , 2008, WWW.

[16]  Zhoujun Li,et al.  DocChat: An Information Retrieval Approach for Chatbot Engines Using Unstructured Documents , 2016, ACL.

[17]  Graeme Ritchie,et al.  Can Computers Create Humor? , 2009, AI Mag..

[18]  Diyi Yang,et al.  Humor Recognition and Humor Anchor Extraction , 2015, EMNLP.

[19]  Rui Yan,et al.  Learning to Respond with Deep Neural Networks for Retrieval-Based Human-Computer Conversation System , 2016, SIGIR.

[20]  Giovanni Pilato,et al.  Humorist Bot: Bringing Computational Humour in a Chat-Bot System , 2008, 2008 International Conference on Complex, Intelligent and Software Intensive Systems.

[21]  Cade McCall,et al.  Does it matter if a computer jokes , 2011, CHI Extended Abstracts.

[22]  Timothy Baldwin,et al.  An Empirical Evaluation of doc2vec with Practical Insights into Document Embedding Generation , 2016, Rep4NLP@ACL.

[23]  Carlo Strapparava,et al.  Technologies That Make You Smile: Adding Humor to Text-Based Applications , 2006, IEEE Intelligent Systems.

[24]  Carlo Strapparava,et al.  Getting serious about the development of computational humor , 2003, IJCAI 2003.

[25]  Jean Carletta,et al.  Assessing Agreement on Classification Tasks: The Kappa Statistic , 1996, CL.

[26]  Dafna Shahaf,et al.  Inside Jokes: Identifying Humorous Cartoon Captions , 2015, KDD.

[27]  K. Binsted.  Using Humour to Make Natural Language Interfaces More Friendly , 1995 .

[28]  Carlo Strapparava,et al.  LEARNING TO LAUGH (AUTOMATICALLY): COMPUTATIONAL MODELS FOR HUMOR RECOGNITION , 2006, Comput. Intell..

[29]  Rada Mihalcea,et al.  Characterizing Humour: An Exploration of Features in Humorous Texts , 2009, CICLing.

[30]  Renxian Zhang,et al.  Recognizing Humor on Twitter , 2014, CIKM.

[31]  Adam Tauman Kalai,et al.  OMG UR Funny! Computer-Aided Humor with an Application to Chat , 2015, ICCC.