The pitfall of using question detection as a proxy for action inference in natural text conversations: a position paper

Detecting calls to action in natural text conversations, such as emails, chats and instant messages, is a pre-processing step that enables assistive technologies, such as the ones used in virtual assistants and chatbots, to capture and handle human-to-human interactions. Different forms of question detection are often used as a proxy solution for detecting intended actions. In this position paper, we provide empirical evidence that, despite their accuracy in detecting questions, both state-of-the-art industrial and academic question detection technologies are not good proxy solutions for inferring intended actions. We provide empirical data to demonstrate that the problem should be approached differently and as a comparison we present results obtained with a solution derived from our patent pending intention inference technology.

[1]  James F. Allen,et al.  Draft of DAMSL Dialog Act Markup in Several Layers , 2007 .

[2]  A. Kalia Identifying Business Tasks and Commitments from Email and Chat Conversations , 2012 .

[3]  Yoon Kim,et al.  Convolutional Neural Networks for Sentence Classification , 2014, EMNLP.

[4]  Jeffrey Dean,et al.  Efficient Estimation of Word Representations in Vector Space , 2013, ICLR.

[5]  Kathleen McKeown,et al.  Detection of Question-Answer Pairs in Email Conversations , 2004, COLING.

[6]  Elizabeth Shriberg,et al.  The ICSI Meeting Recorder Dialog Act (MRDA) Corpus , 2004, SIGDIAL Workshop.

[7]  George A. Miller,et al.  A Semantic Concordance , 1993, HLT.

[8]  Timothy Baldwin,et al.  Classifying Dialogue Acts in Multi-party Live Chats , 2012, PACLIC.

[9]  Neil Yorke-Smith,et al.  Detection of Imperative and Declarative Question-Answer Pairs in Email Conversations , 2009, IJCAI.

[10]  Mark Steyvers,et al.  Identifying Emotions, Intentions, and Attitudes in Text Using a Game with a Purpose , 2010, HLT-NAACL 2010.

[11]  J. Sadock Speech acts , 2007 .

[12]  Mari Ostendorf,et al.  Question Detection in Spoken Conversations Using Textual Conversations , 2011, ACL.

[13]  Marta Tatu,et al.  Automatic Discovery of Intentions in Text and its Application to Question Answering , 2005, ACL.

[14]  Gary Geunbae Lee,et al.  Semi-supervised Speech Act Recognition in Emails and Forums , 2009, EMNLP.

[15]  Kai Wang,et al.  Exploiting Salient Patterns for Question Detection and Question Retrieval in Community-based Question Answering , 2010, COLING.

[16]  Dan Roth,et al.  Learning question classifiers: the role of semantic information , 2005, Natural Language Engineering.

[17]  Yiming Yang,et al.  The Enron Corpus: A New Dataset for Email Classi(cid:12)cation Research , 2004 .