Multi-Intent Hierarchical Natural Language Understanding for Chatbots

Multi-intent natural language understanding aims at identifying multiple user intents (or goals) in a single natural language uttering (e.g., “I want to buy tomatoes and please, remove the 2 beer cans I've added to the cart before” - here intents are “add-product: tomatoes” and “remove-product: 2 beer cans”). The goal of this work is to explore precise tagging of multiple intents and other nonstandard chatbot problems in a newly created dataset, which was created in Polish language for a real-life domain of online shopping. We propose to achieve the goal by using a hierarchical model. The achieved results are on the scale of over 80 % F1 score.

[1]  Jason Weston,et al.  Learning End-to-End Goal-Oriented Dialog , 2016, ICLR.

[2]  Yoshua Bengio,et al.  Neural Machine Translation by Jointly Learning to Align and Translate , 2014, ICLR.

[3]  Bing Liu,et al.  An End-to-End Trainable Neural Network Model with Belief Tracking for Task-Oriented Dialog , 2017, INTERSPEECH.

[4]  Saturnino Luz,et al.  Wizard of Oz Experimentation for Language Technology Applications: Challenges and Tools , 2015, Interact. Comput..

[5]  George R. Doddington,et al.  The ATIS Spoken Language Systems Pilot Corpus , 1990, HLT.

[6]  Matthew Henderson,et al.  The Second Dialog State Tracking Challenge , 2014, SIGDIAL Conference.

[7]  Adrian Hernandez-Mendez,et al.  Evaluating Natural Language Understanding Services for Conversational Question Answering Systems , 2017, SIGDIAL Conference.

[8]  Bing Liu,et al.  Attention-Based Recurrent Neural Network Models for Joint Intent Detection and Slot Filling , 2016, INTERSPEECH.

[9]  Ruhi Sarikaya,et al.  Exploiting shared information for multi-intent natural language sentence classification , 2013, INTERSPEECH.

[10]  Maxine Eskénazi,et al.  Generative Encoder-Decoder Models for Task-Oriented Spoken Dialog Systems with Chatting Capability , 2017, SIGDIAL Conference.

[11]  Tomas Mikolov,et al.  Enriching Word Vectors with Subword Information , 2016, TACL.

[12]  Marcin Wolinski,et al.  Morfeusz - a Practical Tool for the Morphological Analysis of Polish , 2006, Intelligent Information Systems.