A Voice Interactive Multilingual Student Support System using IBM Watson

Systems powered by artificial intelligence are being developed to be more user-friendly by communicating with users in a progressively “human-like” conversational way. Chatbots, also known as dialogue systems, interactive conversational agents, or virtual agents are an example of such systems used in a wide variety of applications ranging from customer support in the business domain to companionship in the healthcare sector. It is becoming increasingly important to develop chatbots that can best respond to the personalized needs of their users, so that they can be as helpful to the user as possible in a real human way. This paper investigates and compares three popular existing chatbots API offerings and then propose and develop a voice interactive and multilingual chatbot that can effectively respond to users’ mood, tone, and language using IBM Watson Assistant, Tone Analyzer, and Language Translator. The chatbot was evaluated using a use case that was targeted at responding to users’ needs regarding exam stress based on university students survey data generated using Google Forms. The results of measuring the chatbot effectiveness at analyzing responses regarding exam stress indicate that the chatbot responding appropriately to the user queries regarding how they are feeling about exams 76.5%. The chatbot could also be adapted for use in other application areas such as student info-centers, government kiosks, and mental health support systems.

[1]  Alan Ritter,et al.  Data-Driven Response Generation in Social Media , 2011, EMNLP.

[2]  Ying Chen,et al.  Multi-Turn Response Selection for Chatbots with Deep Attention Matching Network , 2018, ACL.

[3]  Quoc V. Le,et al.  Sequence to Sequence Learning with Neural Networks , 2014, NIPS.

[4]  Joelle Pineau,et al.  Building End-To-End Dialogue Systems Using Generative Hierarchical Neural Network Models , 2015, AAAI.

[5]  Tom Crick,et al.  Incorporating Emotion and Personality-Based Analysis in User-Centered Modelling , 2016, SGAI Conf..

[6]  Fabio A. González,et al.  Finding Relationships between Socio-Technical Aspects and Personality Traits by Mining Developer E-mails , 2016, 2016 IEEE/ACM Cooperative and Human Aspects of Software Engineering (CHASE).

[7]  Thomas Wolf,et al.  TransferTransfo: A Transfer Learning Approach for Neural Network Based Conversational Agents , 2019, ArXiv.

[8]  Jason Weston,et al.  Personalizing Dialogue Agents: I have a dog, do you have pets too? , 2018, ACL.

[9]  Zhoujun Li,et al.  Sequential Match Network: A New Architecture for Multi-turn Response Selection in Retrieval-based Chatbots , 2016, ArXiv.

[10]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[11]  Jianfeng Gao,et al.  A Diversity-Promoting Objective Function for Neural Conversation Models , 2015, NAACL.

[12]  Sjsu ScholarWorks,et al.  Deep Learning for Chatbots , 2019 .

[13]  Farhana H. Zulkernine,et al.  A Voice Controlled E-Commerce Web Application , 2018, 2018 IEEE 9th Annual Information Technology, Electronics and Mobile Communication Conference (IEMCON).

[14]  Xuan Liu,et al.  Multi-view Response Selection for Human-Computer Conversation , 2016, EMNLP.

[15]  David Konopnicki,et al.  Predicting Customer Satisfaction in Customer Support Conversations in Social Media Using Affective Features , 2016, UMAP.

[16]  Joelle Pineau,et al.  The Ubuntu Dialogue Corpus: A Large Dataset for Research in Unstructured Multi-Turn Dialogue Systems , 2015, SIGDIAL Conference.

[17]  Nobuhiro Kaji,et al.  Predicting and Eliciting Addressee's Emotion in Online Dialogue , 2013, ACL.

[18]  Chitra Dorai,et al.  Cognitive Computing in Action to Enhance Invoice Processing with Customized Language Translation , 2017, 2017 IEEE International Conference on Cognitive Computing (ICCC).

[19]  Sarah Packowski,et al.  Using IBM watson cloud services to build natural language processing solutions to leverage chat tools , 2017, CASCON.

[20]  Harry Shum,et al.  From Eliza to XiaoIce: challenges and opportunities with social chatbots , 2018, Frontiers of Information Technology & Electronic Engineering.

[21]  Frank Maurer,et al.  Social Media Analyst Responding Tool: A Visual Analytics Prototype to Identify Relevant Tweets in Emergency Events , 2017, ISCRAM.

[22]  Jianfeng Gao,et al.  A Neural Network Approach to Context-Sensitive Generation of Conversational Responses , 2015, NAACL.

[23]  Melanie Fleming,et al.  Streamlining student course requests using chatbots , 2018 .

[24]  Mario A. Bochicchio,et al.  MamaBot: a System based on ML and NLP for supporting Women and Families during Pregnancy , 2018, IDEAS.

[25]  Ruhi Sarikaya.  An overview of the system architecture and key components The Technology Behind Personal Digital Assistants , 2022 .

[26]  Júlio Cesar dos Reis,et al.  Exploring Ontologies to Improve the Empathy of Interactive Bots , 2018, 2018 IEEE 27th International Conference on Enabling Technologies: Infrastructure for Collaborative Enterprises (WETICE).

[27]  Satoshi Nakamura,et al.  Positive Emotion Elicitation in Chat-Based Dialogue Systems , 2019, IEEE/ACM Transactions on Audio, Speech, and Language Processing.