A Literature Survey of Recent Advances in Chatbots

Chatbots are intelligent conversational computer systems designed to mimic human conversation to enable automated online guidance and support. The increased benefits of chatbots led to their wide adoption by many industries in order to provide virtual assistance to customers. Chatbots utilise methods and algorithms from two Artificial Intelligence domains: Natural Language Processing and Machine Learning. However, there are many challenges and limitations in their application. In this survey we review recent advances on chatbots, where Artificial Intelligence and Natural Language processing are used. We highlight the main challenges and limitations of current work and make recommendations for future research investigation

[1]  Hang Li,et al.  Neural Responding Machine for Short-Text Conversation , 2015, ACL.

[2]  A Review on Chatbot Design and Implementation Techniques , 2020 .

[3]  Boudhir Anouar Abdelhakim,et al.  A Smart Chatbot Architecture based NLP and Machine Learning for Health Care Assistance , 2020, NISS.

[4]  Mohammed Saeed Jawad,et al.  Intention to Use Intelligent Conversational Agents in e-Commerce among Malaysian SMEs: An Integrated Conceptual Framework Based on Tri-theories including Unified Theory of Acceptance, Use of Technology (UTAUT), and T-O-E , 2019 .

[5]  Giovanni Pilato,et al.  An Approach to Enhance Chatbot Semantic Power and Maintainability: Experiences within the FRASI Project , 2012, 2012 IEEE Sixth International Conference on Semantic Computing.

[6]  Hyun Seung Jin,et al.  Customer service chatbots: Anthropomorphism and adoption , 2020, Journal of Business Research.

[7]  Mgr. Tomáš Zemčík.  A Brief History of Chatbots , 2019, DEStech Transactions on Computer Science and Engineering.

[8]  Eun Go,et al.  Humanizing chatbots: The effects of visual, identity and conversational cues on humanness perceptions , 2019, Comput. Hum. Behav..

[9]  Kit Kuksenok,et al.  Evaluation and Improvement of Chatbot Text Classification Data Quality Using Plausible Negative Examples , 2019, Proceedings of the First Workshop on NLP for Conversational AI.

[10]  Nurfadhlina Mohd Sharef,et al.  Sequence to Sequence Model Performance for Education Chatbot , 2019, Int. J. Emerg. Technol. Learn..

[11]  Wilson Nwankwo.  Interactive Advising with Bots: Improving Academic Excellence in Educational Establishments , 2018 .

[12]  Harry Shum,et al.  From Eliza to XiaoIce: challenges and opportunities with social chatbots , 2018, Frontiers of Information Technology & Electronic Engineering.

[13]  Mary Williamson,et al.  Recipes for Building an Open-Domain Chatbot , 2020, EACL.

[14]  Rui Yan,et al.  Learning to Respond with Deep Neural Networks for Retrieval-Based Human-Computer Conversation System , 2016, SIGIR.

[15]  Peter A. Gloor,et al.  In bot we trust: A new methodology of chatbot performance measures , 2019, Business Horizons.

[16]  Natasha Jaques,et al.  Approximating Interactive Human Evaluation with Self-Play for Open-Domain Dialog Systems , 2019, NeurIPS.

[17]  Wolfgang Wahlster,et al.  Proceedings of the 35th Annual Meeting of the Association for Computational Linguistics and Eighth Conference of the European Chapter of the Association for Computational Linguistics , 1997 .

[18]  Oriol Vinyals,et al.  Adversarial Evaluation of Dialogue Models , 2017, ArXiv.

[19]  Lefteris Moussiades,et al.  An Overview of Chatbot Technology , 2020, AIAI.

[20]  Xueming Luo,et al.  Frontiers: Machines vs. Humans: The Impact of Artificial Intelligence Chatbot Disclosure on Customer Purchases , 2019, Mark. Sci..

[21]  James H. Martin,et al.  Speech and Language Processing: An Introduction to Natural Language Processing, Computational Linguistics, and Speech Recognition , 2000 .

[22]  Srushti Barve,et al.  Chat-Bot For College Management System , 2021, SSRN Electronic Journal.

[23]  Dunja Mladenic,et al.  A Survey of Chabot Systems through a Loebner Prize Competition , 2012 .

[24]  Quoc V. Le,et al.  The Evolved Transformer , 2019, ICML.

[25]  Yoshua Bengio,et al.  Neural Machine Translation by Jointly Learning to Align and Translate , 2014, ICLR.

[26]  Roy De Kleijn,et al.  The effect of context-dependent information and sentence constructions on perceived humanness of an agent in a Turing test , 2019, Knowl. Based Syst..

[27]  Jianfeng Gao,et al.  A Neural Network Approach to Context-Sensitive Generation of Conversational Responses , 2015, NAACL.

[28]  Abdullah Al Mamun,et al.  Programming challenges of chatbot: Current and future prospective , 2017, 2017 IEEE Region 10 Humanitarian Technology Conference (R10-HTC).

[29]  A. M. Turing,et al.  Computing Machinery and Intelligence , 1950, The Philosophy of Artificial Intelligence.

[30]  Yann Dauphin,et al.  Language Modeling with Gated Convolutional Networks , 2016, ICML.

[31]  Joseph Weizenbaum,et al.  ELIZA—a computer program for the study of natural language communication between man and machine , 1966, CACM.

[32]  A. Romano,et al.  Chatbot in Industry 4.0: An Approach for Training New Employees , 2020, 2020 IEEE International Conference on Teaching, Assessment, and Learning for Engineering (TALE).

[33]  Alon Lavie,et al.  METEOR: An Automatic Metric for MT Evaluation with Improved Correlation with Human Judgments , 2005, IEEvaluation@ACL.

[34]  Paulo S. C. Alencar,et al.  Exploring Context-Aware Conversational Agents in Software Development , 2020, ArXiv.

[35]  James H. Martin,et al.  Speech and language processing: an introduction to natural language processing , 2000 .

[36]  Quoc V. Le,et al.  Searching for Activation Functions , 2018, arXiv.

[37]  Ryuichiro Higashinaka,et al.  Towards an open-domain conversational system fully based on natural language processing , 2014, COLING.

[38]  Jianfeng Gao,et al.  Deep Reinforcement Learning for Dialogue Generation , 2016, EMNLP.

[39]  Stephen Petrina,et al.  Using Learning Analytics to Understand the Design of an Intelligent Language Tutor – Chatbot Lucy , 2013 .

[40]  Marilyn A. Walker,et al.  PARADISE: A Framework for Evaluating Spoken Dialogue Agents , 1997, ACL.

[41]  Asbjørn Følstad,et al.  Why People Use Chatbots , 2017, INSCI.

[42]  Sunita Singhal,et al.  Generative model chatbot for Human Resource using Deep Learning , 2019, 2019 International Conference on Data Science and Engineering (ICDSE).

[43]  Quoc V. Le,et al.  Towards a Human-like Open-Domain Chatbot , 2020, ArXiv.

[44]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[45]  Martin Ebner,et al.  Potentials of Chatbots for Spell Check among Youngsters , 2019, Int. J. Learn. Anal. Artif. Intell. Educ..

[46]  Alan Ritter,et al.  Adversarial Learning for Neural Dialogue Generation , 2017, EMNLP.

[47]  Chunyan Miao,et al.  An Affect-Rich Neural Conversational Model with Biased Attention and Weighted Cross-Entropy Loss , 2018, AAAI.

[48]  Rupesh Singh,et al.  Chatbot using TensorFlow for small Businesses , 2018, 2018 Second International Conference on Inventive Communication and Computational Technologies (ICICCT).

[49]  Ming Zhou,et al.  SuperAgent: A Customer Service Chatbot for E-commerce Websites , 2017, ACL.

[50]  Heri Ramampiaro,et al.  Context-Aware Sequence-to-Sequence Models for Conversational Systems , 2018, ArXiv.

[51]  Harry Shum,et al.  The Design and Implementation of XiaoIce, an Empathetic Social Chatbot , 2018, CL.

[52]  Ming-Wei Chang,et al.  BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding , 2019, NAACL.

[53]  Amanda Strigér,et al.  End-to-End Trainable Chatbot for Restaurant Recommendations , 2017 .

[54]  Abonia Sojasingarayar.  Seq2Seq AI Chatbot with Attention Mechanism , 2020, ArXiv.

[55]  J. Weston,et al.  Recipes for Safety in Open-domain Chatbots , 2020, ArXiv.

[56]  Matthew G. Snover,et al.  A Study of Translation Edit Rate with Targeted Human Annotation , 2006, AMTA.

[57]  Livio Robaldo,et al.  Legalbot: A Deep Learning-Based Conversational Agent in the Legal Domain , 2017, NLDB.

[58]  Harksoo Kim,et al.  Multi-Turn Chatbot Based on Query-Context Attentions and Dual Wasserstein Generative Adversarial Networks , 2019, Applied Sciences.

[59]  Omar Khadeer Hussain,et al.  A Survey on Chatbot Implementation in Customer Service Industry through Deep Neural Networks , 2018, 2018 IEEE 15th International Conference on e-Business Engineering (ICEBE).

[60]  Xiaoyu Shen,et al.  DailyDialog: A Manually Labelled Multi-turn Dialogue Dataset , 2017, IJCNLP.

[61]  Alon Lavie,et al.  Meteor, M-BLEU and M-TER: Evaluation Metrics for High-Correlation with Human Rankings of Machine Translation Output , 2008, WMT@ACL.

[62]  Eleni Gregoromichelaki,et al.  Clarification Requests: An Incremental Account , 2007 .

[63]  Eric Atwell,et al.  ALICE Chatbot: Trials and Outputs , 2015, Computación y Sistemas.

[64]  Quoc V. Le,et al.  Sequence to Sequence Learning with Neural Networks , 2014, NIPS.

[65]  B R Kavitha,et al.  Chatbot for Healthcare System Using Artificial Intelligence , 2019, International Research Journal of Modernization in Engineering Technology and Science.

[66]  Jiyou Jia,et al.  The Study of the Application of a Keywords-based Chatbot System on the Teaching of Foreign Languages , 2003, ArXiv.

[67]  Rajiv Kumar,et al.  An intelligent Chatbot using deep learning with Bidirectional RNN and attention model , 2020, Materials Today: Proceedings.

[68]  Alexander M. Rush,et al.  OpenNMT: Open-Source Toolkit for Neural Machine Translation , 2017, ACL.

[69]  Yiming Yang,et al.  Transformer-XL: Attentive Language Models beyond a Fixed-Length Context , 2019, ACL.

[70]  Sivaji Bandyopadhyay,et al.  Textual Entailment Using Machine Translation Evaluation Metrics , 2017, CICLing.

[71]  2020 8th International Conference on Reliability, Infocom Technologies and Optimization (Trends and Future Directions) (ICRITO) , 2020 .

[72]  Eliane Pozzebon,et al.  Chatbots: An Analysis of the State of Art of Literature , 2018, Anais do I Workshop on Advanced Virtual Environments and Education (WAVE 2018).

[73]  Jihie Kim,et al.  Ensemble-Based Deep Reinforcement Learning for Chatbots , 2019, Neurocomputing.

[74]  Lukasz Kaiser,et al.  Reformer: The Efficient Transformer , 2020, ICLR.

[75]  Etsuko Ishii,et al.  XPersona: Evaluating Multilingual Personalized Chatbot , 2020, NLP4CONVAI.

[76]  Hang Li,et al.  A Deep Architecture for Matching Short Texts , 2013, NIPS.

[77]  Morgan C. Benton,et al.  Evaluating Quality of Chatbots and Intelligent Conversational Agents , 2017, ArXiv.

[78]  Jason Weston,et al.  ACUTE-EVAL: Improved Dialogue Evaluation with Optimized Questions and Multi-turn Comparisons , 2019, ArXiv.

[79]  Chris Callison-Burch,et al.  ChatEval: A Tool for Chatbot Evaluation , 2019, NAACL.

[80]  Conversing with Personal Digital Assistants: on Gender and Artificial Intelligence , 2018, Journal of Science and Technology of the Arts.

[81]  John Woods,et al.  Survey on Chatbot Design Techniques in Speech Conversation Systems , 2015 .

[82]  Martin Ebner,et al.  Conception of a Conversational Interface to Provide a Guided Search of Study Related Data , 2019, Int. J. Emerg. Technol. Learn..

[83]  Yoshua Bengio,et al.  Show, Attend and Tell: Neural Image Caption Generation with Visual Attention , 2015, ICML.

[84]  Avelino J. Gonzalez,et al.  Towards a method for evaluating naturalness in conversational dialog systems , 2009, 2009 IEEE International Conference on Systems, Man and Cybernetics.

[85]  Quoc V. Le,et al.  A Neural Conversational Model , 2015, ArXiv.

[86]  Jörg Tiedemann,et al.  OpenSubtitles2016: Extracting Large Parallel Corpora from Movie and TV Subtitles , 2016, LREC.

[87]  Martin Ebner,et al.  Potential of Bots for Encyclopedia , 2020 .

[88]  Cristian Danescu-Niculescu-Mizil,et al.  Chameleons in Imagined Conversations: A New Approach to Understanding Coordination of Linguistic Style in Dialogs , 2011, CMCL@ACL.