Challenges Posed by Voice Interface to Child- Agent Collaborative Storytelling

Child-agent collaborative storytelling can be facilitated through text and voice interfaces. Voice interfaces are more intuitive and closely resemble the way people usually relate to one another. This may be attributed to the colloquial characteristics of everyday conversations that do away with rigid linguistic structures typically present in text interfaces, such as observing the use of correct grammar and spelling. However, the capabilities of voice-based interfaces currently available in virtual assistants can lead to failure in communication due to user frustration and confusion when the agent is not providing the needed support, possibly caused by the latter's misinterpretation of the user's input. In such situations, text-based interfaces from messaging applications may be used as an alternative communication channel. In this paper, we provide a comparative analysis of the performance of our collaborative storytelling agent in processing user input by analyzing conversation logs from voice-based interface using Google Assistant, and text-based interface using Google Firebase. To do this, we give a brief overview of the different dialogue strategies employed by our agent, and how these are manifested through the interfaces. We also identify the obstacles posed by incorrect input processing to the collaborative tasks, and offer suggestions on how these challenges can be addressed.

[1]  W. Marsden I and J , 2012 .

[2]  Jichen Zhu,et al.  Patterns for How Users Overcome Obstacles in Voice User Interfaces , 2018, CHI.

[3]  Arthur C. Graesser,et al.  AutoTutor: an intelligent tutoring system with mixed-initiative dialogue , 2005, IEEE Transactions on Education.

[4]  Ben Shneiderman,et al.  The limits of speech recognition , 2000, CACM.

[5]  L. Kervin,et al.  This Is Me! Empowering children to talk about their learning through digital story , 2010 .

[6]  Loren G. Terveen,et al.  Overview of human-computer collaboration , 1995, Knowl. Based Syst..

[7]  Yvonne Jaeger Essentials Of Human Communication , 2016 .

[8]  Marina Umaschi Bers,et al.  Interactive storytelling systems for children: using technology to explore language and identity , 1999 .

[9]  K. Fitzpatrick,et al.  Delivering Cognitive Behavior Therapy to Young Adults With Symptoms of Depression and Anxiety Using a Fully Automated Conversational Agent (Woebot): A Randomized Controlled Trial , 2017, JMIR mental health.

[10]  Carol Sue Englert,et al.  Students' Metacognitive Knowledge about How to Write Informational Texts , 1988 .

[11]  W. Buxton Human-Computer Interaction , 1988, Springer Berlin Heidelberg.

[12]  Colin Potts,et al.  Design of Everyday Things , 1988 .

[13]  Austin Henderson,et al.  Interaction design: beyond human-computer interaction , 2002, UBIQ.

[14]  Yvonne Rogers,et al.  Interaction Design: Beyond Human-Computer Interaction , 2002 .

[15]  Boyang Li,et al.  Collaborative Storytelling between Robot and Child: A Feasibility Study , 2017, IDC.

[16]  Shigenori Inagaki,et al.  GENTORO: a system for supporting children's storytelling using handheld projectors and a robot , 2009, IDC.

[17]  Aaas News,et al.  Book Reviews , 1893, Buffalo Medical and Surgical Journal.

[18]  Omar Khadeer Hussain,et al.  A Survey on Chatbot Implementation in Customer Service Industry through Deep Neural Networks , 2018, 2018 IEEE 15th International Conference on e-Business Engineering (ICEBE).