Natural Language Input for In-Car Spoken Dialog Systems: How Natural is Natural?

Recent spoken dialog systems are moving away from command and control towards a more intuitive and natural style of interaction. In order to choose an appropriate system design which allows the system to deal with naturally spoken user input, a definition of what exactly constitutes naturalness in user input is important. In this paper, we examine how different user groups naturally speak to an automotive spoken dialog system (SDS). We conduct a user study in which we collect freely spoken user utterances for a wide range of use cases in German. By means of a comparative study of the utterances from the study with interpersonal utterances, we provide criteria what constitutes naturalness in the user input of an state-of-the-art automotive SDS.

[1]  Gabriel Skantze.  Error Handling in Spoken Dialogue Systems : Managing Uncertainty, Grounding and Miscommunication , 2007 .

[2]  M. Pickering,et al.  The role of beliefs in lexical alignment: Evidence from dialogs with humans and computers , 2011, Cognition.

[3]  M. Pickering,et al.  Linguistic alignment between people and computers , 2010 .

[4]  Kazuhiko Kawamura,et al.  Tests of Concepts About Different Kinds of Minds: Predictions About the Behavior of Computers, Robots, and People , 2012, Hum. Comput. Interact..

[5]  Lynette Hirschman,et al.  Comparing Several Aspects of Human-Computer and Human-Human Dialogues , 2001, SIGDIAL Workshop.

[6]  Elena Karagjosova,et al.  Modal particles and the common ground , 2003 .

[7]  Patrick Paroubek,et al.  Twitter as a Corpus for Sentiment Analysis and Opinion Mining , 2010, LREC.

[8]  Anoop K. Sinha,et al.  Suede: a Wizard of Oz prototyping tool for speech user interfaces , 2000, UIST '00.

[9]  Jure Leskovec,et al.  A computational approach to politeness with application to social factors , 2013, ACL.

[10]  Linda Bell,et al.  Linguistic Adaptations in Spoken Human-Computer Dialogues Empirical Studies of User Behavior , 2003 .

[11]  Ravi Kumar,et al.  Search in the Lost Sense of "Query": Question Formulation in Web Search Queries and its Temporal Changes , 2011, ACL.

[12]  W. Johnson,et al.  Studies in language behavior: A program of research , 1944 .

[13]  Omer Tsimhoni,et al.  Language pattern analysis for automotive natural language speech applications , 2010, AutomotiveUI.

[14]  Bernd Resch,et al.  Microblog Emotion Classification by Computing Similarity in Text, Time, and Space , 2016, PEOPLES@COLING.

[15]  Bernhard Thalheim,et al.  Survey on Spoken Dialogue Systems: User Expectations Regarding Style and Usability , 2012 .

[16]  Yasunari Obuchi,et al.  A Spoken Dialog Corpus for Car Telematics Services , 2005 .

[17]  Hansjörg Hofmann,et al.  Speech Interaction with the Internet -- A User Study , 2012, 2012 Eighth International Conference on Intelligent Environments.

[18]  Slav Petrov,et al.  A Universal Part-of-Speech Tagset , 2011, LREC.

[19]  Idan Szpektor,et al.  Syntactic Parsing of Web Queries with Question Intent , 2016, HLT-NAACL.

[20]  Hansjörg Hofmann,et al.  Evaluation of In-Car SDS Notification Concepts for Incoming Proactive Events , 2014, IWSDS.

[21]  Nick Campbell,et al.  Multimodal Analyses enabling Artificial Agents in Human-Machine Interaction , 2015, Lecture Notes in Computer Science.

[22]  Maria Klara Wolters,et al.  Corpus Analysis of Spoken Smart-Home Interactions with Older Users , 2008, LREC.

[23]  Saturnino Luz,et al.  Speech Rate Comparison When Talking to a System and Talking to a Human: A Study from a Speech-to-Speech, Machine Translation Mediated Map Task , 2017, INTERSPEECH.

[24]  Arne Jönsson,et al.  Wizard of Oz studies -- why and how , 1993, Knowl. Based Syst..

[25]  Ido Guy,et al.  Searching by Talking: Analysis of Voice Queries on Mobile Web Search , 2016, SIGIR.

[26]  Hansjörg Hofmann,et al.  A Comparative Analysis of Crowdsourced Natural Language Corpora for Spoken Dialog Systems , 2016, LREC.

[27]  Niels Ole Bernsen,et al.  Designing interactive speech systems - from first ideas to user testing , 1998 .

[28]  W. Johnson,et al.  Studies in language behavior , 1944 .

[29]  Markus M. Berg.  Natürlichsprachlichkeit in Dialogsystemen , 2012, Informatik-Spektrum.

[30]  Arne Jönsson,et al.  Wizard of Oz studies: why and how , 1993, IUI '93.

[31]  Jiang Hu,et al.  Adaptive language behavior in HCI: how expectations and beliefs about a system affect users' word choice , 2006, CHI.

[32]  Ryen W. White,et al.  Questions vs. Queries in Informational Search Tasks , 2015, WWW.