Why doesn't it work?: voice-driven interfaces and young children's communication repair strategies

In this study, we examine the conversational repair strategies that preschoolers use to correct communication breakdowns with a voice-driven interface. We conducted a two-week deployment in the homes of 14 preschoolers of a tablet game that included a broken voice-driven mini-game. We collected 107 audio samples of these children's (unsuccessful) attempts to communicate with the mini-game. We found that children tried a common set of repair strategies, including repeating themselves and experimenting with the tone and pronunciation of their words. Children were persistent, rarely giving up on the interaction, asking for help, or showing frustration. When parents participated in the interaction, they moved through four phases of engagement: first making suggestions, then intervening, then making statements of resignation, and finally pronouncing that the interaction could not be repaired. Designers should anticipate that in this context, children will borrow behaviors from person-to-person communication, such as pivoting strategies to probe the source of failed communication and structuring communication into turn-taking attempts.

[1]  E. Schegloff,et al.  A simplest systematics for the organization of turn-taking for conversation , 2015 .

[2]  M. Knapp,et al.  Turn-Taking in Conversations. , 1975 .

[3]  M. Tomasello,et al.  Children's speech revisions for a familiar and an unfamiliar adult. , 1984, Journal of speech and hearing research.

[4]  Katharina J. Rohlfing,et al.  “Try something else!” — When users change their discursive behavior in human-robot interaction , 2008, 2008 IEEE International Conference on Robotics and Automation.

[5]  Bongshin Lee,et al.  Plan & Play: Supporting Intentional Media Use in Early Childhood , 2017, IDC.

[6]  Norihiro Hagita,et al.  Effects of a Listener Robot with Children in Storytelling , 2017, HAI.

[7]  Brian T. Gill,et al.  "Robovie, you'll have to go into the closet now": children's social and moral relationships with a humanoid robot. , 2012, Developmental psychology.

[8]  Marina Fridin,et al.  Storytelling by a kindergarten social assistive robot: A tool for constructive learning in preschool education , 2014, Comput. Educ..

[9]  Raj Reddy,et al.  Steps Toward Graceful Interaction in Spoken and Written Man-Machine Communication , 1983, Int. J. Man Mach. Stud..

[10]  B. Brinton,et al.  Development of conversational repair strategies in response to requests for clarification. , 1986, Journal of speech and hearing research.

[11]  Lucy A. Suchman,et al.  Plans and Situated Actions: The Problem of Human-Machine Communication (Learning in Doing: Social, , 1987 .

[12]  T. Gallagher,et al.  Revision behaviors in the speech of normal children developing language. , 1977, Journal of speech and hearing research.

[13]  D. Stern,et al.  The prosody of maternal speech: infant age and context related changes , 1983, Journal of Child Language.

[14]  Allison Druin,et al.  Technology probes: inspiring design for and with families , 2003, CHI '03.

[15]  Anne Marie Piper,et al.  "Siri, is this you?": Understanding young children's interactions with voice input systems , 2015, IDC.

[16]  Meredith Ringel Morris,et al.  User-defined gestures for surface computing , 2009, CHI.

[17]  Lisa Anthony,et al.  Understanding childdefined gestures and children's mental models for touchscreen tabletop interaction , 2014, IDC.

[18]  Lucy Suchman.  Plans and situated actions: the problem of human-machine communication , 1987 .

[19]  R. Stevens,et al.  The New Coviewing: Designing for Learning through Joint Media Engagement , 2011 .

[20]  Christine Stephen,et al.  Parents, pre-schoolers and learning with technology at home: some implications for policy , 2011, J. Comput. Assist. Learn..

[21]  Michael A. Forrester,et al.  The development of other-related conversational skills: A case study of conversational repair during the early years , 2009 .

[22]  Shruti Sannon,et al.  "Alexa is my new BFF": Social Roles, User Satisfaction, and Personification of the Amazon Echo , 2017, CHI Extended Abstracts.

[23]  B. Prizant,et al.  CSBS DP manual : communication and symbolic behavior scales : developmental profile , 2002 .

[24]  Ernst L. Moerk,et al.  Principles of Interaction in Language Learning. , 1972 .

[25]  R. Golinkoff,et al.  ‘I beg your pardon?’: the preverbal negotiation of failed messages , 1984, Journal of Child Language.

[26]  Helen Goodluck,et al.  First language acquisition. , 2011, Wiley interdisciplinary reviews. Cognitive science.

[27]  C. Nass,et al.  Machines and Mindlessness , 2000 .

[28]  Tony Belpaeme,et al.  Review of Semantic-Free Utterances in Social Human–Robot Interaction , 2016, Int. J. Hum. Comput. Interact..

[29]  Sean Andrist,et al.  Fun and fair: influencing turn-taking in a multi-party game with a virtual agent , 2013, IDC.

[30]  Shawna R. White,et al.  Relation between active mediation, exposure to Daniel Tiger’s Neighborhood, and US preschoolers’ social and emotional development , 2016 .