"This is the fluffy robot that only speaks French" : language use between preschoolers, their families, and a social robot while sharing virtual toys

This thesis proposes an approach to language learning for preschool aged children using social robots as conversation partners within a shared play context for children and their families. It addresses an underserved age for language learning, where early learning can greatly impact later educational success, but that cannot benefit from text-based interventions. With the goal of establishing a shared physical context between multiple participants without absorbing all of the children's focus onto digital content, a hybrid physical and digital interface was iteratively designed and play-tested. This interface took the form of a "cafe table" on which the child and robot could share food. A robot was programmed to introduce itself and name foods in French, eat some foods and express dislike towards others, respond with distress to a new object, show its focus of attention through gaze, and in one experimental condition, express feedback about its comprehension when spoken to in French or English. The study found that some children as young as 3 years old would treat a social robot as an agent capable of understanding them and of perceiving a shared physical context, and would spontaneously modify their use of language and gesture in order to communicate with it-particularly when the robot communicated confusion. The study also found that parents tended to frame their scaffolding of the children's behavior with the robot in a social context, and without prompting aligned their guidance and reinforcement with language learning goals. After one exposure to the robot and new French vocabulary, children did not retain the robot's utterances, but engaged in communicative and social behaviors and language mimicry throughout the interaction. The system appeared to support multiuser social participation, including both caretakers and siblings of the participants. 3 "You don't know what a joy it is to run in your own language until you've stumbled in someone else's." This thesis is dedicated to my French and American grandmothers, Christiane Baudot and Marian Scudder, who both in ways as different and wonderful as your styles of cooking were masters in the Grandmother Method of encouraging, and are still with me today. Acknowledgements To my readers: Many thanks and credit are due to my advisor Dr. Cynthia Breazeal both for her expertise on social robotics and for her vision and enthusiasm about the future of education. You pushed me to take on new challenges while providing the resources to make it possible. To …

[1]  Natalie Freed,et al.  Toys keeping in touch: technologies for distance play , 2010, TEI '10.

[2]  Cynthia Breazeal,et al.  Affective Learning — A Manifesto , 2004 .

[3]  Hiroshi Ishii,et al.  Picture this!: film assembly using toy gestures , 2008, UbiComp.

[4]  Keiko Koda,et al.  Development of Literacy. , 2006 .

[5]  B. MacWhinney The CHILDES project: tools for analyzing talk , 1992 .

[6]  Javier R. Movellan,et al.  Sociable robot improves toddler vocabulary skills , 2009, 2009 4th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[7]  Po-Yao Chao,et al.  Exploring the Possibility of Using Humanoid Robots as Instructional Tools for Teaching a Second Language in Primary School , 2010, J. Educ. Technol. Soc..

[8]  David Robert,et al.  Imaginative play with blended reality characters , 2011 .

[9]  Design-Based Research: An Emerging Paradigm for Educational Inquiry , 2003 .

[10]  Cynthia Breazeal,et al.  Designing for long-term human-robot interaction and application to weight loss , 2008 .

[11]  Adam Setapen,et al.  Creating robotic characters for long-term interaction , 2012 .

[12]  Esther Geva,et al.  The development of vocabulary in English as a second language children and its role in predicting word recognition ability , 2009 .

[13]  Nonie K. Lesaux,et al.  The gap between Spanish speakers' word reading and word knowledge: a longitudinal study. , 2011, Child development.

[14]  Takayuki Kanda,et al.  Interactive Robots as Social Partners and Peer Tutors for Children: A Field Trial , 2004, Hum. Comput. Interact..

[15]  Sungjin Lee,et al.  Cognitive Effects of Robot-Assisted Language Learning on Oral Skills , 2010 .