Conversational Technologies for In-home Learning: Using Co-Design to Understand Children's and Parents' Perspectives

Today, Conversational Agents (CA) are deeply integrated into the daily lives of millions of families, which has led children to extensively interact with such devices. Studies have suggested that the social nature of CA makes them a good learning companion for children. Therefore, to understand children's preferences for the use of CAs for the purpose of in-home learning, we conducted three participatory design sessions. In order to identify parents' requirements in this regard, we also included them in the third session. We found that children expect such devices to possess a personality and an advanced level of intelligence, and support multiple content domains and learning modes and human-like conversations. Parents desire such devices to include them in their children's learning activities, foster social engagement, and to allow them to monitor their children's use. This understanding will inform the design of future CAs for the purpose of in-home learning.

[1]  Elizabeth Foss,et al.  Layered elaboration: a new technique for co-design with children , 2010, CHI.

[2]  Emily Reardon,et al.  Designing for Parasocial Relationships and Learning: Linear Video, Interactive Media, and Artificial Intelligence , 2017, IDC.

[3]  Fadel Adib,et al.  Emotion recognition using wireless signals , 2016, MobiCom.

[4]  C. DesForges,et al.  The Impact of Parental Involvement, Parental Support and Family Education on Pupil Achievement and Adjustment: a literature review , 2003 .

[5]  Benjamin R. Cowan,et al.  What Makes a Good Conversation?: Challenges in Designing Truly Conversational Agents , 2019, CHI.

[6]  James A. Holstein,et al.  Qualitative Interviewing and Grounded Theory Analysis , 2003 .

[7]  Christine L. Lisetti,et al.  MAUI avatars: Mirroring the user's sensed emotions via expressive multi-ethnic facial avatars , 2006, J. Vis. Lang. Comput..

[8]  R. Atkinson Optimizing learning from examples using animated pedagogical agents. , 2002 .

[9]  Martin Ludvigsen,et al.  Mission from Mars: a method for exploring user requirements for children in a narrative space , 2005, IDC '05.

[10]  Mark Warschauer,et al.  Young Children's Reading and Learning with Conversational Agents , 2019, CHI Extended Abstracts.

[11]  P. Fehrmann,et al.  Home Influence on School Learning: Direct and Indirect Effects of Parental Involvement on High School Grades , 1987 .

[12]  Morgan G. Ames,et al.  Understanding technology choices and values through social class , 2011, CSCW.

[13]  Patti M. Valkenburg,et al.  Developing a scale to assess three styles of television mediation: "restrictive mediation," "instructive mediation," and "social coviewing" , 1999 .

[14]  Kirsten Drotner,et al.  Children and their Changing Media Environment: A European Comparative Study , 2001 .

[15]  H. Westcott,et al.  Exploring meaning through interviews with children , 2005 .

[16]  Elizabeth Foss,et al.  FACIT PD: a framework for analysis and creation of intergenerational techniques for participatory design , 2013, CHI.

[17]  W. Jeynes A Meta-Analysis of the Relation of Parental Involvement to Urban Elementary School Student Academic Achievement , 2005 .

[18]  Allison Druin,et al.  Cooperative inquiry: developing new technologies for children with children , 1999, CHI '99.

[19]  Justine Cassell,et al.  Embodied Conversational Agents: Representation and Intelligence in User Interfaces , 2001, AI Mag..

[20]  Jeonghye Han,et al.  Comparative Study on the Educational Use of Home Robots for Children , 2008, J. Inf. Process. Syst..

[21]  Christoph Bartneck,et al.  Expressive robots in education: varying the degree of social supportive behavior of a robotic tutor , 2010, CHI.

[22]  Sarah J. McCarthey,et al.  Home–School Connections: A Review of the Literature , 2000 .

[23]  Julie A. Kientz,et al.  Not at the Dinner Table: Parents' and Children's Perspectives on Family Technology Rules , 2016, CSCW.

[24]  Guillaume Dubuisson Duplessis,et al.  Multifaceted Engagement in Social Interaction with a Machine: The JOKER Project , 2018, 2018 13th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2018).

[25]  Jason C. Yip,et al.  Using Co-Design to Examine How Children Conceptualize Intelligent Interfaces , 2018, CHI.

[26]  H. Wellman,et al.  Creepiness Creeps In: Uncanny Valley Feelings Are Acquired in Childhood. , 2019, Child development.

[27]  Jodi Forlizzi,et al.  "Hey Alexa, What's Up?": A Mixed-Methods Studies of In-Home Conversational Agent Usage , 2018, Conference on Designing Interactive Systems.

[28]  P. Nikken,et al.  Parental mediation of children’s videogame playing: a comparison of the reports by parents and children , 2006 .

[29]  James A. Holstein,et al.  The SAGE Handbook of Interview Research: The Complexity of the Craft , 2012 .

[30]  J. Cassell,et al.  Towards a model of technology and literacy development: Story listening systems , 2004 .

[31]  James C. Lester,et al.  The persona effect: affective impact of animated pedagogical agents , 1997, CHI.

[32]  Jason C. Yip,et al.  Communication Breakdowns Between Families and Alexa , 2019, CHI.

[33]  Susan Bull,et al.  CALMsystem: A Conversational Agent for Learner Modelling , 2007, Knowl. Based Syst..

[34]  Ye Yuan,et al.  Children asking questions: speech interface reformulations and personification preferences , 2018, IDC.

[35]  Allison Druin,et al.  The role of children in the design of new technology , 2002 .

[36]  Jason C. Yip,et al.  Laughing is Scary, but Farting is Cute: A Conceptual Model of Children's Perspectives of Creepy Technologies , 2019, CHI.

[37]  Jackie Halliday,et al.  Instructional Technology for Teaching and Learning: Designing Instruction, Integrating Computers, and Using media , 2000, J. Educ. Technol. Soc..

[38]  S. Livingstone,et al.  Children and Their Changing Media Environment : A European Comparative Study , 2001 .

[39]  Wayne H. Ward,et al.  My Science Tutor: A Conversational Multimedia Virtual Tutor. , 2013 .

[40]  Anne Marie Piper,et al.  Hey Google, Do Unicorns Exist?: Conversational Agents as a Path to Answers to Children's Questions , 2019, IDC.

[41]  Sandra L. Calvert,et al.  Children’s future parasocial relationships with media characters: the age of intelligent characters , 2016 .

[42]  Elizabeth Foss,et al.  Children's search roles at home: Implications for designers, researchers, educators, and parents , 2012, J. Assoc. Inf. Sci. Technol..

[43]  Allison Druin,et al.  Cooperative Inquiry revisited: Reflections of the past and guidelines for the future of intergenerational co-design , 2013, Int. J. Child Comput. Interact..

[44]  S. Livingstone,et al.  How can parents support children’s internet safety? , 2012 .

[45]  D. Olson,et al.  Developing theories of mind , 1988 .

[46]  Daesang Kim,et al.  Effects of Text, Audio, and Graphic Aids in Multimedia Instruction for Vocabulary Learning , 2008, J. Educ. Technol. Soc..

[47]  Allison Druin,et al.  Co-designing Mobile Online Safety Applications with Children , 2018, CHI.

[48]  Anne Marie Piper,et al.  "Siri, is this you?": Understanding young children's interactions with voice input systems , 2015, IDC.

[49]  Alexis Hiniker,et al.  Why doesn't it work?: voice-driven interfaces and young children's communication repair strategies , 2018, IDC.

[50]  Robert K. Yin,et al.  Qualitative Research from Start to Finish , 2010 .

[51]  Stuart Reeves Conversation considered harmful? , 2019, CUI.

[52]  Oussama Metatla,et al.  Voice User Interfaces in Schools: Co-designing for Inclusion with Visually-Impaired and Sighted Pupils , 2019, CHI.

[53]  Yasmin B. Kafai,et al.  Elementary School Students' Computer and Internet Use at Home: Current Trends and Issues , 1999 .

[54]  Juan E. Gilbert,et al.  Co-Designing an Intelligent Conversational History Tutor with Children , 2019, IDC.

[55]  Bilge Mutlu,et al.  MACH: my automated conversation coach , 2013, UbiComp.

[56]  Anastasios Karakostas,et al.  Promoting academically productive talk with conversational agent interventions in collaborative learning settings , 2015, Comput. Educ..

[57]  Melissa Mazmanian,et al.  "Okay, One More Episode": An Ethnography of Parenting in the Digital Age , 2017, CSCW.

[58]  Shruti Sannon,et al.  "Alexa is my new BFF": Social Roles, User Satisfaction, and Personification of the Amazon Echo , 2017, CHI Extended Abstracts.

[59]  Emer Gilmartin,et al.  Social talk: making conversation with people and machine , 2017, ISIAA@ICMI.

[60]  Gunnar Harboe,et al.  Real-World Affinity Diagramming Practices: Bridging the Paper-Digital Gap , 2015, CHI.

[61]  R. Stevens,et al.  The New Coviewing: Designing for Learning through Joint Media Engagement , 2011 .

[62]  Allison Druin,et al.  Mixing ideas: a new technique for working with young children as design partners , 2004, IDC '04.

[63]  Bradley J. Bond,et al.  A Model and Measure of US Parents' Perceptions of Young Children's Parasocial Relationships , 2014 .

[64]  Radhika Garg,et al.  "When you can do it, why can't I?": Racial and Socioeconomic Differences in Family Technology Use and Non-Use , 2019, Proc. ACM Hum. Comput. Interact..