Exploring Machine Teaching with Children

Iteratively building and testing machine learning models can help children develop creativity, flexibility, and comfort with machine learning and artificial intelligence. We explore how children use machine teaching interfaces with a team of 14 children (aged 7–13 years) and adult co-designers. Children trained image classifiers and tested each other's models for robustness. Our study illuminates how children reason about ML concepts, offering these insights for designing machine teaching experiences for children: (i) ML metrics (e.g. confidence scores) should be visible for experimentation; (ii) ML activities should enable children to exchange models for promoting reflection and pattern recognition; and (iii) the interface should allow quick data inspection (e.g. images vs. gestures).

[1]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[2]  John Maloney,et al.  The Scratch Programming Language and Environment , 2010, TOCE.

[3]  Xingquan Zhu,et al.  Class Noise vs. Attribute Noise: A Quantitative Study , 2003, Artificial Intelligence Review.

[4]  Alan F. Blackwell,et al.  Interactive visual machine learning in spreadsheets , 2015, 2015 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC).

[5]  John Costello,et al.  A Next Generation Artificial Intelligence Development Plan , 2018 .

[6]  Panos Markopoulos,et al.  Interaction design and children , 2003, Interact. Comput..

[7]  David Maxwell Chickering,et al.  Machine Teaching: A New Paradigm for Building Machine Learning Systems , 2017, ArXiv.

[8]  Allison Druin,et al.  Cooperative Inquiry revisited: Reflections of the past and guidelines for the future of intergenerational co-design , 2013, Int. J. Child Comput. Interact..

[9]  Allison Druin,et al.  The role of children in the design of new technology , 2002 .

[10]  Ankur Chattopadhyay,et al.  A Middle-School Module for Introducing Data-Mining, Big-Data, Ethics and Privacy Using RapidMiner and a Hollywood Theme , 2018, SIGCSE.

[11]  Margaret M. Burnett,et al.  Principles of a debugging-first puzzle game for computing education , 2014, 2014 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC).

[12]  Neil Gershenfeld,et al.  MIT-Media Lab , 1991, ICMC.

[13]  Play.  Lifelong Kindergarten : Cultivating Creativity through Projects , Passion , Peers , and , 2022 .

[14]  Stefania Druga,et al.  Growing up with AI : Cognimates : from coding to teaching machines , 2018 .

[15]  Hadas Erel,et al.  Introducing children to machine learning concepts through hands-on experience , 2018, IDC.

[16]  Richard E. Ladner,et al.  A Personalizable Mobile Sound Detector App Design for Deaf and Hard-of-Hearing Users , 2016, ASSETS.

[17]  Allison Druin,et al.  Embedding Participatory Design into Designs for Learning: An Untapped Interdisciplinary Resource? , 2013, CSCL.

[18]  Hernisa Kacorri,et al.  Teachable machines for accessibility , 2017, ASAC.

[19]  Philip J. Guo,et al.  Software Developers Learning Machine Learning: Motivations, Hurdles, and Desires , 2019, 2019 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC).

[20]  Forrest N. Iandola,et al.  SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <1MB model size , 2016, ArXiv.

[21]  Andrew Large,et al.  Children in the information technology design process: A review of theories and their applications , 2004 .

[22]  Perry R. Cook,et al.  Human model evaluation in interactive supervised learning , 2011, CHI.

[23]  R. Benjamin Shapiro,et al.  Youth Learning Machine Learning through Building Models of Athletic Moves , 2019, IDC.

[24]  Teemu Valtonen,et al.  Learning machine learning with very young children: Who is teaching whom? , 2020, Int. J. Child Comput. Interact..

[25]  Mitchel Resnick,et al.  Lifelong Kindergarten: Cultivating Creativity through Projects, Passion, Peers, and Play , 2017 .

[26]  Grant Potter,et al.  Machine Learning for Kids , 2018 .

[27]  Yvonne Rogers,et al.  Designing for or designing with? Informant design for interactive learning environments , 1997, CHI.

[28]  V. Braun,et al.  Using thematic analysis in psychology , 2006 .

[29]  Sandra Zilles,et al.  An Overview of Machine Teaching , 2018, ArXiv.

[30]  Chieko Asakawa,et al.  People with Visual Impairment Training Personal Object Recognizers: Feasibility and Challenges , 2017, CHI.

[31]  Kyungjun Lee,et al.  Crowdsourcing the Perception of Machine Teaching , 2020, CHI.

[32]  Alexander Scheidt,et al.  Any-Cubes: A Children's Toy for Learning AI: Enhanced Play with Deep Learning and MQTT , 2019, MuC.

[33]  Weidong Hu,et al.  Diversity in Machine Learning , 2018, IEEE Access.

[34]  Qian Yang,et al.  Grounding Interactive Machine Learning Tool Design in How Non-Experts Actually Build Models , 2018, Conference on Designing Interactive Systems.

[35]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[36]  Arjun Rao,et al.  Milo: A visual programming environment for Data Science Education , 2018, 2018 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC).

[37]  Soroush Ghorashi,et al.  Using Expert Patterns in Assisted Interactive Machine Learning: A Study in Machine Teaching , 2019, INTERACT.

[38]  Sayamindu Dasgupta,et al.  Scratch Community Blocks: Supporting Children as Data Scientists , 2017, CHI.

[39]  Varun Aggarwal,et al.  Introducing Data Science to School Kids , 2017, SIGCSE.

[40]  Seymour Papert,et al.  Mindstorms: Children, Computers, and Powerful Ideas , 1981 .

[41]  R. B. Shapiro,et al.  Youth making machine learning models for gesture-controlled interactive media , 2020, IDC.

[42]  Jason C. Yip,et al.  Examining Adult-Child Interactions in Intergenerational Participatory Design , 2017, CHI.

[43]  R. Benjamin Shapiro,et al.  Sports and machine learning: How young people can use data from their own bodies to learn about machine learning , 2019, XRDS.

[44]  Maya Cakmak,et al.  Power to the People: The Role of Humans in Interactive Machine Learning , 2014, AI Mag..

[45]  Allison Druin,et al.  Cooperative inquiry: developing new technologies for children with children , 1999, CHI '99.

[46]  Ariel Shamir,et al.  Can Children Understand Machine Learning Concepts?: The Effect of Uncovering Black Boxes , 2019, CHI.

[47]  Hadas Erel,et al.  Scratch Nodes ML: A Playful System for Children to Create Gesture Recognition Classifiers , 2019, CHI Extended Abstracts.