Can Children Understand Machine Learning Concepts?: The Effect of Uncovering Black Boxes

Machine Learning services are integrated into various aspects of everyday life. Their underlying processes are typically black-boxed to increase ease-of-use. Consequently, children lack the opportunity to explore such processes and develop essential mental models. We present a gesture recognition research platform, designed to support learning from experience by uncovering Machine Learning building blocks: Data Labeling and Evaluation. Children used the platform to perform physical gestures, iterating between sampling and evaluation. Their understanding was tested in a pre/post experimental design, in three conditions: learning activity uncovering Data Labeling only, Evaluation only, or both. Our findings show that both building blocks are imperative to enhance children's understanding of basic Machine Learning concepts. Children were able to apply their new knowledge to everyday life context, including personally meaningful applications. We conclude that children's interaction with uncovered black boxes of Machine Learning contributes to a better understanding of the world around them.

[1]  Cynthia Breazeal,et al.  "Hey Google is it OK if I eat you?": Initial Explorations in Child-Agent Interaction , 2017, IDC.

[2]  Jason C. Yip,et al.  Using Co-Design to Examine How Children Conceptualize Intelligent Interfaces , 2018, CHI.

[3]  Michael A. McDaniel,et al.  The generation effect: A meta-analytic review , 2007, Memory & cognition.

[4]  N. J. Slamecka,et al.  The Generation Effect: Delineation of a Phenomenon , 1978 .

[5]  Robert Sommer,et al.  Experience and Education. , 1974 .

[6]  Jean Piaget,et al.  To Understand is to Invent: The Future of Education , 1973 .

[7]  Hadas Erel,et al.  Introducing children to machine learning concepts through hands-on experience , 2018, IDC.

[8]  Cynthia Breazeal,et al.  How smart are the smart toys?: children and parents' agent interaction and intelligence attribution , 2018, IDC.

[9]  Philip Henning,et al.  Mental Models: Knowledge in the Head and Knowledge in the World , 1996, ICLS.

[10]  Mitchel Resnick,et al.  Extending tangible interfaces for education: digital montessori-inspired manipulatives , 2005, CHI.

[11]  Sotiris B. Kotsiantis,et al.  Supervised Machine Learning: A Review of Classification Techniques , 2007, Informatica.

[12]  L. Schauble,et al.  Building Functional Models: Designing an Elbow , 1997 .

[13]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.

[14]  Susanne Bögeholz,et al.  Hands-on Activities and Their Influence on Students’ Interest , 2010 .

[15]  Ethem Alpaydin,et al.  Introduction to machine learning , 2004, Adaptive computation and machine learning.

[16]  Janet Read Children as participants in design and evaluation , 2015, Interactions.

[17]  Emel Ültanir,et al.  An Epistemologic Glance at the Constructivist Approach : Constructivist Learning in Dewey, Piaget, and Montessori , 2011 .

[18]  Weng-Keen Wong,et al.  Principles of Explanatory Debugging to Personalize Interactive Machine Learning , 2015, IUI.

[19]  Anne Marie Piper,et al.  "Siri, is this you?": Understanding young children's interactions with voice input systems , 2015, IDC.

[20]  C. J. Nuesse The Human Use of Human Beings: Cybernetics and Society , 1952 .

[21]  Oren Zuckerman,et al.  Flow blocks as a conceptual bridge between understanding the structure and behavior of a complex causal system , 2006 .

[22]  Janet L. Kolodner,et al.  Designing to Learn About Complex Systems , 2000 .

[23]  Mitchel Resnick,et al.  Some reflections on designing construction kits for kids , 2005, IDC '05.

[24]  Ken Kahn,et al.  Child-Friendly Programming Interfaces to AI Cloud Services , 2017, EC-TEL.

[25]  Ameet Talwalkar,et al.  MLlib: Machine Learning in Apache Spark , 2015, J. Mach. Learn. Res..

[26]  R. Bjork,et al.  The Generation Effect: Support for a Two-Factor Theory , 1988 .

[27]  Alissa Nicole Antle,et al.  The ethics of doing research with vulnerable populations , 2017, Interactions.

[28]  Janet L. Kolodner,et al.  Learning by Design from Theory to Practice , 1998 .

[29]  Hadas Erel,et al.  Digital Outdoor Play: Benefits and Risks from an Interaction Design Perspective , 2018, CHI.

[30]  Carol Strohecker Construction kits as learning environments , 1999, Proceedings IEEE International Conference on Multimedia Computing and Systems.

[31]  Norbert Wiener,et al.  The human use of human beings - cybernetics and society , 1988 .

[32]  F. Leeuw,et al.  Unpacking Black Boxes: Mechanisms and Theory Building in Evaluation , 2010 .

[33]  Mark D. Gross,et al.  roBlocks: a robotic construction kit for mathematics and science education , 2006, ICMI '06.

[34]  Mark Guzdial,et al.  Of Black and Glass Boxes: Scaffolding for Doing and Learning , 1996, ICLS.

[35]  Florence R. Sullivan Robotics and science literacy: Thinking skills, science process skills and systems understanding , 2008 .

[36]  Joseph A. Paradiso,et al.  The gesture recognition toolkit , 2014, J. Mach. Learn. Res..

[37]  A. King Facilitating Elaborative Learning Through Guided Student-Generated Questioning , 1992 .

[38]  Carl E. McFarland,et al.  Retrieval of internally versus externally generated words in episodic memory , 1980 .

[39]  Michael Eisenberg,et al.  Beyond Black Boxes: Bringing Transparency and Aesthetics Back to Scientific Investigation , 2000 .

[40]  Yunjia Sun,et al.  Novice-Centric Visualizations for Machine Learning , 2016 .

[41]  D. D. Poudel,et al.  Hands-On Activities and Challenge Tests in Agricultural and Environmental Education , 2005 .