Decomposed Inductive Procedure Learning

Recent advances in machine learning have made it possible to train artificially intelligent agents that perform with super-human accuracy on a great diversity of complex tasks. However, the process of training these capabilities often necessitates millions of annotated examples—far more than humans typically need in order to achieve a passing level of mastery on similar tasks. Thus, while contemporary methods in machine learning can produce agents that exhibit superhuman performance, their rate of learning per opportunity in many domains is decidedly lower than human-learning. In this work we formalize a theory of Decomposed Inductive Procedure Learning (DIPL) that outlines how different forms of inductive symbolic learning can be used in combination to build agents that learn educationally relevant tasks such as mathematical, and scientific procedures, at a rate similar to human learners. We motivate the construction of this theory along Marr’s concepts of the computational, algorithmic, and implementation levels of cognitive modeling, and outline at the computational-level six learning capacities that must be achieved to accurately model human learning. We demonstrate that agents built along the DIPL theory are amenable to satisfying these capacities, and demonstrate, both empirically and theoretically, that DIPL enables the creation of agents that exhibit human-like learning performance.

[1]  Amos Azaria,et al.  SUGILITE: Creating Multimodal Smartphone Automation by Demonstration , 2017, CHI.

[2]  Allen Newell,et al.  Knowledge Level Learning in Soar , 1987, AAAI.

[3]  John E. Laird,et al.  A Standard Model of the Mind: Toward a Common Computational Framework across Artificial Intelligence, Cognitive Science, Neuroscience, and Robotics , 2017, AI Mag..

[4]  Kenneth R. Koedinger,et al.  Efficient Complex Skill Acquisition Through Representation Learning , 2012 .

[5]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[6]  A. Newell You can't play 20 questions with nature and win : projective comments on the papers of this symposium , 1973 .

[7]  Ross D. Shachter,et al.  Using background knowledge to speed reinforcement learning in physical agents , 2001, AGENTS '01.

[8]  Demis Hassabis,et al.  Mastering the game of Go with deep neural networks and tree search , 2016, Nature.

[9]  Burr Settles,et al.  Active Learning Literature Survey , 2009 .

[10]  Oriol Vinyals,et al.  Matching Networks for One Shot Learning , 2016, NIPS.

[11]  Marcin Andrychowicz,et al.  One-Shot Imitation Learning , 2017, NIPS.

[12]  Kurt VanLehn,et al.  The Behavior of Tutoring Systems , 2006, Int. J. Artif. Intell. Educ..

[13]  Gordon Plotkin,et al.  A Note on Inductive Generalization , 2008 .

[14]  J. Ross Quinlan,et al.  Learning logical definitions from relations , 1990, Machine Learning.

[15]  Daniel F. McCaffrey,et al.  Effectiveness of Cognitive Tutor Algebra I at Scale , 2014 .

[16]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[17]  Paul J. Feltovich,et al.  Categorization and Representation of Physics Problems by Experts and Novices , 1981, Cogn. Sci..

[18]  Kenneth R. Koedinger,et al.  The Apprentice Learner architecture: Closing the loop between learning theory and educational data , 2016, EDM.

[19]  John R. Anderson,et al.  ACT-R: A Theory of Higher Level Cognition and Its Relation to Visual Attention , 1997, Hum. Comput. Interact..

[20]  Albert T. Corbett,et al.  The Knowledge-Learning-Instruction Framework: Bridging the Science-Practice Chasm to Enhance Robust Student Learning , 2012, Cogn. Sci..

[21]  Kenneth R. Koedinger,et al.  Toward Stable Asymptotic Learning with Simulated Learners , 2021, AIED.

[22]  Tom M. Mitchell,et al.  Generalization as Search , 2002 .

[23]  Albert T. Corbett,et al.  Cognitive Tutor: Applied research in mathematics education , 2007, Psychonomic bulletin & review.

[24]  Kenneth R. Koedinger,et al.  Investigating the Effect of Meta-cognitive Scaffolding for Learning by Teaching , 2014, Intelligent Tutoring Systems.

[25]  John R. Anderson,et al.  Cognitive Tutors: Lessons Learned , 1995 .

[26]  John E. Laird,et al.  Toward Incremental Knowledge Correction for Agents in Complex Environments , 1995, Machine Intelligence 15.

[27]  J. R. Quinlan,et al.  Comparing connectionist and symbolic learning methods , 1994, COLT 1994.

[28]  C. MacLellan,et al.  TRESTLE: A Model of Concept Formation in Structured Domains , 2016 .

[29]  John E. Laird,et al.  The Soar Cognitive Architecture , 2012 .

[30]  Christopher J. MacLellan,et al.  Computational Models of Human Learning: Applications for Tutor Development, Behavior Prediction, and Theory Testing , 2017 .

[31]  Kenneth R. Koedinger,et al.  Toward Near Zero-Parameter Prediction Using a Computational Model of Student Learning , 2019, EDM.

[32]  Ming-Wei Chang,et al.  BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding , 2019, NAACL.

[33]  Vincent Aleven,et al.  A New Paradigm for Intelligent Tutoring Systems: Example-Tracing Tutors , 2009, Int. J. Artif. Intell. Educ..

[34]  Olusola O. Adesope,et al.  Intelligent tutoring systems and learning outcomes: A meta-analysis , 2014 .

[35]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[36]  R. Mooney,et al.  Explanation-Based Learning: An Alternative View , 1986, Machine Learning.

[37]  Erik Harpstead,et al.  An Interaction Design for Machine Teaching to Develop AI Tutors , 2020, CHI.

[38]  Learning Expert Models for Educationally Relevant Tasks using Reinforcement Learning , 2021, EDM.

[39]  Brad A. Myers,et al.  Gamut: demonstrating whole applications , 1997, UIST '97.

[40]  Kenneth R. Koedinger,et al.  Teaching the Teacher: Tutoring SimStudent Leads to More Effective Cognitive Tutor Authoring , 2014, International Journal of Artificial Intelligence in Education.

[41]  Vincent Aleven,et al.  Example-Tracing Tutors: Intelligent Tutor Development for Non-programmers , 2016, International Journal of Artificial Intelligence in Education.

[42]  Kenneth R. Koedinger,et al.  A Data Repository for the EDM Community: The PSLC DataShop , 2010 .

[43]  Allen Newell,et al.  Chunking in Soar: The anatomy of a general learning mechanism , 1985, Machine Learning.

[44]  Erik Harpstead,et al.  Investigating Differential Error Types Between Human and Simulated Learners , 2020, AIED.

[45]  Andrea Stocco,et al.  A Biologically Plausible Action Selection System for Cognitive Architectures: Implications of Basal Ganglia Anatomy for Learning and Decision-Making Models , 2018, Cogn. Sci..

[46]  John E. Laird,et al.  Soar-RL: integrating reinforcement learning with Soar , 2005, Cognitive Systems Research.

[47]  Giosuè Baggio,et al.  Theory Before the Test: How to Build High-Verisimilitude Explanatory Theories in Psychological Science , 2021, Perspectives on psychological science : a journal of the Association for Psychological Science.

[48]  Nikolaos Doulamis,et al.  Deep Learning for Computer Vision: A Brief Review , 2018, Comput. Intell. Neurosci..

[49]  Kurt VanLehn,et al.  STEPS: a simulated, tutorable physics student , 1995 .

[50]  Rich Caruana,et al.  An empirical comparison of supervised learning algorithms , 2006, ICML.

[51]  Frank J. Lee,et al.  Production Compilation: A Simple Mechanism to Model Complex Skill Acquisition , 2003, Hum. Factors.

[52]  Xuemei Wang,et al.  Learning by Observation and Practice: An Incremental Approach for Planning Operator Acquisition , 1995, ICML.

[53]  Douglas H. Fisher,et al.  Knowledge Acquisition Via Incremental Conceptual Clustering , 1987, Machine Learning.

[54]  H A Simon,et al.  Cue recognition and cue elaboration in learning from examples. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[55]  R. Weale Vision. A Computational Investigation Into the Human Representation and Processing of Visual Information. David Marr , 1983 .

[56]  Siu Kwan Lam,et al.  Numba: a LLVM-based Python JIT compiler , 2015, LLVM '15.

[57]  Kenneth R. Koedinger,et al.  A Machine Learning Approach for Automatic Student Model Discovery , 2011, EDM.

[58]  Pedro M. Domingos,et al.  Learning Repetitive Text-Editing Procedures with SMARTedit , 2001, Your Wish is My Command.

[59]  The Journal of the Learning Sciences , 2018 .

[60]  K. Stowers,et al.  Optimizing Human Performance using Individualized Computational Models of Learning , 2020 .

[61]  C. MacLellan,et al.  Domain-General Tutor Authoring with Apprentice Learner Models , 2020, Int. J. Artif. Intell. Educ..

[62]  Kenneth R. Koedinger,et al.  Integrating representation learning and skill learning in a human-like intelligent agent , 2015, Artif. Intell..

[63]  Amina Adadi,et al.  Peeking Inside the Black-Box: A Survey on Explainable Artificial Intelligence (XAI) , 2018, IEEE Access.

[64]  Kenneth R. Koedinger,et al.  Learning Factors Analysis - A General Method for Cognitive Model Evaluation and Improvement , 2006, Intelligent Tutoring Systems.