Deep learning goes to school: toward a relational understanding of AI in education

ABSTRACT In Applied AI, or ‘machine learning’, methods such as neural networks are used to train computers to perform tasks without human intervention. In this article, we question the applicability of these methods to education. In particular, we consider a case of recent attempts from data scientists to add AI elements to a handful of online learning environments, such as Khan Academy and the ASSISTments intelligent tutoring system. Drawing on Science and Technology Studies (STS), we provide a detailed examination of the scholarly work carried out by several data scientists around the use of ‘deep learning’ to predict aspects of educational performance. This approach draws attention to relations between various (problematic) units of analysis: flawed data, partially incomprehensible computational methods, narrow forms of educational’ knowledge baked into the online environments, and a reductionist discourse of data science with evident economic ramifications. These relations can be framed ethnographically as a ‘controversy’ that casts doubts on AI as an objective scientific endeavour, whilst illuminating the confusions, the disagreements and the economic interests that surround its implementations.

[1]  B. Latour,et al.  Laboratory Life: The Construction of Scientific Facts , 1979 .

[2]  Philip E. Agre,et al.  Toward a Critical Technical Practice: Lessons Learned in Trying to Reform AI , 2006 .

[3]  Diana E. Forsythe,et al.  Studying Those Who Study Us: An Anthropologist in the World of Artificial Intelligence , 2002 .

[4]  Navdeep Jaitly,et al.  Towards End-To-End Speech Recognition with Recurrent Neural Networks , 2014, ICML.

[5]  Dit-Yan Yeung,et al.  Addressing two problems in deep knowledge tracing via prediction-consistent regularization , 2018, L@S.

[6]  D. Haraway Situated Knowledges: The Science Question in Feminism and the Privilege of Partial Perspective , 1988 .

[7]  Paul Dourish,et al.  Algorithms and their others: Algorithmic culture in context , 2016, Big Data Soc..

[8]  Joseph E. Beck,et al.  Going Deeper with Deep Knowledge Tracing , 2016, EDM.

[9]  Michael C. Mozer,et al.  Automatic Discovery of Cognitive Skills to Improve the Prediction of Student Learning , 2014, NIPS.

[10]  K. Crawford,et al.  Anatomy of an AI System , 2019 .

[11]  Rob Fergus,et al.  Visualizing and Understanding Convolutional Networks , 2013, ECCV.

[12]  Ruth McNally,et al.  Classifying, Constructing, and Identifying Life , 2013 .

[13]  Neil T. Heffernan,et al.  The ASSISTments Ecosystem: Building a Platform that Brings Scientists and Teachers Together for Minimally Invasive Research on Human Learning and Teaching , 2014, International Journal of Artificial Intelligence in Education.

[14]  Adrian Mackenzie,et al.  Machine Learners: Archaeology of a Data Practice , 2017 .

[15]  Rob Kitchin,et al.  The data revolution : big data, open data, data infrastructures & their consequences , 2014 .

[16]  D. MacKenzie,et al.  Statistical Theory and Social Interests , 1978, Social studies of science.

[17]  Harry M. Collins,et al.  Artificial experts - social knowledge and intelligent machines , 1990, Inside technology.

[18]  Sweety Agrawal,et al.  Few hundred parameters outperform few hundred thousand? , 2017, EDM.

[19]  Michael C. Mozer,et al.  How Deep is Knowledge Tracing? , 2016, EDM.

[20]  M. Callon Struggles and Negotiations to Define What is Problematic and What is Not , 1980 .

[21]  Chris Piech,et al.  Learning to Represent Student Knowledge on Programming Exercises Using Deep Learning , 2017, EDM.

[22]  Neil T. Heffernan,et al.  Incorporating Rich Features into Deep Knowledge Tracing , 2017, L@S.

[23]  Chaitanya Ekanadham,et al.  Back to the basics: Bayesian extensions of IRT outperform neural networks for proficiency estimation , 2016, EDM.

[24]  Razvan Pascanu,et al.  On the difficulty of training recurrent neural networks , 2012, ICML.

[25]  Karin D. Knorr-Cetina,et al.  How Superorganisms Change: Consensus Formation and the Social Ontology of High-Energy Physics Experiments , 1995 .

[26]  M. C. Elish,et al.  Situating methods in the magic of Big Data and AI , 2018 .

[27]  Ben Williamson,et al.  Who owns educational theory? Big data, algorithms and the expert power of education data science , 2017 .

[28]  John R. Anderson,et al.  Knowledge tracing: Modeling the acquisition of procedural knowledge , 2005, User Modeling and User-Adapted Interaction.

[29]  Margaret S. Archer,et al.  Critical Realism and Relational Sociology , 2010 .

[30]  Adrian Mackenzie,et al.  Programming subjects in the regime of anticipation: Software studies and subjectivity , 2013 .

[31]  Christopher Kelty,et al.  Ten Thousand Journal Articles Later: Ethnography of «The Literature» in Science , 2009 .

[32]  H. Dreyfus What Computers Can't Do: The Limits of Artificial Intelligence , 1978 .

[33]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.