Integrating data across digital activities

The volume of data that can be captured and stored from students' everyday interactions with digital environments allows for the creation of models of student knowledge, skills, and attributes unobtrusively. However, models and techniques for transforming these data into information that is useful for educators have not been established. This paper explores the use of learning progressions and Bayesian networks (BayesNets) as tools for aggregating evidence across digital learning environments. It includes a worked example demonstrating both the technical creation of a BayesNet and potential classroom application to monitor students' proficiency as they interact with a range of digital media environments.

[1]  Allan M. Collins,et al.  Rethinking Education in the Age of Technology , 2008, Intelligent Tutoring Systems.

[2]  David Heckerman,et al.  A Tutorial on Learning with Bayesian Networks , 1999, Innovations in Bayesian Networks.

[3]  R. Hambleton,et al.  Fundamentals of Item Response Theory , 1991 .

[4]  Robert J. Mislevy,et al.  Specifying and Refining a Measurement Model for a Computer-Based Interactive Assessment , 2004 .

[5]  Drew A. Linzer,et al.  poLCA : Polytomous Variable Latent Class Analysis Version , 2007 .

[6]  Russell G. Almond,et al.  Design and analysis in task-based language assessment , 2002 .

[7]  Robert J. Mislevy,et al.  A Bayesian Network Approach To Modeling Learning Progressions , 2012 .

[8]  K. Vehkalahti.  Foundations of Factor Analysis, Second Edition by Stanley A. Mulaik , 2010 .

[9]  Juan-Diego Zapata-Rivera.  Indirectly Visible Bayesian Student Models , 2007, BMA.

[10]  Lakhmi C. Jain,et al.  Introduction to Bayesian Networks , 2008 .

[11]  Kristen E. DiCerbo,et al.  Game-Based Assessment of Persistence , 2014, J. Educ. Technol. Soc..

[12]  David J. Spiegelhalter,et al.  Local computations with probabilities on graphical structures and their application to expert systems , 1990 .

[13]  Russell G. Almond,et al.  Bayesian networks: A teacher's view , 2009, Int. J. Approx. Reason..

[14]  H. Schweingruber,et al.  TAKING SCIENCE TO SCHOOL: LEARNING AND TEACHING SCIENCE IN GRADES K-8 , 2007 .

[15]  Yadira Espinal.  Viktor Mayer-Schonberger and Kenneth Cukier, Big Data: A Revolution That Will Transform How We Live, Work and Think , 2013 .

[16]  Kristen E. DiCerbo,et al.  Technological Implications for Assessment Ecosystems: Opportunities for Digital Technology to Advance Assessment , 2014, Teachers College Record: The Voice of Scholarship in Education.

[17]  Russell G. Almond,et al.  You Can't Fatten A Hog by Weighing It - Or Can You? Evaluating an Assessment for Learning System Called ACED , 2008, Int. J. Artif. Intell. Educ..

[18]  Robert J. Mislevy,et al.  Automated scoring of complex tasks in computer-based testing , 2006 .

[19]  D. Butler.  Data, data everywhere... , 2005, Nature Structural &Molecular Biology.

[20]  Aaron Rogat,et al.  Learning Progressions in Science: An Evidence-Based Approach to Reform. CPRE Research Report # RR-63. , 2009 .

[21]  Drew A. Linzer,et al.  poLCA: An R Package for Polytomous Variable Latent Class Analysis , 2011 .

[22]  John R. Anderson,et al.  Knowledge tracing: Modeling the acquisition of procedural knowledge , 2005, User Modeling and User-Adapted Interaction.

[23]  Robert J. Mislevy,et al.  Putting ECD into Practice: The Interplay of Theory and Data in Evidence Models within a Digital Learning Environment , 2012, EDM 2012.

[24]  Valerie J. Shute,et al.  Assessment and Learning of Qualitative Physics in Newton's Playground , 2013, AIED.

[25]  L. Lewis.  Teachers’ Use of Educational Technology in U.S. Public Schools: 2009 , 2010 .

[26]  Russell G. Almond,et al.  Modeling Diagnostic Assessments with Bayesian Networks , 2007 .

[27]  Eric Gossett,et al.  Big Data: A Revolution That Will Transform How We Live, Work, and Think , 2015 .

[28]  Dave Evans,et al.  How the Next Evolution of the Internet Is Changing Everything , 2011 .

[29]  Vincent Aleven,et al.  More Accurate Student Modeling through Contextual Estimation of Slip and Guess Probabilities in Bayesian Knowledge Tracing , 2008, Intelligent Tutoring Systems.

[30]  George E. P. Box,et al.  Empirical Model‐Building and Response Surfaces , 1988 .

[31]  A. Cassandra.  A Survey of POMDP Applications , 2003 .

[32]  G. Schwarz.  Estimating the Dimension of a Model , 1978 .

[33]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.

[34]  Lisa A Keller,et al.  Using multivariate generalizability theory to assess the effect of content stratification on the reliability of a performance assessment , 2010, Advances in health sciences education : theory and practice.

[35]  J. Manyika.  Big data: The next frontier for innovation, competition, and productivity , 2011 .