A reference model for learning analytics

Recently, there is an increasing interest in learning analytics in Technology-Enhanced Learning TEL. Generally, learning analytics deals with the development of methods that harness educational datasets to support the learning process. Learning analytics LA is a multi-disciplinary field involving machine learning, artificial intelligence, information retrieval, statistics and visualisation. LA is also a field in which several related areas of research in TEL converge. These include academic analytics, action analytics and educational data mining. In this paper, we investigate the connections between LA and these related fields. We describe a reference model for LA based on four dimensions, namely data and environments what?, stakeholders who?, objectives why? and methods how?. We then review recent publications on LA and its related fields and map them to the four dimensions of the reference model. Furthermore, we identify various challenges and research opportunities in the area of LA in relation to each dimension.

[1]  Sebastián Ventura,et al.  Educational data mining: A survey from 1995 to 2005 , 2007, Expert Syst. Appl..

[2]  John R. Anderson,et al.  Using Neural Imaging and Cognitive Modeling to Infer Mental States while Using an Intelligent Tutoring System , 2010, EDM.

[3]  Paulo Blikstein,et al.  Using learning analytics to assess students' behavior in open-ended programming tasks , 2011, LAK.

[4]  Stephen Fancsali,et al.  Variable construction for predictive and causal modeling of online education data , 2011, LAK.

[5]  Mohamed Amine Chatti.  Personalization in technology enhanced learning: a social software perspective , 2010 .

[6]  ChattiMohamed Amine,et al.  A reference model for learning analytics , 2012 .

[7]  Austin Gibbons,et al.  Learning Analytics , 2014, Encyclopedia of Social Network Analysis and Mining.

[8]  Ryan Shaun Joazeiro de Baker,et al.  An Analysis of the Differences in the Frequency of Students' Disengagement in Urban, Rural, and Suburban High Schools , 2010, EDM.

[9]  Sebastián Ventura,et al.  Mining Rare Association Rules from e-Learning Data , 2010, EDM.

[10]  Zachary A. Pardos,et al.  Does Time Matter? Modeling the Effect of Time with Bayesian Knowledge Tracing , 2011, EDM.

[11]  Lars Schmidt-Thieme,et al.  Factorization Models for Forecasting Student Performance , 2011, EDM.

[12]  Nikos Palavitsinis,et al.  Applying analytics for a learning portal: the Organic.Edunet case study , 2011, LAK.

[13]  Gediminas Adomavicius,et al.  Toward the next generation of recommender systems: a survey of the state-of-the-art and possible extensions , 2005, IEEE Transactions on Knowledge and Data Engineering.

[14]  Erik Duval,et al.  Dataset-driven research for improving recommender systems for learning , 2011, LAK.

[15]  Louis C. Pugliese,et al.  Action Analytics: Measuring and Improving Performance that Matters in Higher Education. , 2008 .

[16]  Vipin Kumar,et al.  Chapman & Hall/CRC Data Mining and Knowledge Discovery Series , 2008 .

[17]  Donald Norris,et al.  Framing action analytics and putting them to work , 2008 .

[18]  Christian D. Schunn,et al.  Assessing Reviewer's Performance Based on Mining Problem Localization in Peer-Review Data , 2010, EDM.

[19]  Cristina Conati,et al.  A Framework for Capturing Distinguishing User Interaction Behaviors in Novel Interfaces , 2011, EDM.

[20]  Pasi Fränti,et al.  Web Data Mining , 2009, Encyclopedia of Database Systems.

[21]  James R. Curran,et al.  Data Mining for Generating Hints in a Python Tutor , 2010, EDM.

[22]  M. Baglin.  All You Need to Know about Action Research , 2007 .

[23]  Ryan S. Baker,et al.  The State of Educational Data Mining in 2009: A Review and Future Visions. , 2009, EDM 2009.

[24]  Zachary A. Pardos,et al.  Less is More: Improving the Speed and Prediction Power of Knowledge Tracing by Using Less Data , 2011, EDM.

[25]  Maren Scheffel,et al.  Usage contexts for object similarity: exploratory investigations , 2011, LAK.

[26]  Sebastián Ventura,et al.  Educational Data Mining: A Review of the State of the Art , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[27]  Tanya Elias,et al.  Learning Analytics: Definitions, Processes and Potential , 2011 .

[28]  Yue Gong,et al.  Items, Skills, and Transfer Models: Which Really Matters for Student Modeling? , 2011, EDM.

[29]  Rebecca Ferguson,et al.  Learning analytics: drivers, developments and challenges , 2012 .

[30]  Nobuko Fujita,et al.  Scholarship at UWindsor Scholarship at UWindsor Towards Visual Analytics for Teachers’ Dynamic Diagnostic Towards Visual Analytics for Teachers’ Dynamic Diagnostic Pedagogical Decision-Making Pedagogical Decision-Making , 2011 .

[31]  Kimberly E. Arnold.  Signals: Applying Academic Analytics. , 2010 .

[32]  Stanley Wasserman,et al.  Social Network Analysis: Methods and Applications , 1994, Structural analysis in the social sciences.

[33]  Mykola Pechenizkiy,et al.  Handbook of Educational Data Mining , 2010 .

[34]  Colin Tattersall,et al.  Integration of adaptive learning processes with IMS Learning Design considering corporate requirements. , 2007 .

[35]  Doug Clow,et al.  iSpot analysed: participatory learning and reputation , 2011, LAK.

[36]  Vania Dimitrova,et al.  CourseVis: A graphical student monitoring tool for supporting instructors in web-based distance courses , 2007, Int. J. Hum. Comput. Stud..

[37]  Daniel D. Suthers,et al.  A unified framework for multi-level analysis of distributed learning , 2011, LAK.

[38]  D. Boud,et al.  Reflection, turning experience into learning , 1985 .

[39]  Petra Perner,et al.  Data Mining - Concepts and Techniques , 2002, Künstliche Intell..

[40]  Judy Kay,et al.  Adaptive Technologies for Training and Education: Lifelong Learner Modeling , 2012 .

[41]  Sebastián Ventura,et al.  Data mining in course management systems: Moodle case study and tutorial , 2008, Comput. Educ..

[42]  Neil T. Heffernan,et al.  Can We Get Better Assessment From A Tutoring System Compared to Traditional Paper Testing? Can We Have Our Cake (Better Assessment) and Eat It too (Student Learning During the Test)? , 2010, EDM.

[43]  Gautam Biswas,et al.  Analysis of Productive Learning Behaviors in a Structured Inquiry Cycle Using Hidden Markov Models , 2010, EDM.

[44]  John P. Campbell,et al.  Academic Analytics: A New Tool for a New Era. , 2007 .

[45]  Rebecca Nugent,et al.  Skill Set Profile Clustering: The Empty K-Means Algorithm with Automatic Specification of Starting Cluster Centers , 2010, EDM.

[46]  Dennis Zielke,et al.  Design and Implementation of a Learning Analytics Toolkit for Teachers , 2012, J. Educ. Technol. Soc..

[47]  Shane Dawson,et al.  SNAPP: a bird's-eye view of temporal participant interaction , 2011, LAK.

[48]  Jim E. Greer,et al.  The who, what, when, and why of lecture capture , 2011, LAK.

[49]  Abigail Selzer King,et al.  Using Signals for appropriate feedback: Perceptions and practices , 2011, Comput. Educ..

[50]  Peter N. Posch,et al.  Teachers investigate their work : an introduction to the methods of action research , 1993 .

[51]  Riccardo Mazza,et al.  Introduction to Information Visualization , 2009 .