Learning Analytics Evaluation - Beyond Usability

Learning analytics tools should be useful, i.e., they should be usable and provide the functionality for reaching the goals attributed to learning analytics. We present a short summary of the learning analytics goals, and the importance of evaluation of learning analytics while trying to attain these goals. Furthermore, we present three different case studies of learning analytics eval- uation, and in the end provide a short outlook about the necessity of systematic way of learning analytics evaluation.

[1]  Maren Scheffel,et al.  Quality Indicators for Learning Analytics , 2014, J. Educ. Technol. Soc..

[2]  Shane Dawson,et al.  Where learning analytics meets learning design , 2012, LAK '12.

[3]  Yu-O Yang.  Penetrating the Fog , 2016, Nursing science quarterly.

[4]  Tanya Elias,et al.  Learning Analytics: Definitions, Processes and Potential , 2011 .

[5]  Larry Johnson,et al.  The NMC Horizon Report: 2012 Higher Education Edition. , 2012 .

[6]  Peter Goodyear,et al.  Processing and Visualizing Data in Complex Learning Environments , 2013 .

[7]  Ulrik Schroeder,et al.  A reference model for learning analytics , 2012 .

[8]  Erik Duval,et al.  Learning Analytics Dashboard Applications , 2013 .

[9]  Alan J. Dix,et al.  An explorative analysis of user evaluation studies in information visualisation , 2006, BELIV '06.

[10]  George Siemens,et al.  Penetrating the fog: analytics in learning and education , 2014 .

[11]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[12]  Matthew D. Pistilli,et al.  Course signals at Purdue: using learning analytics to increase student success , 2012, LAK.

[13]  Austin Gibbons,et al.  Learning Analytics , 2014, Encyclopedia of Social Network Analysis and Mining.

[14]  Ulrik Schroeder,et al.  Supporting action research with learning analytics , 2013, LAK '13.

[15]  Doug Clow.  An overview of learning analytics , 2013 .

[16]  Erik Duval,et al.  The student activity meter for awareness and self-reflection , 2012, CHI Extended Abstracts.

[17]  Maren Scheffel,et al.  Developing an evaluation framework of quality indicators for learning analytics , 2015, LAK.

[18]  Marek Hatala,et al.  A qualitative evaluation of evolution of a learning analytics tool , 2012, Comput. Educ..

[19]  Ulrik Schroeder,et al.  Learning Analytics: Challenges and Future Research Directions , 2014 .

[20]  George Siemens,et al.  Let’s not forget: Learning analytics are about learning , 2015 .