Quality Indicators for Learning Analytics

This article proposes a framework of quality indicators for learning analytics that aims to standardise the evaluation of learning analytics tools and to provide a mean to capture evidence for the impact of learning analytics on educational practices in a standardised manner. The criteria of the framework and its quality indicators are based on the results of a Group Concept Mapping study conducted with experts from the field of learning analytics. The outcomes of this study are further extended with findings from a focused literature review.

[1]  E. Duval.  Attention please!: learning analytics for visualization and recommendation , 2011, LAK.

[2]  Pierre Sens,et al.  Stream Processing of Healthcare Sensor Data: Studying User Traces to Identify Challenges from a Big Data Perspective , 2015, ANT/SEIT.

[3]  Tanya Elias,et al.  Learning Analytics: Definitions, Processes and Potential , 2011 .

[4]  Hendrik Drachsler,et al.  Translating Learning into Numbers: A Generic Framework for Learning Analytics , 2012, J. Educ. Technol. Soc..

[5]  Steven Lonn,et al.  An exercise in institutional reflection: the learning analytics readiness instrument (LARI) , 2014, LAK.

[6]  Rebecca Ferguson,et al.  Learning analytics: drivers, developments and challenges , 2012 .

[7]  J. Hoven,et al.  Information Technology and Moral Philosophy: List of Contributors , 2008 .

[8]  Sandra Taylor,et al.  Reflective practice: writing and professional development , 2011 .

[9]  Lorna Wong,et al.  Building institutional capacities and competencies for systemic learning analytics initiatives , 2014, LAK.

[10]  Xavier Ochoa,et al.  Techniques for data-driven curriculum analysis , 2014, LAK.

[11]  Hendrik Drachsler,et al.  Identifying the Goal, User model and Conditions of Recommender Systems for Formal and Informal Learning , 2009, J. Digit. Inf..

[12]  Mary Kane,et al.  Concept Mapping for Planning and Evaluation , 2006 .

[13]  Charles Oppenheim,et al.  Legal, Risk and Ethical Aspects of Analytics in Higher Education , 2012 .

[14]  Mykola Pechenizkiy,et al.  Handbook of Educational Data Mining , 2010 .

[15]  Carlos Delgado Kloos,et al.  Usage Pattern Recognition in Student Activities , 2011, EC-TEL.

[16]  Ramón Fabregat,et al.  Activity-Based Learner-Models for Learner Monitoring and Recommendations in Moodle , 2011, EC-TEL.

[17]  Batya Friedman,et al.  Human values and the design of computer technology , 1997 .

[18]  Davide Taibi,et al.  Fostering Analytics on Learning Analytics Research: the LAK Dataset , 2013, LAK.

[19]  Doug Clow,et al.  The learning analytics cycle: closing the loop effectively , 2012, LAK.

[20]  Mica R. Endsley,et al.  Theoretical Underpinnings of Situation Awareness, A Critical Review , 2000 .

[21]  Wim Westera,et al.  Infusing Reflective Practice in eLearning Courses - Can Widgets Help? , 2011, MUPPLE@EC-TEL.

[22]  James E. Willis,et al.  Ethics, Big Data, and Analytics: A Model for Application , 2013 .

[23]  Erik Duval,et al.  The student activity meter for awareness and self-reflection , 2012, CHI Extended Abstracts.

[24]  George Siemens,et al.  Learning analytics and educational data mining: towards communication and collaboration , 2012, LAK.

[25]  Hendrik Drachsler,et al.  The pulse of learning analytics understandings and expectations from the stakeholders , 2012, LAK.

[26]  Erik Duval,et al.  Dataset-Driven Research to Support Learning and Knowledge Analytics , 2012, J. Educ. Technol. Soc..

[27]  Donald A. Schön,et al.  The Reflective Practitioner: How Professionals Think in Action. , 1987 .

[28]  Lynn McAlpine,et al.  Reflection: issues related to improving professors' teaching and students' learning , 2000 .

[29]  Mica R. Endsley,et al.  Toward a Theory of Situation Awareness in Dynamic Systems , 1995, Hum. Factors.

[30]  D. Verpoorten.  Reflection amplifiers in self-regulated learning , 2012 .

[31]  Kenneth R. Koedinger,et al.  A Data Repository for the EDM Community: The PSLC DataShop , 2010 .

[32]  Alyssa Friend Wise,et al.  Designing pedagogical interventions to support student use of learning analytics , 2014, LAK.

[33]  George Siemens,et al.  Ethical and privacy principles for learning analytics , 2014, Br. J. Educ. Technol..

[34]  John C. Burnham,et al.  Psychiatry and the Human Condition , 1976 .

[35]  Carlos Delgado Kloos,et al.  Key Action Extraction for Learning Analytics , 2012, EC-TEL.

[36]  J. Hoven,et al.  Information technology, privacy and the protection of personal data , 2008 .

[37]  Claus Zinn,et al.  Getting to Know Your Student in Distance Learning Contexts , 2006, EC-TEL.

[38]  D. Schoen,et al.  The Reflective Practitioner: How Professionals Think in Action , 1985 .

[39]  George Siemens,et al.  Penetrating the fog: analytics in learning and education , 2014 .

[40]  Matthew D. Pistilli,et al.  Course signals at Purdue: using learning analytics to increase student success , 2012, LAK.

[41]  Ulrik Schroeder,et al.  Supporting action research with learning analytics , 2013, LAK '13.

[42]  Erik Duval,et al.  Recommender Systems for Technology Enhanced Learning ( RecSysTEL 2010 ) Issues and Considerations regarding Sharable Data Sets for Recommender Systems in Technology Enhanced Learning , 2010 .

[43]  Daniel J. Garland,et al.  Situation Awareness Analysis and Measurement , 2009 .