How to Design Effective Learning Analytics Indicators? A Human-Centered Design Approach

Empowering learners and teachers to take control of the indicator design process can increase value and drive forward the acceptance and adoption of learning analytics (LA) systems. In this paper, we present the Human-Centered Indicator Design (HCID) approach as a theory-driven framework to guide the systematic and effective design of LA indicators that truly meet user needs. With human needs at the forefront, the aim of HCID is to enable a shift from an ad hoc, data-first to a systematic, people-first approach to indicator design. As a proof of concept, we present a case of applying the HCID approach to indicator design in a higher education context. The case demonstrates that HCID could be a viable approach to design useful LA indicators for and with their users, informed by design practices from the human-computer interaction (HCI) and information visualization fields.

[1]  Dennis P. Groth,et al.  Engaging Faculty in Learning Analytics: Agents of Institutional Culture Change , 2019, J. Learn. Anal..

[2]  Jovita M. Vytasek,et al.  What if Learning Analytics Were Based on Learning Science , 2016 .

[3]  Inge Molenaar,et al.  Designing dashboards to support learners' self-regulated learning , 2019, LAK 2019.

[4]  George Siemens,et al.  Let’s not forget: Learning analytics are about learning , 2015 .

[5]  Judy Kay,et al.  Open learner models and learning analytics dashboards: a systematic review , 2018, LAK.

[6]  Maren Scheffel,et al.  License to evaluate: preparing learning analytics dashboards for educational practice , 2018, LAK.

[7]  June Ahn,et al.  Designing in Context: Reaching Beyond Usability in Learning Analytics Dashboard Design , 2019, J. Learn. Anal..

[8]  Maren Scheffel,et al.  Awareness Is Not Enough: Pitfalls of Learning Analytics Dashboards in the Educational Practice , 2017, EC-TEL.

[9]  Erik Duval,et al.  Learning Analytics Dashboard Applications , 2013 .

[10]  Colin Ware,et al.  Information Visualization: Perception for Design , 2000 .

[11]  Sakinah S. J. Alhadad,et al.  Visualizing Data to Support Judgement, Inference, and Decision Making in Learning Analytics: Insights from Cognitive Psychology and Visualization Science , 2018, J. Learn. Anal..

[12]  Theresa Dirndorfer Anderson,et al.  Co-designing learning analytics tools with learners , 2018, Learning Analytics in the Classroom.

[13]  Judy Kay,et al.  LATUX: an Iterative Workflow for Designing, Validating and Deploying Learning Analytics Visualisations , 2016 .

[14]  Mollie Dollinger,et al.  Co-creation strategies for learning analytics , 2018, LAK.

[15]  Mohamed Amine Chatti,et al.  The PERLA Framework: Blending Personalization and Learning Analytics , 2019 .

[16]  Chris North,et al.  Toward measuring visualization insight , 2006, IEEE Computer Graphics and Applications.

[17]  Vincent Aleven,et al.  Co-Designing a Real-Time Classroom Orchestration Tool to Support Teacher-AI Complementarity , 2019, J. Learn. Anal..

[18]  Haiyi Zhu,et al.  Towards Value-Sensitive Learning Analytics Design , 2018, LAK.

[19]  Katrien Verbert,et al.  Linking learning behavior analytics and learning science concepts: Designing a learning analytics dashboard for feedback to support learning regulation , 2020, Comput. Hum. Behav..

[20]  Ulrik Schroeder,et al.  The Goal - Question - Indicator Approach for Personalized Learning Analytics - , 2017, CSEDU.

[21]  María Jesús Rodríguez-Triana,et al.  Perceiving Learning at a Glance: A Systematic Literature Review of Learning Dashboard Research , 2017, IEEE Transactions on Learning Technologies.

[22]  Rebecca Ferguson,et al.  Human-Centred Learning Analytics , 2019, J. Learn. Anal..

[23]  Mollie Dollinger,et al.  Working Together in Learning Analytics Towards the Co-Creation of Value , 2019, J. Learn. Anal..

[24]  Dragan Gasevic,et al.  How Do We Start? State Directions of Learning Analytics Adoption , 2016 .

[25]  Kate Thompson,et al.  Theory-led Design of Instruments and Representations in Learning Analytics: Developing a Novel Tool for Orchestration of Online Collaborative Learning , 2015, J. Learn. Anal..

[26]  Erik Duval,et al.  Learning dashboards: an overview and future research opportunities , 2013, Personal and Ubiquitous Computing.

[27]  Jonathan C. Roberts,et al.  Towards more Visual Analytics in Learning Analytics , 2014, EuroVA@EuroVis.

[28]  Erik Duval,et al.  Learning analytics dashboards , 2017 .