Learning analytics in European higher education - Trends and barriers

Abstract Learning analytics (LA) as a research field has grown rapidly over the last decade. However, adoption of LA is mostly found to be small in scale and isolated at the instructor level. This paper presents an exploratory study on institutional approaches to LA in European higher education and discusses prominent challenges that impede LA from reaching its potential. Based on a series of consultations with senior managers from 83 different higher education institutions in 24 European countries, we observe that LA is primarily perceived as a tool to enhance teaching and institutional management. As a result, teaching and support staff are found to be the main users of LA and the target audience of training support. In contrast, there is little evidence of active engagement with students or using LA to develop self-regulated learning skills. We highlight the importance of grounding LA in learning sciences and including students as a key stakeholder in the design and implementation of LA. This paper contributes to our understanding of the development of LA in European higher education and highlights areas to address in both practice and research.

[1]  K. Eisenhardt.  Building theories from case study research , 1989, STUDI ORGANIZZATIVI.

[2]  P. Kirschner,et al.  The myths of the digital native and the multitasker , 2017 .

[3]  Carlos Delgado Kloos,et al.  Prediction in MOOCs: A Review and Future Research Directions , 2019, IEEE Transactions on Learning Technologies.

[4]  What makes good feedback good? , 2021, Studies in Higher Education.

[5]  George Siemens,et al.  Increasing the Impact of Learning Analytics , 2019, LAK.

[6]  D. Gašević,et al.  Empowering learners with personalised learning approaches? Agency, equity and transparency in the context of learning analytics , 2019, Assessment & Evaluation in Higher Education.

[7]  Christothea Herodotou,et al.  Predictive Learning Analytics "At Scale": Towards Guidelines to Successful Implementation in Higher Education Based on the Case of the Open University UK. , 2019 .

[8]  B. Daniel,et al.  The perceptions of the meaning and value of analytics in New Zealand higher education institutions , 2017, International Journal of Educational Technology in Higher Education.

[9]  P. Prinsloo,et al.  Learning Analytics , 2013 .

[10]  Leah P. Macfadyen,et al.  Embracing Big Data in Complex Educational Systems: The Learning Analytics Imperative and the Policy Challenge. , 2014 .

[11]  Billy Tak-Ming Wong,et al.  Learning analytics in higher education: an analysis of case studies , 2017 .

[12]  Tracii Ryan,et al.  The challenges of feedback in higher education , 2019, Assessment & Evaluation in Higher Education.

[13]  Hendrik Drachsler,et al.  Translating Learning into Numbers: A Generic Framework for Learning Analytics , 2012, J. Educ. Technol. Soc..

[14]  Rebecca Ferguson,et al.  Learning analytics: drivers, developments and challenges , 2012 .

[15]  Dragan Gašević,et al.  The privacy paradox and its implications for learning analytics , 2020, LAK.

[16]  Dirk Ifenthaler,et al.  Features students really expect from learning analytics , 2016, Comput. Hum. Behav..

[17]  Stephanie D. Teasley,et al.  Conceptualizing co-enrollment: accounting for student experiences across the curriculum , 2018, LAK.

[18]  Vincent Aleven,et al.  Co-Designing a Real-Time Classroom Orchestration Tool to Support Teacher-AI Complementarity , 2019, J. Learn. Anal..

[19]  Linda Corrin,et al.  What data and analytics can and do say about effective learning , 2017, npj Science of Learning.

[20]  Mansureh Kebritchi,et al.  Learning Analytics Methods, Benefits, and Challenges in Higher Education: A Systematic Literature Review. , 2016 .

[21]  Dragan Gasevic,et al.  Learning analytics in higher education --- challenges and policies: a review of eight learning analytics policies , 2017, LAK.

[22]  D. Carless,et al.  Developing sustainable feedback practices , 2011 .

[23]  Z. Zdráhal,et al.  A large-scale implementation of predictive learning analytics in higher education: the teachers’ role and perspective , 2019, Educational Technology Research and Development.

[24]  Sarah J. Tracy.  Qualitative Research Methods: Collecting Evidence, Crafting Analysis, Communicating Impact , 2012 .

[25]  David Boud,et al.  The development of student feedback literacy: enabling uptake of feedback , 2018 .

[26]  Olga Viberg,et al.  Efforts in Europe for Data-Driven Improvement of Education - A Review of Learning Analytics Research in Seven Countries , 2019, Int. J. Learn. Anal. Artif. Intell. Educ..

[27]  George Siemens,et al.  Learning analytics and educational data mining: towards communication and collaboration , 2012, LAK.

[28]  Elizabeth Colucci,et al.  E-Learning in European Higher Education Institutions: Results of a Mapping Survey Conducted in October-December 2013. , 2014 .

[29]  Dragan Gasevic,et al.  Proceedings of the 8th International Conference on Learning Analytics and Knowledge , 2011, LAK.

[30]  Alan Rubel,et al.  Student privacy in learning analytics: An information ethics perspective , 2014, Inf. Soc..

[31]  Olga Viberg,et al.  The current landscape of learning analytics in higher education , 2018, Comput. Hum. Behav..

[32]  Dragan Gasevic,et al.  Piecing the learning analytics puzzle: a consolidated model of a field of research and practice , 2017 .

[33]  Dragan Gasevic,et al.  The SHEILA Framework: Informing Institutional Strategies and Policy Processes of Learning Analytics , 2018, J. Learn. Anal..

[34]  Martin Ebner,et al.  Learning Analytics Challenges to Overcome in Higher Education Institutions , 2019, Utilizing Learning Analytics to Support Study Success.

[35]  S. A. Becker,et al.  NMC Horizon Report: 2016 Higher Education Edition , 2015 .

[36]  Kevin Ashford-Rowe,et al.  EDUCAUSE Horizon Report: 2019 Higher Education Edition. , 2019 .

[37]  Maren Scheffel,et al.  License to evaluate: preparing learning analytics dashboards for educational practice , 2018, LAK.

[38]  Linda Corrin,et al.  Enhancing learning analytics by understanding the needs of teachers , 2013 .

[39]  George Siemens,et al.  Let’s not forget: Learning analytics are about learning , 2015 .

[40]  Fred D. Davis.  Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology , 1989, MIS Q..

[41]  Shahira El Alfy,et al.  Exploring the benefits and challenges of learning analytics in higher education institutions: a systematic literature review , 2019, Information Discovery and Delivery.

[42]  María Jesús Rodríguez-Triana,et al.  Orchestrating learning analytics (OrLA): Supporting inter-stakeholder communication about adoption of learning analytics at the classroom level , 2019, Australasian Journal of Educational Technology.

[43]  Saeed-Ul Hassan,et al.  A bibliometric perspective of learning analytics research landscape , 2018, Behav. Inf. Technol..

[44]  George Siemens,et al.  Ethical and privacy principles for learning analytics , 2014, Br. J. Educ. Technol..

[45]  Martin Ebner,et al.  Learning Analytics in Higher Education—A Literature Review , 2017 .

[46]  Hendrik Drachsler,et al.  Opportunities and Challenges in Using Learning Analytics in Learning Design , 2017, EC-TEL.

[47]  Hendrik Drachsler,et al.  Privacy and analytics: it's a DELICATE issue a checklist for trusted learning analytics , 2016, LAK.

[48]  Dragan Gasevic,et al.  Using learning analytics to scale the provision of personalised feedback , 2019, Br. J. Educ. Technol..

[49]  Dragan Gasevic,et al.  A Systematic Review of Empirical Studies on Learning Analytics Dashboards: A Self-Regulated Learning Perspective , 2020, IEEE Transactions on Learning Technologies.

[50]  Dragan Gasevic,et al.  Complexity leadership in learning analytics: Drivers, challenges and opportunities , 2019, Br. J. Educ. Technol..

[51]  A. Wise,et al.  Why Theory Matters More than Ever in the Age of Big Data , 2015, J. Learn. Anal..

[52]  David Heath,et al.  Let's talk learning analytics: A framework for implementation in relation to student retention , 2015 .