Comparison of learning analytics and educational data mining: A topic modeling approach

Abstract Educational data mining and learning analytics, although experiencing an upsurge in exploration and use, continue to elude precise definition; the two terms are often interchangeably used. This could be owing to the fact that the two fields exhibit common thematic elements. One avenue to provide clarity, uniformity, and consistency around the two fields, is to identify similarities and differences in topics between the two evolving fields. This paper conducted a topic modeling analysis of articles related to educational data mining and learning analytics to reveal thematic features of the two fields. Specifically, we employed structural topic modeling to identify the topics of the two fields from the abstracts. We apply structural topic modeling on N=192 articles for educational data mining and N=489 articles for learning analytics. We infer five-topic models for both educational data mining and learning analytics. We find that while there appears to be disciplinary differences in terms of research focus, there is little support for a clear distinction between the two disciplines, beyond their different lineage. T he trend points to a convergence within the field of educational research on the applications of advanced statistical learning techniques to extract actionable insights from large data streams for optimizing teaching and learning. Both fields have converged on an increasing focus on student behaviors over the last five years.

[1]  Anastasios A. Economides,et al.  Learning Analytics and Educational Data Mining in Practice: A Systematic Literature Review of Empirical Evidence , 2014, J. Educ. Technol. Soc..

[2]  Nobuko Fujita,et al.  Scholarship at UWindsor Scholarship at UWindsor Towards Visual Analytics for Teachers’ Dynamic Diagnostic Towards Visual Analytics for Teachers’ Dynamic Diagnostic Pedagogical Decision-Making Pedagogical Decision-Making , 2011 .

[3]  Alekseĭ Nikolaevich Leontʹev Problems of the development of the mind , 1981 .

[4]  Etienne Wenger,et al.  Communities of Practice: Learning, Meaning, and Identity , 1998 .

[5]  F. Dochy,et al.  Using student-centred learning environments to stimulate deep approaches to learning: Factors encouraging or discouraging their effectiveness , 2010 .

[6]  Rebecca Ferguson,et al.  Guest Editorial: Ethics and Privacy in Learning Analytics , 2016, J. Learn. Anal..

[7]  Sidney K. D'Mello,et al.  Evaluating Fairness and Generalizability in Models Predicting On-Time Graduation from College Applications , 2019, EDM.

[8]  Muhittin ŞAHİN,et al.  Educational Data Mining and Learning Analytics: Past, Present and Future , 2020 .

[9]  Vincent Donche,et al.  A Learning Patterns Perspective on Student Learning in Higher Education: State of the Art and Moving Forward , 2017, Educational Psychology Review.

[10]  Gwo-Jen Hwang,et al.  Trends in mobile technology-supported collaborative learning: A systematic review of journal publications from 2007 to 2016 , 2018, Comput. Educ..

[11]  Camilo Vieira,et al.  Visual learning analytics of educational data: A systematic literature review and research agenda , 2018, Comput. Educ..

[12]  Matt Taddy,et al.  On Estimation and Selection for Topic Models , 2011, AISTATS.

[13]  George Siemens,et al.  Learning analytics and educational data mining: towards communication and collaboration , 2012, LAK.

[14]  Ryan S. Baker,et al.  Educational Data Mining and Learning Analytics , 2014 .

[15]  Tenzin Doleck,et al.  A Bibliometric Analysis of the Papers Published in the Journal of Artificial Intelligence in Education from 2015-2019 , 2020, Int. J. Learn. Anal. Artif. Intell. Educ..

[16]  Hosam Al-Samarraie,et al.  Educational data mining and learning analytics for 21st century higher education: A review and synthesis , 2019, Telematics Informatics.

[17]  Ryan S. Baker,et al.  Challenges for the Future of Educational Data Mining: The Baker Learning Analytics Prizes , 2019 .

[18]  Demetrios G. Sampson,et al.  Teaching and Learning Analytics to Support Teacher Inquiry: A Systematic Literature Review , 2017 .

[19]  Ángel Alejandro Juan Pérez,et al.  Educational Data Mining and Learning Analytics: differences, similarities, and time evolution , 2015, International Journal of Educational Technology in Higher Education.

[20]  A. Wise,et al.  Teaching with Analytics: Towards a Situated Model of Instructional Decision-Making , 2019, J. Learn. Anal..

[21]  Chong Wang,et al.  Reading Tea Leaves: How Humans Interpret Topic Models , 2009, NIPS.

[22]  Gwo-Jen Hwang,et al.  Trends and development in technology-enhanced adaptive/personalized learning: A systematic review of journal publications from 2007 to 2017 , 2019, Comput. Educ..

[23]  Michael Prosser,et al.  Problem-based learning: Student learning experiences and outcomes , 2014, Clinical linguistics & phonetics.

[24]  Haoran Xie,et al.  Detecting latent topics and trends in educational technologies over four decades using structural topic modeling: A retrospective of all volumes of Computers & Education , 2020, Comput. Educ..

[25]  Margaret E. Roberts,et al.  stm: An R Package for Structural Topic Models , 2019, Journal of Statistical Software.

[26]  Vicki A. Vescio,et al.  A review of research on the impact of professional learning communities on teaching practice and student learning , 2008 .

[27]  Rebecca Ferguson,et al.  Ethical Challenges for Learning Analytics , 2019, J. Learn. Anal..

[28]  Rui Guo,et al.  Participation-based student final performance prediction model through interpretable Genetic Programming: Integrating learning analytics, educational data mining and theory , 2015, Comput. Hum. Behav..

[29]  Stevens Dormezil,et al.  Differentiating between Educational Data Mining and Learning Analytics: A Bibliometric Approach , 2019, EDM.

[30]  Cristóbal Romero,et al.  Educational data mining and learning analytics: An updated survey , 2020, WIREs Data Mining Knowl. Discov..

[31]  Jürgen Börstler,et al.  Educational Data Mining and Learning Analytics in Programming: Literature Review and Case Studies , 2015, ITiCSE-WGR.

[32]  Kshitij Sharma,et al.  Multimodal teaching analytics: Automated extraction of orchestration graphs from wearable sensor data , 2018, J. Comput. Assist. Learn..

[33]  Haoran Xie,et al.  Fifty years of British Journal of Educational Technology: A topic modeling based bibliometric perspective , 2020, Br. J. Educ. Technol..

[34]  Learning Analytics and Educational Data Mining , 2016 .

[35]  Baichang Zhong,et al.  A systematic review on teaching and learning robotics content knowledge in K-12 , 2018, Comput. Educ..

[36]  Dragan Gasevic,et al.  Complexity leadership in learning analytics: Drivers, challenges and opportunities , 2019, Br. J. Educ. Technol..

[37]  Ruslan Salakhutdinov,et al.  Evaluation methods for topic models , 2009, ICML '09.

[38]  Andrew McCallum,et al.  Optimizing Semantic Coherence in Topic Models , 2011, EMNLP.

[39]  Laura Calvet Liñán,et al.  Educational Data Mining and Learning Analytics: differences, similarities, and time evolution , 2015 .

[40]  Martin Ebner,et al.  Learning Analytics Challenges to Overcome in Higher Education Institutions , 2019, Utilizing Learning Analytics to Support Study Success.