A literature review of empirical research on learning analytics in medical education

The number of publications in the field of medical education is still markedly low, despite recognition of the value of the discipline in the medical education literature, and exponential growth of publications in other fields. This necessitates raising awareness of the research methods and potential benefits of learning analytics (LA). The aim of this paper was to offer a methodological systemic review of empirical LA research in the field of medical education and a general overview of the common methods used in the field in general. Search was done in Medline database using the term “LA.” Inclusion criteria included empirical original research articles investigating LA using qualitative, quantitative, or mixed methodologies. Articles were also required to be written in English, published in a scholarly peer-reviewed journal and have a dedicated section for methods and results. A Medline search resulted in only six articles fulfilling the inclusion criteria for this review. Most of the studies collected data about learners from learning management systems or online learning resources. Analysis used mostly quantitative methods including descriptive statistics, correlation tests, and regression models in two studies. Patterns of online behavior and usage of the digital resources as well as predicting achievement was the outcome most studies investigated. Research about LA in the field of medical education is still in infancy, with more questions than answers. The early studies are encouraging and showed that patterns of online learning can be easily revealed as well as predicting students’ performance.

[1]  Alvin Y. Wang,et al.  Predictors of web-student performance: the role of self-efficacy and reasons for taking an on-line class , 2002, Comput. Hum. Behav..

[2]  C. Y. Peng,et al.  An Introduction to Logistic Regression Analysis and Reporting , 2002 .

[3]  Alvin Y. Wang,et al.  Predictors of Performance in the Virtual Classroom: Identifying and Helping At-Risk Cyber-Students , 2002 .

[4]  Vania Dimitrova,et al.  Visualising student tracking data to support instructors in web-based distance education , 2004, WWW Alt. '04.

[5]  Errol Yudko,et al.  "Hits" (not "Discussion Posts") predict student success in online courses: A double cross-validation study , 2008, Comput. Educ..

[6]  Leah P. Macfadyen,et al.  Learning or performance: Predicting drivers of student motivation , 2009 .

[7]  Shane Dawson,et al.  Mining LMS data to develop an "early warning system" for educators: A proof of concept , 2010, Comput. Educ..

[8]  Rebecca Ferguson,et al.  Learning analytics: drivers, developments and challenges , 2012 .

[9]  Doug Clow,et al.  The learning analytics cycle: closing the loop effectively , 2012, LAK.

[10]  Ulrik Schroeder,et al.  A reference model for learning analytics , 2012 .

[11]  Sebastián Ventura,et al.  Predicting students' final performance from participation in on-line discussion forums , 2013, Comput. Educ..

[12]  Zdenek Zdráhal,et al.  Improving retention: predicting at-risk students by analysing clicking behaviour in a virtual learning environment , 2013, LAK '13.

[13]  Meri Kailanto,et al.  Visualizations of user data in a social media enhanced web-based environment in higher education , 2013, 2013 IEEE Global Engineering Education Conference (EDUCON).

[14]  George Siemens,et al.  Learning Analytics , 2013 .

[15]  M. Pusic,et al.  Developing the role of big data and analytics in health professional education , 2014, Medical teacher.

[16]  Alyssa Friend Wise,et al.  Learning Analytics for Online Discussions: Embedded and Extracted Approaches , 2014, J. Learn. Anal..

[17]  Dirk T. Tempelaar,et al.  In search for the most informative data for feedback generation: Learning analytics in a data-rich context , 2015, Comput. Hum. Behav..

[18]  Mohammed Saqr Learning Analytics And Medical Education. , 2015, International journal of health sciences.

[19]  Dragan Gasevic,et al.  Learning Analytics – A Growing Field and Community Engagement , 2015 .

[20]  Martin Hlosta,et al.  OU Analyse: analysing at-risk students at The Open University , 2015 .

[21]  I. Doherty,et al.  Contemporary and future eLearning trends in medical education , 2015, Medical teacher.

[22]  Anthony V. Robins,et al.  Illustrating performance indicators and course characteristics to support students’ self-regulated learning in CS1 , 2015, Comput. Sci. Educ..

[23]  Bart Rienties,et al.  Analytics4Action Evaluation Framework: A Review of Evidence-Based Learning Analytics Interventions at the Open University UK , 2016 .

[24]  Richard A. Levine,et al.  Random Forests for Evaluating Pedagogy and Informing Personalized Learning , 2016, EDM 2016.

[25]  Dragan Gasevic,et al.  Learning analytics should not promote one size fits all: The effects of instructional conditions in predicting academic success , 2016, Internet High. Educ..

[26]  Brian J. Novoselich,et al.  An Investigation of First-Year Engineering Student and Instructor Perspectives of Learning Analytics Approaches , 2016, J. Learn. Anal..

[27]  Derek L Choi-Lundberg,et al.  Online dissection audio‐visual resources for human anatomy: Undergraduate medical students’ usage and learning outcomes , 2016, Anatomical sciences education.

[28]  B. Daniel,et al.  Clinical anatomy e-cases: a five-year follow-up of learning analytics. , 2017, The New Zealand medical journal.

[29]  Matti Tedre,et al.  How learning analytics can early predict under-achieving students in a blended medical education course , 2017, Medical teacher.

[30]  M. C. Sáiz Manzanares,et al.  How Do B-Learning and Learning Patterns Influence Learning Outcomes? , 2017, Front. Psychol..

[31]  M. Pusic,et al.  A Big Data and Learning Analytics Approach to Process-Level Feedback in Cognitive Simulations , 2017, Academic medicine : journal of the Association of American Medical Colleges.

[32]  Joel S. Mtebe,et al.  Using Learning Analytics to Predict Students’ Performance in Moodle Learning Management System: A Case of Mbeya University of Science and Technology , 2017, Electron. J. Inf. Syst. Dev. Ctries..

[33]  K. Scott,et al.  Medical student use of digital learning resources , 2018, The clinical teacher.