Learning analytics in higher education: an analysis of case studies

Purpose The purpose of this paper is to present a systematic review of the mounting research work on learning analytics. Design/methodology/approach This study collects and summarizes information on the use of learning analytics. It identifies how learning analytics has been used in the higher education sector, and the expected benefits for higher education institutions. Empirical research and case studies on learning analytics were collected, and the details of the studies were categorized, including their objectives, approaches, and major outcomes. Findings The results show the benefits of learning analytics, which help institutions to utilize available data effectively in decision making. Learning analytics can facilitate evaluation of the effectiveness of pedagogies and instructional designs for improvement, and help to monitor closely students’ learning and persistence, predict students’ performance, detect undesirable learning behaviours and emotional states, and identify students at risk, for taking prompt follow-up action and providing proper assistance to students. It can also provide students with insightful data about their learning characteristics and patterns, which can make their learning experiences more personal and engaging, and promote their reflection and improvement. Originality/value Despite being increasingly adopted in higher education, the existing literature on learning analytics has focussed mainly on conventional face-to-face institutions, and has yet to adequately address the context of open and distance education. The findings of this study enable educational organizations and academics, especially those in open and distance institutions, to keep abreast of this emerging field and have a foundation for further exploration of this area.

[1]  Jacob Cohen Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[2]  Juan Cruz-Benito,et al.  Monitoring and feedback of learning processes in virtual worlds through analytics architectures: A real case , 2014, 2014 9th Iberian Conference on Information Systems and Technologies (CISTI).

[3]  Ángel Francisco Agudo-Peregrina,et al.  Assessing the suitability of student interactions from Moodle data logs as predictors of cross-curricular competencies , 2015, Comput. Hum. Behav..

[4]  Francis Harvey Technology Tools for Developing, Delivering, Updating and Assessing Sustainable High-Quality Academic Programs , 2013 .

[5]  Zane L. Berge,et al.  Learning analytics as a tool for closing the assessment loop in higher education , 2012 .

[6]  Bart Rienties,et al.  Reviewing three case-studies of learning analytics interventions at the open university UK , 2016, LAK.

[7]  Mikhael Star,et al.  GPS: Shaping Student Success One Conversation at a Time. , 2010 .

[8]  Paula de Barba,et al.  The role of students' motivation and participation in predicting performance in a MOOC , 2016, J. Comput. Assist. Learn..

[9]  Carolyn Penstein Rosé,et al.  Towards triggering higher-order thinking behaviors in MOOCs , 2016, LAK.

[10]  Nickolas J. G. Falkner,et al.  Using Learning Analytics to Visualise Computer Science Teamwork , 2015, ITiCSE.

[11]  P. Lachenbruch Statistical Power Analysis for the Behavioral Sciences (2nd ed.) , 1989 .

[12]  Eitel J. M. Lauría,et al.  Early Alert of Academically At-Risk Students: An Open Source Analytics Initiative , 2014, J. Learn. Anal..

[13]  Bart Rienties,et al.  Analytics4Action Evaluation Framework: A Review of Evidence-Based Learning Analytics Interventions at the Open University UK , 2016 .

[14]  Mansureh Kebritchi,et al.  Learning Analytics Methods, Benefits, and Challenges in Higher Education: A Systematic Literature Review. , 2016 .

[15]  Irena Koprinska,et al.  Mining autograding data in computer science education , 2016, ACSW.

[16]  Linda Corrin,et al.  How do students interpret feedback delivered via dashboards? , 2015, LAK.

[17]  Jürgen Börstler,et al.  Educational Data Mining and Learning Analytics in Programming: Literature Review and Case Studies , 2015, ITiCSE-WGR.

[18]  Matthew D. Pistilli,et al.  Course signals at Purdue: using learning analytics to increase student success , 2012, LAK.

[19]  Vernon C. Smith,et al.  Predictive Modeling to Forecast Student Outcomes and Drive Effective Interventions in Online Community College Courses , 2012 .

[20]  Sandra Milligan,et al.  Crowd-sourced learning in MOOCs: learning analytics meets measurement theory , 2015, LAK.

[21]  Francisco J. García-Peñalvo,et al.  Using Learning Analytics to improve teamwork assessment , 2015, Comput. Hum. Behav..

[22]  Dragan Gasevic,et al.  Profiling MOOC Course Returners: How Does Student Behavior Change Between Two Course Enrollments? , 2016, L@S.

[23]  Bart Rienties,et al.  Analysing 157 learning designs using learning analytic approaches as a means to evaluate the impact of pedagogical decision making , 2016, Br. J. Educ. Technol..

[24]  Paul Prinsloo,et al.  Educational Triage in Open Distance Learning: Walking a Moral Tightrope. , 2014 .

[25]  Maja Matetic,et al.  Mining student data to assess the impact of moodle activities and prior knowledge on programming course success , 2015, CompSysTech '15.

[26]  Bernie Dodge,et al.  Improving undergraduate student achievement in large blended courses through data-driven interventions , 2015, LAK.

[27]  Yasmin,et al.  Application of the classification tree model in predicting learner dropout behaviour in open and distance learning , 2013 .

[28]  Tsuyoshi Usagawa,et al.  Development of Open Textbooks Learning Analytics System , 2016 .

[29]  Anastasios A. Economides,et al.  Learning Analytics and Educational Data Mining in Practice: A Systematic Literature Review of Empirical Evidence , 2014, J. Educ. Technol. Soc..

[30]  Justin Reich,et al.  Forecasting student achievement in MOOCs with natural language processing , 2016, LAK.

[31]  Gary K. W. Wong,et al.  Academic Performance Prediction Using Chance Discovery from Online Discussion Forums , 2016, 2016 IEEE 40th Annual Computer Software and Applications Conference (COMPSAC).

[32]  Norlida Buniyamin,et al.  An overview of using academic analytics to predict and improve students' achievement: A proposed proactive intelligent intervention , 2013, 2013 IEEE 5th Conference on Engineering Education (ICEED).

[33]  Francisco J. García-Peñalvo,et al.  Exploring Software Engineering Subjects by Using Visual Learning Analytics Techniques , 2015, IEEE Revista Iberoamericana de Tecnologias del Aprendizaje.

[34]  A. L. Dyckhoff Implications for Learning Analytics Tools : A Meta-Analysis of Applied Research Questions , 2011 .

[35]  Jordi Conesa,et al.  A Semi-automatic System to Detect Relevant Learning Content for Each Subject , 2015, 2015 International Conference on Intelligent Networking and Collaborative Systems.

[36]  Dragan Gasevic,et al.  How do we start? State and Directions of , 2016 .

[37]  Susanne P. Lajoie,et al.  Using Learning Analytics to Identify Medical Student Misconceptions in an Online Virtual Patient Environment. , 2015 .

[38]  Adriana Gewerc-Barujel,et al.  Collaboration and Social Networking in Higher Education.Colaboración y redes sociales en la enseñanza universitaria , 2014 .

[39]  Sahil P. Karkhanis,et al.  A Study of Application of Data Mining and Analytics in Education Domain , 2015 .