What Learning Analytics Tells Us: Group Behavior Analysis and Individual Learning Diagnosis based on Long-Term and Large-Scale Data

The practice and application of education data mining and learning analytics has become the focus of educational researchers. However, it is still a difficult task to explore the law of group learning and the characteristics of individual learning. In this study, the online learning logs of 1,088 students from 22 classes were analyzed from the aspects of their login behaviors, resource utilization, quizzes, interactive behaviors, and academic achievement. To address these issues, multiple methods, including statistical analysis, visualization social network analysis and correlation analysis, were used to analyze the process and results of online learning. The results reveal the characteristics of group behavior of online learners and highlight the key factors that influence the learning process and outcomes of individual learners. From the view of students, these factors include the length and allocation of online time, the effective utilization of resources, social interaction, online learning support and services, etc. From the perspective of teachers, the factors include the management of online teaching, the appropriateness of learning resources, the effectiveness of online intervention strategies, the accurate feedback for online learners, etc. Therefore, learning analysis technology can not only standardize the assessment of learning outcomes, but can also focus more attention on the standardization of learning process assessment. It also identifies the main factors that affect the online learning outcomes and the group characteristics of online learners. At the same time, it provides the learners with personalized learning diagnosis reports which can both help learners understand their own learning status and promote instructors’ accurate teaching and reasonable evaluation.

[1]  Ian Dunwell,et al.  Foundations of dynamic learning analytics: Using university student data to increase retention , 2015, Br. J. Educ. Technol..

[2]  Gwo-Jen Hwang,et al.  Influences of an inquiry-based ubiquitous gaming design on students' learning achievements, motivation, behavioral patterns, and tendency towards critical thinking and problem solving , 2017, Br. J. Educ. Technol..

[3]  Gwo-Jen Hwang,et al.  Interaction of problem-based gaming and learning anxiety in language students' English listening performance and progressive behavioral patterns , 2017, Comput. Educ..

[4]  Mehmet Firat,et al.  Determining the Effects of LMS Learning Behaviors on Academic Achievement in a Learning Analytic Perspective , 2016, J. Inf. Technol. Educ. Res..

[5]  Darren Morton Reviewer for ASCILITE: Australasian Society for Computers in Learning in Tertiary Education , 2012 .

[6]  Marie Bienkowski,et al.  Enhancing Teaching and Learning Through Educational Data Mining and Learning Analytics: An Issue Brief , 2012 .

[7]  Il-Hyun Jo,et al.  Effects of learning analytics dashboard: analyzing the relations among dashboard utilization, satisfaction, and learning achievement , 2015, Asia Pacific Education Review.

[8]  Julián Chaparro-Peláez,et al.  Applying social learning analytics to message boards in online distance learning: A case study , 2015, Comput. Hum. Behav..

[9]  Qiang Fei,et al.  An Examination of the Impact of Early Intervention on Learning Outcomes of At-Risk Students. , 2014 .

[10]  Erik Duval,et al.  Creating Effective Learning Analytics Dashboards: Lessons Learnt , 2016, EC-TEL.

[11]  Deborah Richards,et al.  Learning analytics in higher education : a summary of tools and approaches , 2013 .

[12]  Lauri Malmi,et al.  Increasing Students’ Awareness of Their Behavior in Online Learning Environments with Visualizations and Achievement Badges , 2015, IEEE Transactions on Learning Technologies.

[13]  Itana Stiubiener,et al.  FAG – a management support tool with BI techniques to assist teachers in the virtual learning environment Moodle , 2017 .

[14]  James Melitski,et al.  Using Learning Analytics to Predict At-Risk Students in Online Graduate Public Affairs and Administration Education , 2015 .

[15]  Chien Chou,et al.  Applying Learning Analytics to Explore the Influence of Online Learners' Motivation on Their Online Learning Behavioral Patterns , 2016 .

[16]  Anouschka van Leeuwen,et al.  Teacher regulation of cognitive activities during student collaboration: Effects of learning analytics , 2015, Comput. Educ..

[17]  Matthew D. Pistilli,et al.  In practice: Purdue Signals: Mining real‐time academic data to enhance student success , 2010 .

[18]  Janet S Twyman,et al.  Handbook on Personalized Learning for States, Districts, and Schools. , 2016 .

[19]  Maren Scheffel,et al.  Quality Indicators for Learning Analytics , 2014, J. Educ. Technol. Soc..

[20]  Ruth Cobos,et al.  Using a learning analytics manager for monitoring of the collaborative learning activities and students' motivation into the Moodle system , 2016, 2016 IEEE 11th Colombian Computing Conference (CCC).

[21]  J. Manyika Big data: The next frontier for innovation, competition, and productivity , 2011 .

[22]  Florence Martin,et al.  Applying Learning Analytics to Investigate Timed Release in Online Learning , 2016, Technol. Knowl. Learn..

[23]  Sung-Hee Jin,et al.  Learning Activities and Learning Behaviors for Learning Analytics in e-Learning Environments , 2016 .

[24]  Shane Dawson,et al.  Mining LMS data to develop an "early warning system" for educators: A proof of concept , 2010, Comput. Educ..

[25]  Dongho Kim,et al.  Toward evidence-based learning analytics: Using proxy variables to improve asynchronous online discussion environments , 2016, Internet High. Educ..

[26]  Mansureh Kebritchi,et al.  Learning Analytics Methods, Benefits, and Challenges in Higher Education: A Systematic Literature Review. , 2016 .

[27]  R. Baker Using Learning Analytics in Personalized Learning , 2019 .

[28]  Austin Gibbons,et al.  Learning Analytics , 2014, Encyclopedia of Social Network Analysis and Mining.

[29]  Gwo-Jen Hwang,et al.  Definition, framework and research issues of smart learning environments - a context-aware ubiquitous learning perspective , 2014, Smart Learning Environments.

[30]  Matthew D. Pistilli,et al.  Course signals at Purdue: using learning analytics to increase student success , 2012, LAK.

[31]  Florence Martin,et al.  Using Learning Analytics to Assess Student Learning in Online Courses. , 2016 .

[32]  Teresa Moore,et al.  Identification of ‘at risk’ students using learning analytics: the ethical dilemmas of intervention strategies in a higher education institution , 2016 .

[33]  Paulo Blikstein,et al.  Modeling how students learn to program , 2012, SIGCSE '12.

[34]  Gwo-Jen Hwang,et al.  Objectives, methodologies and research issues of learning analytics , 2017, Interact. Learn. Environ..

[35]  Gwo-Jen Hwang,et al.  A spreadsheet-based visualized Mindtool for improving students’ learning performance in identifying relationships between numerical variables , 2015, Interact. Learn. Environ..

[36]  Senén Barro,et al.  Evaluation of a Data‐To‐Text System for Verbalizing a Learning Analytics Dashboard , 2017, Int. J. Intell. Syst..

[37]  Ali Shiri Learning Analytics: Supporting Teaching and Learning through Learner’s Data Analytics and Visualization , 2016 .

[38]  Eitel J. M. Lauría,et al.  Mining academic data to improve college student retention: an open source perspective , 2012, LAK.