Using HMM to compare interaction activity patterns of student groups with different achievements in MPOCs

ABSTRACT With the development of online learning, LMSs accumulated huge amounts of students’ interaction data. Unfortunately, with the support of LMSs data, few researchers put a sight on interaction research in MPOCs. Particularly, comparing interaction activity patterns of different achievement student groups and in different course processes in MPOCs has been paid less attention. This paper generates hidden Markov models to identify frequently occurring interaction activity sequence patterns of High/Low achievement groups in the Learning/Exam processes under MPOCs settings. The results demonstrate that High-achievement students especially focused on content learning, assignments, and quizzes to consolidate their knowledge construction in both Learning and Exam processes, while Low-achievement students extremely did not perform the same. Further, High-achievement students adjusted their learning strategies based on the goals of different course processes; Low-achievement students were inactive in the learning process and opportunistic in the exam process. In sum, the comparative analysis implies that certain interaction patterns may distinguish the High-achievement students from the Low-achievement ones, and students change their patterns more or less based on different course processes. It is also helpful for students, instructors to adjust their strategies and make decisions, and for developers, and administrators to build recommendation systems based on objective and comprehensive information.

[1]  Jenny Thomas,et al.  Exploring the use of asynchronous online discussion in health care education: A literature review , 2013, Comput. Educ..

[2]  Wenge Guo From SPOC to MPOC -- The Effective Practice of Peking University Online Teacher Training , 2014, 2014 International Conference of Educational Innovation through Technology.

[3]  Shane Dawson,et al.  Teaching smarter: how mining ICT data can inform and improve learning and teaching practice , 2008 .

[4]  Gautam Biswas,et al.  Analysis of Productive Learning Behaviors in a Structured Inquiry Cycle Using Hidden Markov Models , 2010, EDM.

[5]  María del Puerto Paule Ruíz,et al.  Students' LMS interaction patterns and their relationship with achievement: A case study in higher education , 2016, Comput. Educ..

[6]  Kristen E. DiCerbo,et al.  Harnessing the Currents of the Digital Ocean , 2014 .

[7]  Hosseini Zahra,et al.  COLLABORATIVE LEARNING AND CRITICAL THINKING , 2009 .

[8]  Khe Foon Hew,et al.  Asynchronous online discussion thread development: examining growth patterns and peer-facilitation techniques , 2009, J. Comput. Assist. Learn..

[9]  Gautam Biswas,et al.  Using Hidden Markov Models to Characterize Student Behaviors in Learning-by-Teaching Environments , 2008, Intelligent Tutoring Systems.

[10]  G. Schwarz Estimating the Dimension of a Model , 1978 .

[11]  Ben Kei Daniel,et al.  Big Data and Learning Analytics in Higher Education , 2017 .

[12]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[13]  K. Hew,et al.  Students’ and instructors’ use of massive open online courses (MOOCs): Motivations and challenges , 2014 .

[14]  Khe Foon Hew,et al.  Student perceptions of peer versus instructor facilitation of asynchronous online discussions: further findings from three cases , 2015 .

[15]  Winter A. Mason,et al.  Collaborative learning in networks , 2011, Proceedings of the National Academy of Sciences.

[16]  Manuele Bicego,et al.  A Hidden Markov Model-Based Approach to Sequential Data Clustering , 2002, SSPR/SPR.

[17]  K. Patricia Cross,et al.  Collaborative Learning Techniques: A Handbook for College Faculty , 2004 .

[18]  Steven Lonn,et al.  A Learning Management System-Based Early Warning System for Academic Advising in Undergraduate Engineering , 2014 .

[19]  John Morgan,et al.  Will MOOCs transform learning and teaching in higher education? Engagement and course retention in online learning provision , 2015, Br. J. Educ. Technol..

[20]  Judy Kay,et al.  Clustering and Sequential Pattern Mining of Online Collaborative Learning Data , 2009, IEEE Transactions on Knowledge and Data Engineering.

[21]  P. Dillenbourg What do you mean by collaborative learning , 1999 .

[22]  Alan M. Lesgold,et al.  Modeling the process of collaborative learning , 2007 .

[23]  B Tulasi. Learning Analytics and Big Data in Higher Education , 2014 .

[24]  Katrina A. Meyer,et al.  FACE-TO-FACE VERSUS THREADED DISCUSSIONS: THE ROLE OF TIME AND HIGHER-ORDER THINKING , 2019, Online Learning.

[25]  A. Kaplan,et al.  Higher education and the digital revolution: About MOOCs, SPOCs, social media, and the Cookie Monster , 2016 .

[26]  Sam Kwong,et al.  Training approach for hidden Markov models , 1996 .

[27]  Judy Kay,et al.  Analysing Frequent Sequential Patterns of Collaborative Learning Activity Around an Interactive Tabletop. Nominee for Best Paper Award , 2010, EDM.

[28]  David Heckerman,et al.  A Tutorial on Learning with Bayesian Networks , 1999, Innovations in Bayesian Networks.

[29]  Ben Kei Daniel,et al.  Big Data in Higher Education: The Big Picture , 2017 .

[30]  Martin Ebner,et al.  MOOCs Completion Rates and Possible Methods to Improve Retention - A Literature Review , 2014 .

[31]  Ian H. Witten,et al.  Data mining: practical machine learning tools and techniques with Java implementations , 2002, SGMD.

[32]  L. Baum,et al.  A Maximization Technique Occurring in the Statistical Analysis of Probabilistic Functions of Markov Chains , 1970 .

[33]  Gautam Biswas,et al.  A Bayesian approach for structural learning with hidden Markov models , 2002, Sci. Program..

[34]  Veda C. Storey,et al.  Big data technologies and Management: What conceptual modeling can do , 2017, Data Knowl. Eng..

[35]  Evaluating Asynchronous Discussion as Social Constructivist Pedagogy in an Online Undergraduate Gerontological Social Work Course , 2015 .

[36]  Lalit R. Bahl,et al.  Maximum mutual information estimation of hidden Markov model parameters for speech recognition , 1986, ICASSP '86. IEEE International Conference on Acoustics, Speech, and Signal Processing.

[37]  David Burshtein,et al.  A discriminative training algorithm for hidden Markov models , 2004, IEEE Transactions on Speech and Audio Processing.

[38]  John S. Kinnebrew,et al.  A Contextualized, Differential Sequence Mining Method to Derive Students' Learning Behavior Patterns , 2013, EDM 2013.

[39]  Gwo-Jen Hwang,et al.  Objectives, methodologies and research issues of learning analytics , 2017, Interact. Learn. Environ..