Interpretable MOOC recommendation: a multi-attention network for personalized learning behavior analysis

PurposeCourse recommendations are important for improving learner satisfaction and reducing dropout rates on massive open online course (MOOC) platforms. This study aims to propose an interpretable method of analyzing students' learning behaviors and recommending MOOCs by integrating multiple data sources.Design/methodology/approachThe study proposes a deep learning method of recommending MOOCs to students based on a multi-attention mechanism comprising learning records attention, word-level review attention, sentence-level review attention and course description attention. The proposed model is validated using real-world data consisting of the learning records of 6,628 students for 1,789 courses and 65,155 reviews.FindingsThe main contribution of this study is its exploration of multiple unstructured information using the proposed multi-attention network model. It provides an interpretable strategy for analyzing students' learning behaviors and conducting personalized MOOC recommendations.Practical implicationsThe findings suggest that MOOC platforms must fully utilize the information implied in course reviews to extract personalized learning preferences.Originality/valueThis study is the first attempt to recommend MOOCs by exploring students' preferences in course reviews. The proposed multi-attention mechanism improves the interpretability of MOOC recommendations.

[1]  Erhan Delen,et al.  Effects of interactivity and instructional scaffolding on learning: Self-regulation in online video-based environments , 2014, Comput. Educ..

[2]  George Karypis,et al.  Domain-Aware Grade Prediction and Top-n Course Recommendation , 2016, RecSys.

[3]  Qian Zhang,et al.  Modeling and Predicting Learning Behavior in MOOCs , 2016, WSDM.

[4]  Shu-Kun Lin Gibbs Paradox and the Concepts of Information, Symmetry, Similarity and Their Relationship , 2008, Entropy.

[5]  Brian Axelrod,et al.  Causal Strategic Linear Regression , 2020, ICML.

[6]  Cynthia Rudin,et al.  Algorithms for interpretable machine learning , 2014, KDD.

[7]  Thushari Atapattu,et al.  A Framework for Topic Generation and Labeling from MOOC Discussions , 2016, L@S.

[8]  Carolyn Penstein Rosé,et al.  Identifying Latent Study Habits by Mining Learner Behavior Patterns in Massive Open Online Courses , 2014, CIKM.

[9]  Xian Peng,et al.  Investigating learners' behaviors and discourse content in MOOC course reviews , 2020, Comput. Educ..

[10]  Yoram Singer,et al.  Adaptive Subgradient Methods for Online Learning and Stochastic Optimization , 2011, J. Mach. Learn. Res..

[11]  Ben Kei Daniel,et al.  Big Data and data science: A critical review of issues for educational research , 2019, Br. J. Educ. Technol..

[12]  Yongqiang Sun,et al.  Understanding the determinants of learner engagement in MOOCs: An adaptive structuration perspective , 2020, Comput. Educ..

[13]  Ben Niu,et al.  Understanding the focal points and sentiment of learners in MOOC reviews: A machine learning and SC-LIWC-based approach , 2020, Br. J. Educ. Technol..

[14]  Kui Yu,et al.  Multi-Source Causal Feature Selection , 2020, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Roberto Turrin,et al.  Performance of recommender algorithms on top-n recommendation tasks , 2010, RecSys '10.

[16]  Ying Zhang,et al.  Collaborative filtering recommendation for MOOC application , 2017, Comput. Appl. Eng. Educ..

[17]  David Heckerman,et al.  Empirical Analysis of Predictive Algorithms for Collaborative Filtering , 1998, UAI.

[18]  Tat-Seng Chua,et al.  Fast Matrix Factorization for Online Recommendation with Implicit Feedback , 2016, SIGIR.

[19]  Aditya G. Parameswaran,et al.  Recommendation systems with complex constraints: A course recommendation perspective , 2011, TOIS.

[20]  Ming Gao,et al.  BiRank: Towards Ranking on Bipartite Graphs , 2017, IEEE Transactions on Knowledge and Data Engineering.

[21]  Gaurav Aggarwal,et al.  Modeling MOOC Dropouts , 2015 .

[22]  Long Chen,et al.  Counterfactual Critic Multi-Agent Training for Scene Graph Generation , 2018, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[23]  J. Shane Culpepper,et al.  Efficient set intersection for inverted indexing , 2010, TOIS.

[24]  Kenneth D. Jones,et al.  Exploring the complex relations between achievement emotions and self-regulated learning behaviors in online learning , 2012, Internet High. Educ..

[25]  Tao Chen,et al.  TriRank: Review-aware Explainable Recommendation by Modeling Aspects , 2015, CIKM.

[26]  Hongyan Wang,et al.  Causal Association Analysis Algorithm for MOOC Learning Behavior and Learning Effect , 2016, 2016 IEEE 14th Intl Conf on Dependable, Autonomic and Secure Computing, 14th Intl Conf on Pervasive Intelligence and Computing, 2nd Intl Conf on Big Data Intelligence and Computing and Cyber Science and Technology Congress(DASC/PiCom/DataCom/CyberSciTech).

[27]  Xiangnan He,et al.  NAIS: Neural Attentive Item Similarity Model for Recommendation , 2018, IEEE Transactions on Knowledge and Data Engineering.

[28]  Narimel Bendakir,et al.  Using Association Rules for Course Recommendation , 2006 .

[29]  Sebastián Ventura,et al.  Predicting students' final performance from participation in on-line discussion forums , 2013, Comput. Educ..

[30]  David Novak,et al.  Binary Sketches for Secondary Filtering , 2018, ACM Trans. Inf. Syst..

[31]  MengChu Zhou,et al.  An Efficient Non-Negative Matrix-Factorization-Based Approach to Collaborative Filtering for Recommender Systems , 2014, IEEE Transactions on Industrial Informatics.

[32]  Bowei Hong,et al.  Discovering learning behavior patterns to predict dropout in MOOC , 2017, 2017 12th International Conference on Computer Science and Education (ICCSE).

[33]  Xia Hu,et al.  Techniques for interpretable machine learning , 2018, Commun. ACM.

[34]  Hong-Ren Chen,et al.  How attention level and cognitive style affect learning in a MOOC environment? Based on the perspective of brainwave analysis , 2019, Comput. Hum. Behav..

[35]  Kun Li,et al.  MOOC learners' demographics, self-regulated learning strategy, perceived learning and satisfaction: A structural equation modeling approach , 2019, Comput. Educ..

[36]  Katharina Reinecke,et al.  Demographic differences in how students navigate through MOOCs , 2014, L@S.

[37]  Tat-Seng Chua,et al.  Neural Collaborative Filtering , 2017, WWW.

[38]  Fangyi Wan,et al.  A Case Study of the Characteristics of MOOCs Completers: Taking an Online Professional Training MOOC for Example , 2016, 2016 IEEE 16th International Conference on Advanced Learning Technologies (ICALT).

[39]  George Veletsianos,et al.  Digging deeper into learners' experiences in MOOCs: Participation in social networks outside of MOOCs, notetaking and contexts surrounding content consumption , 2015, Br. J. Educ. Technol..

[40]  Zhiyong Peng,et al.  Modeling Student Learning Styles in MOOCs , 2017, CIKM.

[41]  Wei Gao,et al.  Detecting fake news in social media , 2020, Commun. ACM.

[42]  George Karypis,et al.  Item-based top-N recommendation algorithms , 2004, TOIS.

[43]  Julian J. McAuley,et al.  VBPR: Visual Bayesian Personalized Ranking from Implicit Feedback , 2015, AAAI.

[44]  Yu He,et al.  The YouTube video recommendation system , 2010, RecSys '10.

[45]  Tao Huang,et al.  MOOCRC: A Highly Accurate Resource Recommendation Model for Use in MOOC Environments , 2018, Mob. Networks Appl..

[46]  Hugh C. Davis,et al.  Modelling MOOC learners' social behaviours , 2020, Comput. Hum. Behav..

[47]  George Karypis,et al.  FISM: factored item similarity models for top-N recommender systems , 2013, KDD.

[48]  Yew Haur Lee,et al.  Mining sentiments in SMS texts for teaching evaluation , 2012, Expert Syst. Appl..

[49]  Kai Liu,et al.  Deep Item-based Collaborative Filtering for Top-N Recommendation , 2018, ACM Trans. Inf. Syst..

[50]  Jian Peng,et al.  When causal inference meets deep learning , 2020, Nature Machine Intelligence.