On the Efficiency of Online Social Learning Networks

A social learning network (SLN) emerges when users exchange information on educational topics with structured interactions. The recent proliferation of massively scaled online (human) learning, such as massive open online courses (MOOCs), has presented a plethora of research challenges surrounding SLN. In this paper, we ask: how efficient are these networks? We propose a method in which the SLN efficiency is determined by comparing user benefit in the observed network to a benchmark of maximum utility achievable through optimization. Our method defines the optimal SLN through utility maximization subject to a set of constraints that can be inferred from the network, and given multiple solutions searches for the one closest to the observed network so as to require the least amount of change to user behavior in practice. Through evaluation on four MOOC discussion forum data sets and optimizing over millions of variables, we find that the SLN efficiency can be rather low (from 76% to 90% depending on the specific parameters and data set), which indicates that much can be gained through optimization. We find that the gains in global utility (i.e., average across users) can be obtained without making the distribution of local utilities (i.e., utility of individual users) less fair. We also propose an algorithm for realizing the optimal network through curated news feeds in online SLN.

[1]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[2]  Young-In Song,et al.  Finding question-answer pairs from online forums , 2008, SIGIR '08.

[3]  Caroline Haythornthwaite,et al.  Social networks and learning networks: Using social network perspectives to understand social learning , 2010 .

[4]  Alfred O. Hero,et al.  Shrinkage Algorithms for MMSE Covariance Estimation , 2009, IEEE Transactions on Signal Processing.

[5]  Tingting He,et al.  An empirical study of topic-sensitive probabilistic model for expert finding in question answer communities , 2014, Knowl. Based Syst..

[6]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.

[7]  Carolyn Penstein Rosé,et al.  Question recommendation with constraints for massive open online courses , 2014, RecSys '14.

[8]  Jin Cao,et al.  Enterprise social network analysis and modeling: A tale of two graphs , 2013, 2013 Proceedings IEEE INFOCOM.

[9]  Zhenming Liu,et al.  Learning about Social Learning in MOOCs: From Statistical Analysis to Generative Model , 2013, IEEE Transactions on Learning Technologies.

[10]  Patrick Jermann,et al.  Your click decides your fate: Inferring Information Processing and Attrition Behavior from MOOC Video Clickstream Interactions , 2014, Proceedings of the EMNLP 2014 Workshop on Analysis of Large Scale Social Interaction in MOOCs.

[11]  Mung Chiang,et al.  Social learning networks: A brief survey , 2014, 2014 48th Annual Conference on Information Sciences and Systems (CISS).

[12]  Kristy Elizabeth Boyer,et al.  Unsupervised modeling for understanding MOOC discussion forums: a learning analytics approach , 2015, LAK.

[13]  Mung Chiang,et al.  MOOC performance prediction via clickstream data and social learning networks , 2015, 2015 IEEE Conference on Computer Communications (INFOCOM).

[14]  Tobias Hecking,et al.  Investigating social and semantic user roles in MOOC discussion forums , 2016, LAK.

[15]  Rebecca Eynon,et al.  Structural limitations of learning in a crowd: communication vulnerability and information diffusion in MOOCs , 2014, Scientific Reports.

[16]  Karl Aberer,et al.  SoCo: a social network aided context-aware recommender system , 2013, WWW.

[17]  Alex Beutel,et al.  Recurrent Recommender Networks , 2017, WSDM.

[18]  Jure Leskovec,et al.  Engaging with massive online courses , 2014, WWW.

[19]  Jingjing Zhang,et al.  Understanding the dynamics of MOOC discussion forums with simulation investigation for empirical network analysis (SIENA) , 2016 .

[20]  Krishna P. Gummadi,et al.  A measurement-driven analysis of information propagation in the flickr social network , 2009, WWW '09.

[21]  Zhenming Liu,et al.  On the efficiency of social recommender networks , 2016, 2015 IEEE Conference on Computer Communications (INFOCOM).

[22]  Mung Chiang,et al.  Behavior-Based Grade Prediction for MOOCs Via Time Series Neural Networks , 2017, IEEE Journal of Selected Topics in Signal Processing.

[23]  Yong Hu,et al.  A Social Network Analysis of Online Collaborative Learning Aspects in an Online Course , 2016, 2016 International Symposium on Educational Technology (ISET).

[24]  Dong Wang,et al.  A genealogy of information spreading on microblogs: A Galton-Watson-based explicative model , 2013, 2013 Proceedings IEEE INFOCOM.

[25]  Ankhtuya Ochirbat,et al.  Small K-Teams Recommendation in Social Learning Networks , 2014, 2014 7th International Conference on Ubi-Media Computing and Workshops.

[26]  Stephen J. Roberts,et al.  Communication Communities in MOOCs , 2014, ArXiv.

[27]  Zoran Budimac,et al.  E-Learning personalization based on hybrid recommendation strategy and learning style identification , 2011, Comput. Educ..

[28]  Francisco J. García-Peñalvo,et al.  Learning Communities in Social Networks and Their Relationship With the MOOCs , 2017, IEEE Revista Iberoamericana de Tecnologias del Aprendizaje.

[29]  Ido Guy,et al.  What is Your Organization 'Like'?: A Study of Liking Activity in the Enterprise , 2016, CHI.

[30]  Michael I. Jordan,et al.  Latent Dirichlet Allocation , 2001, J. Mach. Learn. Res..

[31]  Dan Yang,et al.  Study Partners Recommendation for xMOOCs Learners , 2015, Comput. Intell. Neurosci..

[32]  H. Vincent Poor,et al.  Mining MOOC Clickstreams: Video-Watching Behavior vs. In-Video Quiz Performance , 2016, IEEE Transactions on Signal Processing.

[33]  H. Vincent Poor,et al.  Social learning networks: Efficiency optimization for MOOC forums , 2016, IEEE INFOCOM 2016 - The 35th Annual IEEE International Conference on Computer Communications.

[34]  C. Cortese,et al.  Learning through Teaching , 2005 .