Longitudinal engagement, performance, and social connectivity: a MOOC case study using exponential random graph models

This paper explores a longitudinal approach to combining engagement, performance and social connectivity data from a MOOC using the framework of exponential random graph models (ERGMs). The idea is to model the social network in the discussion forum in a given week not only using performance (assignment scores) and overall engagement (lecture and discussion views) covariates within that week, but also on the same person-level covariates from adjacent previous and subsequent weeks. We find that over all eight weekly sessions, the social networks constructed from the forum interactions are relatively sparse and lack the tendency for preferential attachment. By analyzing data from the second week, we also find that individuals with higher performance scores from current, previous, and future weeks tend to be more connected in the social network. Engagement with lectures had significant but sometimes puzzling effects on social connectivity. However, the relationships between social connectivity, performance, and engagement weakened over time, and results were not stable across weeks.

[1]  David R. Hunter,et al.  Curved exponential family models for social networks , 2007, Soc. Networks.

[2]  Alan M. Frieze,et al.  Random graphs , 2006, SODA '06.

[3]  P. Holland,et al.  An Exponential Family of Probability Distributions for Directed Graphs , 1981 .

[4]  Osmar R. Zaïane,et al.  Collaborative Learning of Students in Online Discussion Forums: A Social Network Analysis Perspective , 2014 .

[5]  Daniella Meeker,et al.  Variations in network boundary and type: A study of adolescent peer influences , 2013, Soc. Networks.

[6]  Peng Wang,et al.  Exponential random graph model specifications for bipartite networks - A dependence hierarchy , 2013, Soc. Networks.

[7]  Michael Stefanone,et al.  Social information sharing in a CSCL community , 2002, CSCL.

[8]  Stanley Wasserman,et al.  Social Network Analysis: Methods and Applications , 1994, Structural analysis in the social sciences.

[9]  Danielle S. McNamara,et al.  Good Communities and Bad Communities: Does Membership Affect Performance? , 2015, EDM.

[10]  E. Lazega,et al.  Position in formal structure, personal characteristics and choices of advisors in a law firm: A logistic regression model for dyadic network data , 1997 .

[11]  Caroline Haythornthwaite,et al.  Exploring Multiplexity: Social Network Structures in a Computer-Supported Distance Learning Class , 2001, Inf. Soc..

[12]  Garry Robins,et al.  An introduction to exponential random graph (p*) models for social networks , 2007, Soc. Networks.

[13]  S. Wasserman,et al.  Logit models and logistic regressions for social networks: II. Multivariate relations. , 1999, The British journal of mathematical and statistical psychology.

[14]  Amy Soller,et al.  Supporting Social Interaction in an Intelligent Collaborative Learning System , 2001 .

[15]  Luc Paquette,et al.  A Longitudinal Study on Learner Career Advancement in MOOCs , 2014, J. Learn. Anal..

[16]  T. Snijders,et al.  A multilevel network study of the effects of delinquent behavior on friendship evolution , 2003 .

[17]  Rhona Brown Literary Communities and Commemorations in the Edinburgh Cape Club , 2015 .

[18]  Danielle S. McNamara,et al.  Communities of Performance & Communities of Preference , 2015, EDM.

[19]  Tao Zhou,et al.  Empirical study on clique-degree distribution of networks. , 2006, Physical review. E, Statistical, nonlinear, and soft matter physics.

[20]  Andrew Laghos,et al.  SOCIOLOGY OF STUDENT-CENTRED E-LEARNING COMMUNITIES: A NETWORK ANALYSIS , 2007 .

[21]  T. Snijders,et al.  Estimation and Prediction for Stochastic Blockmodels for Graphs with Latent Block Structure , 1997 .

[22]  S. Wasserman,et al.  Logit models and logistic regressions for social networks: I. An introduction to Markov graphs andp , 1996 .

[23]  S. Wasserman,et al.  Logit models and logistic regressions for social networks: III. Valued relations , 1999 .

[24]  Yoav Bergner,et al.  Methodological Challenges in the Analysis of MOOC Data for Exploring the Relationship between Discussion Forum Views and Learning Outcomes , 2015, EDM.

[25]  Hichang Cho,et al.  Social Network Analysis of Information Sharing Networks in a CSCL Community , 2001 .

[26]  Liyan Song,et al.  Understanding Students' Online Interaction: Analysis of Discussion Board Postings , 2011 .

[27]  Martina Morris,et al.  statnet: Software Tools for the Representation, Visualization, Analysis and Simulation of Network Data. , 2008, Journal of statistical software.

[28]  Danielle S. McNamara,et al.  Language to Completion: Success in an Educational Data Mining Massive Open Online Class , 2015, EDM.

[29]  Anirban Dasgupta,et al.  Superposter behavior in MOOC forums , 2014, L@S.

[30]  T. Snijders,et al.  p2: a random effects model with covariates for directed graphs , 2004 .

[31]  Ove Frank,et al.  http://www.jstor.org/about/terms.html. JSTOR's Terms and Conditions of Use provides, in part, that unless you have obtained , 2007 .

[32]  Kevin Oliver,et al.  A Social Network Perspective on Peer Supported Learning in MOOCs for Educators , 2014 .

[33]  Rebecca Eynon,et al.  Communication patterns in massively open online courses , 2014, Internet High. Educ..

[34]  D. Christopher Brooks,et al.  The Current Ecosystem of Learning Management Systems in Higher Education: Student, Faculty, and IT Perspectives. , 2014 .

[35]  Michael Eagle,et al.  Interaction Networks: Generating High Level Hints Based on Network Community Clusterings , 2012, EDM.

[36]  Mengxiao Zhu,et al.  An exploratory study using social network analysis to model eye movements in mathematics problem solving , 2015, LAK.

[37]  Albert-László Barabási,et al.  Statistical mechanics of complex networks , 2001, ArXiv.

[38]  Brian W. Junker,et al.  Hierarchical Network Models for Education Research , 2013 .

[39]  Yoav Bergner,et al.  Estimation of ability from homework items when there are missing and/or multiple attempts , 2015, LAK.

[40]  A. Bandura Social Foundations of Thought and Action: A Social Cognitive Theory , 1985 .

[41]  George Siemens Connectivism: A Learning Theory for the Digital Age , 2004 .

[42]  Gilad Ravid,et al.  Mechanisms and architectures of online learning communities , 2004, IEEE International Conference on Advanced Learning Technologies, 2004. Proceedings..

[43]  Gerd Kortemeyer,et al.  Correlations between Student Discussion Behavior, Attitudes, and Learning. , 2007 .

[44]  Errol Yudko,et al.  "Hits" (not "Discussion Posts") predict student success in online courses: A double cross-validation study , 2008, Comput. Educ..

[45]  Peng Wang,et al.  Recent developments in exponential random graph (p*) models for social networks , 2007, Soc. Networks.

[46]  Peter D. Hoff,et al.  Latent Space Approaches to Social Network Analysis , 2002 .

[47]  Robin H. Kay,et al.  Developing a comprehensive metric for assessing discussion board effectiveness , 2006, Br. J. Educ. Technol..