Bringing order to chaos in MOOC discussion forums with content-related thread identification

This study addresses the issues of overload and chaos in MOOC discussion forums by developing a model to categorize and identify threads based on whether or not they are substantially related to the course content. Content-related posts were defined as those that give/seek help for the learning of course material and share/comment on relevant resources. A linguistic model was built based on manually-coded starting posts in threads from a statistics MOOC (n=837) and tested on thread starting posts from the second offering of the same course (n=304) and a different statistics course (n=298). The number of views and votes threads received were tested to see if they helped classification. Results showed that content-related posts in the statistics MOOC had distinct linguistic features which appeared to be unrelated to the subject-matter domain; the linguistic model demonstrated good cross-course reliability (all recall and precision > .77) and was useful across all time segments of the courses; number of views and votes were not helpful for classification.

[1]  Guglielmo Trentin,et al.  The Quality-Interactivity Relationship in Distance Education. , 2000 .

[2]  Alyssa Friend Wise,et al.  A Survey of Factors Contributing to Learners' “Listening” Behaviors in Asynchronous Online Discussions , 2012 .

[3]  Carolyn Penstein Rosé,et al.  Question recommendation with constraints for massive open online courses , 2014, RecSys '14.

[4]  Alyssa Friend Wise,et al.  Identifying Content-Related Threads in MOOC Discussion Forums , 2015, L@S.

[5]  Andreas Paepcke,et al.  YouEDU: Addressing Confusion in MOOC Discussion Forums by Recommending Instructional Video Clips , 2015, EDM.

[6]  Zhenming Liu,et al.  Learning about Social Learning in MOOCs: From Statistical Analysis to Generative Model , 2013, IEEE Transactions on Learning Technologies.

[7]  Alyssa Friend Wise,et al.  Starburst: a new graphical interface to support purposeful attention to others’ posts in online discussions , 2015, Educational Technology Research and Development.

[8]  David E. Pritchard,et al.  Studying Learning in the Worldwide Classroom Research into edX's First MOOC. , 2013 .

[9]  Jim Hewitt,et al.  An investigation of student practices in asynchronous computer conferencing courses , 2010, Comput. Educ..

[10]  Susan C. Herring.  Interactional Coherence in CMC , 1999, J. Comput. Mediat. Commun..

[11]  Laurie P. Dringus,et al.  Using data mining as a strategy for assessing asynchronous discussion forums , 2005, Comput. Educ..

[12]  Christopher D. Manning,et al.  Introduction to Information Retrieval , 2010, J. Assoc. Inf. Sci. Technol..

[13]  Daniel Zingaro,et al.  Examining the characteristics of student postings that are liked and linked in a CSCL environment , 2015, Br. J. Educ. Technol..

[14]  Armando Fox,et al.  Monitoring MOOCs: which information sources do instructors value? , 2014, L@S.

[15]  Min-Yen Kan,et al.  Learning Instructor Intervention from MOOC Forums: Early Results and Issues , 2015, EDM.

[16]  Anirban Dasgupta,et al.  Superposter behavior in MOOC forums , 2014, L@S.

[17]  Martin Ebner,et al.  MOOCs Completion Rates and Possible Methods to Improve Retention - A Literature Review , 2014 .

[18]  Chris Piech,et al.  Deconstructing disengagement: analyzing learner subpopulations in massive open online courses , 2013, LAK '13.

[19]  A. Graesser,et al.  Dynamics of affective states during complex learning , 2012 .

[20]  Omprakash Gnawali,et al.  Language independent analysis and classification of discussion threads in Coursera MOOC forums , 2014, Proceedings of the 2014 IEEE 15th International Conference on Information Reuse and Integration (IEEE IRI 2014).

[21]  Yan Zhang,et al.  Influence Analysis by Heterogeneous Network in MOOC Forums: What can We Discover? , 2015, EDM.

[22]  Martin Ebner,et al.  “How satisfied are you with your MOOC?” - A Research Study on Interaction in Huge Online Courses , 2013 .

[23]  Dragan Gasevic,et al.  Learning analytics should not promote one size fits all: The effects of instructional conditions in predicting academic success , 2016, Internet High. Educ..

[24]  Carolyn Penstein Rosé,et al.  Forum Thread Recommendation for Massive Open Online Courses , 2014, EDM.

[25]  Dan Goldwasser,et al.  Predicting Instructor’s Intervention in MOOC forums , 2014, ACL.

[26]  Fiona M. Hollands and Devayani Tirthali.  MOOCs: Expectations and Reality , 2014 .

[27]  Christian Gütl,et al.  Attrition in MOOC: Lessons Learned from Drop-Out Students , 2014, LTEC@KMO.

[28]  Andrew D. Ho,et al.  Changing “Course” , 2014 .

[29]  Kristina Lerman,et al.  Leveraging Position Bias to Improve Peer Recommendation , 2014, PloS one.

[30]  M. Moore.  Editorial: Three types of interaction , 1989 .