Predicting student success by modeling student interaction in asynchronous online courses

Abstract Early-warning intervention for students at risk of failing their online courses is increasingly important for higher education institutions. Students who show high levels of engagement appear less likely to be at risk of failing, and how engaged a student is in their online experience can be characterized as factors contributing to their social presence. Social presence begins with teacher-student and student-student interaction in online courses. Fortunately, student interaction data can be gleaned from learning management systems, used to model and predict at-risk students at an early stage. This research addresses an existing model for predicting at-risk students to test a previous hypothesis that a holiday effect is a contributor for failure. A new analysis then presents an alternative approach, one that tests the frequency of student interaction rather than amount of interaction as a preferable indicator.

[1]  Ellen D. Wagner,et al.  In Support of a Functional Definition of Interaction , 1994 .

[2]  Heather Kanuka,et al.  Distance education MBA students: an investigation into the use of an orientation course to address academic and social integration issues , 2006 .

[3]  Jui-Long Hung,et al.  An Educational Data Mining Model for Online Teaching and Learning , 2012 .

[4]  Lai Cheng Tung,et al.  Proactive Intervention Strategies for Improving Online Student Retention in a Malaysian Distance Education Institution , 2012 .

[5]  Cherng-Jyh Yen,et al.  Community College Online Course Retention and Final Grade: Predictability of Social Presence. , 2009 .

[6]  Lisa M. Lane.  Insidious Pedagogy: How Course Management Systems Affect Teaching , 2009, First Monday.

[7]  Ormond Simpson,et al.  Student–student mentoring for retention and engagement in distance education , 2010 .

[8]  O. Simpson.  The impact on retention of interventions to support distance learning students , 2004 .

[9]  Daniel Hellerstein,et al.  BOARD OF REGENTS OF THE UNIVERSITY OF WISCONSIN SYSTEM Research, Economic Development, & Innovation Committee , 2005 .

[10]  Charlotte N. Gunawardena,et al.  Analysis of a Global Online Debate and the Development of an Interaction Analysis Model for Examining Social Construction of Knowledge in Computer Conferencing , 1997 .

[11]  Avner Caspi,et al.  Social presence in online discussion groups: testing three conceptions and their relations to perceived learning , 2008 .

[12]  B. Patterson,et al.  Attrition in Online and Campus Degree Programs. , 2009 .

[13]  V. Dennen.  Facilitator presence and identity in online discourse: use of positioning theory as an analytic framework , 2011 .

[14]  Karen Swan,et al.  Building Learning Communities in Online Courses: the importance of interaction , 2002 .

[15]  Janet E. Hurn,et al.  Using learning analytics to predict (and improve) student success: a faculty perspective , 2013 .

[16]  Scott D. Johnson,et al.  FACTORS THAT INFLUENCE STUDENTS’ DECISION TO DROPOUT OF ONLINE COURSES , 2019, Online Learning.

[17]  Wallace E. Boston,et al.  Comprehensive Assessment of Student Retention in Online Learning Environments , 2011 .

[18]  Joanna C. Dunlap,et al.  Defeating the Kobayashi Maru: Supporting student retention by balancing the needs of the many and the one , 2010 .

[19]  Doris U. Bolliger,et al.  Development and Validation of the Online Student Connectedness Survey (OSCS) , 2012 .

[20]  Steven M. Crooks,et al.  Examining Online Learning Patterns with Data Mining Techniques in Peer-Moderated and Teacher-Moderated Courses , 2009 .

[21]  Aimee L. Whiteside.  Introducing the Social Presence Model to Explore Online and Blended Learning Experiences , 2015 .

[22]  Jennifer Richardson,et al.  INTERPERSONAL INTERACTION IN ONLINE LEARNING: EXPERIENCED ONLINE INSTRUCTORS' PERCEPTIONS OF INFLUENCING FACTORS , 2012 .

[23]  María del Puerto Paule Ruíz,et al.  Students' LMS interaction patterns and their relationship with achievement: A case study in higher education , 2016, Comput. Educ..

[24]  Errin Heyman,et al.  Overcoming student retention issues in higher education online programs: A Delphi study. , 2010 .

[25]  Anthony G. Picciano.  BEYOND STUDENT PERCEPTIONS: ISSUES OF INTERACTION, PRESENCE, AND PERFORMANCE IN AN ONLINE COURSE , 2019, Online Learning.

[26]  Lorraine Angelino,et al.  Strategies to Engage Online Students and Reduce Attrition Rates. , 2007 .

[27]  I. E. Allen,et al.  Changing Course: Ten Years of Tracking Online Education in the United States. , 2013 .

[28]  Shane Dawson,et al.  Mining LMS data to develop an "early warning system" for educators: A proof of concept , 2010, Comput. Educ..

[29]  C. Gunawardena,et al.  Social presence as a predictor of satisfaction within a computer‐mediated conferencing environment , 1997 .

[30]  I. Ajzen,et al.  Attitude-behavior relations: A theoretical analysis and review of empirical research. , 1977 .

[31]  M. Moore.  Editorial: Three types of interaction , 1989 .

[32]  Jennifer C. Richardson,et al.  EXAMINING SOCIAL PRESENCE IN ONLINE COURSES IN RELATION TO STUDENTS' PERCEIVED LEARNING AND SATISFACTION , 2003, Online Learning.

[33]  Karen Swan,et al.  AN EXPLORATION OF THE RELATIONSHIP BETWEEN INDICATORS OF THE COMMUNITY OF INQUIRY FRAMEWORK AND RETENTION IN ONLINE PROGRAMS , 2019, Online Learning.

[34]  Karen Swan,et al.  ON THE NATURE AND DEVELOPMENT OF SOCIAL PRESENCE IN ONLINE COURSE DISCUSSIONS , 2019, Online Learning.

[35]  Joanna C. Dunlap,et al.  Learner Support Services for Online Students: Scaffolding for Success. , 2003 .

[36]  Linda Serra Hagedorn,et al.  How to Define Retention: A New Look at an Old Problem. , 2006 .

[37]  D. Garrison,et al.  Assessing Social Presence In Asynchronous Text-based Computer Conferencing , 1999 .

[38]  M. Kang,et al.  Factors of learner-instructor interaction which predict perceived learning outcomes in online learning environment , 2013, J. Comput. Assist. Learn..

[39]  Wu He,et al.  Using Data Mining for Predicting Relationships between Online Question Theme and Final Grade , 2012, J. Educ. Technol. Soc..

[40]  Vanessa Paz Dennen,et al.  Presence and Positioning as Components of Online Instructor Persona , 2007 .

[41]  V. Dennen,et al.  Instructor–Learner Interaction in Online Courses: The relative perceived importance of particular instructor actions on performance and satisfaction , 2007 .

[42]  Jui-Long Hung,et al.  Integrating Data Mining in Program Evaluation of K-12 Online Education , 2012, J. Educ. Technol. Soc..

[43]  Deepa Thiagarajan,et al.  Designing Corporate Training in Developing Economies Using Open Educational Resources. , 2010 .

[44]  Patrick R. Lowenthal,et al.  Death to the Digital Dropbox: Rethinking Student Privacy and Public Performance. , 2010 .

[45]  Vanessa P. Dennen,et al.  From Message Posting to Learning Dialogues: Factors affecting learner participation in asynchronous discussion , 2005 .

[46]  Thomas G. Reio,et al.  Social Presence and Student Satisfaction as Predictors of Online Enrollment Intent , 2013 .

[47]  John Short,et al.  The social psychology of telecommunications , 1976 .

[48]  N. Sadat Shami,et al.  Adapting a Face-to-Face Role-Playing Simulation for Online Play , 2006 .

[49]  Clare Brett,et al.  Social Presence and Online Learning: A Review of Research , 2011 .

[50]  Peter Shea,et al.  Measures of Quality in Online Education: An Investigation of the Community of Inquiry Model and the Net Generation , 2008 .

[51]  A. P. Rovai.  Development of an instrument to measure classroom community , 2002, Internet High. Educ..

[52]  Carol Hostetter,et al.  Measuring up Online: The Relationship between Social Presence and Student Learning Satisfaction. , 2006 .

[53]  Brett E. Shelton,et al.  Online Graduate Teacher Education: Establishing an EKG for Student Success Intervention , 2016, Technol. Knowl. Learn..

[54]  Robert M. Bernard,et al.  A Meta-Analysis of Three Types of Interaction Treatments in Distance Education , 2009 .

[55]  Joanna C. Dunlap,et al.  The Power of Presence: Our Quest for the Right Mix of Social Presence in Online Courses , 2014 .

[56]  A. P. Rovai.  Sense of community, perceived cognitive learning, and persistence in asynchronous learning networks , 2002, Internet High. Educ..

[57]  Michael A. Herbert.  Staying the Course: A Study in Online Student Satisfaction and Retention , 2006 .

[58]  A. J. Massey.  The Feasibility of Equating National Test Standards in Science between Key Stages 2 and 3 and from Year to Year , 1997 .

[59]  Marek Hatala,et al.  Social presence in online discussions as a process predictor of academic performance , 2015, J. Comput. Assist. Learn..

[60]  Zdenek Zdráhal,et al.  Improving retention: predicting at-risk students by analysing clicking behaviour in a virtual learning environment , 2013, LAK '13.