A Large Sample Comparison of Grade Based Student Learning Outcomes in Online vs. Face-to-Face Courses.

Comparisons of grade based learning outcomes between online and face-to-face course formats have become essential because the number of online courses, online programs and institutional student enrollments have seen rapid growth in recent years. Overall, online education is largely viewed by education professionals as being equivalent to instruction conducted face-to-face. However, the research investigating student performance in online versus face-to-face courses has been mixed and is often hampered by small samples or a lack of demographic and academic controls. This study utilizes a dataset that includes over 5,000 courses taught by over 100 faculty members over a period of ten academic terms at a large, public, four-year university. The unique scale of the dataset facilitates macro level understanding of course formats at an institutional level. Multiple regression was used to account for student demographic and academic corollaries—factors known to bias course format selection and grade based outcomes—to generate a robust test for differences in grade based learning outcomes that could be attributed to course format. The final model identified a statistical difference between course formats that translated into a negligible difference of less than 0.07 GPA points on a 4 point scale. The primary influence on individual course grades was student GPA. Interestingly, a model based interaction between course type and student GPA indicated a cumulative effect whereby students with higher GPAs will perform even better in online courses (or alternatively, struggling students perform worse when taking courses in an online format compared to a face-to-face format). These results indicate that, given the large scale university level, multi course, and student framework of the current study, there is little to no difference in grade based student performance between instructional modes for courses where both modes are applicable.

[1]  Mark L. Berenson,et al.  Proctored versus Unproctored Online Exams: Studying the Impact of Exam Environment on Student Performance. , 2009 .

[2]  H. Johnson,et al.  Online Learning and Student Outcomes in California's Community Colleges. , 2014 .

[3]  Shanna Smith Jaggars,et al.  The impact of online learning on students’ course outcomes: Evidence from a large community and technical college system , 2013 .

[4]  William Sadera,et al.  Comparing student success between developmental math courses offered online, blended, and face-to-face. , 2011 .

[5]  Shanna Smith Jaggars,et al.  Adaptability to Online Learning: Differences across Types of Students and Academic Subject Areas. CCRC Working Paper No. 54. , 2013 .

[6]  Shanna Smith Jaggars,et al.  What We Know about Online Course Outcomes. Research Overview. , 2013 .

[7]  I. E. Allen,et al.  Changing Course: Ten Years of Tracking Online Education in the United States. , 2013 .

[8]  Andrea N. Hunt,et al.  Can Online Courses Deliver In-class Results? , 2012 .

[9]  Barbara Means,et al.  Evaluation of Evidence-Based Practices in Online Learning: A Meta-Analysis and Review of Online Learning Studies , 2009 .

[10]  Sanford Weisberg,et al.  An R Companion to Applied Regression , 2010 .

[11]  P. Calafiore,et al.  The Effect of Time Spent Online on Student Achievement in Online Economics and Finance Courses , 2011 .

[12]  D. Hallock,et al.  An exploratory investigation of the potential relationship between student learning styles, course grade, cumulative grade point average and selected demographics in on‐line undergraduate business courses , 2003 .

[13]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[14]  Shanna Smith Jaggars,et al.  The Effectiveness of Distance Education across Virginia's Community Colleges: Evidence from Introductory College-Level Math and English Courses , 2011 .

[15]  Dev K. Dalal,et al.  Some Common Myths About Centering Predictor Variables in Moderated Multiple Regression and Polynomial Regression , 2012 .

[16]  Cynthia Akers,et al.  Comparison of course completion and student performance through online and traditional courses , 2013 .

[17]  Peter Shea,et al.  Does online learning impede degree completion? A national study of community college students , 2014, Comput. Educ..

[18]  Mary K. Tallent-Runnels,et al.  Teaching Courses Online: A Review of the Research , 2006 .

[19]  Ruth Johnson,et al.  Students' Characteristics and Motivation Orientations for Online and Traditional Degree Programs , 2010 .

[20]  Robert M. Bernard,et al.  How Does Distance Education Compare With Classroom Instruction? A Meta-Analysis of the Empirical Literature , 2004 .

[21]  Yong Zhao,et al.  What Makes the Difference? A Practical Analysis of Research on the Effectiveness of Distance Education , 2005, Teachers College Record: The Voice of Scholarship in Education.