Assessing the impact of blended learning on student performance 1

This paper assesses quantitatively the impact on student performance of a blended learning experiment within a large undergraduate first-year course in statistics for business and economics students. We employ a difference-in-differences method, which controls for differences in student characteristics and course delivery method, to evaluate the impact of blended learning on student performance. Our results suggest that the impact of blended learning on student performance depends on whether the effect of blended learning is cumulative or not. Blended learning has no impact on student performance if learning is non-cumulative and only affects the performance on the quizzes associated with the material covered by blended learning. However, if learning is cumulative and impacts the performance for the whole course, then our results strongly suggest a strong, negative effect. Taken as a whole, these results provide a possible explanation for why most of the existing studies focusing on short online courses have obtained neutral or even positive results while nearly all the studies focusing on semester-length course tend to observe negative impacts from online learning.

[1]  H. D. Johnson,et al.  Internet Approach versus Lecture and Lab‐Based Approach for Teaching an Introductory Statistical Methods Course: Students’ Opinions , 2009 .

[2]  B. W. Brown,et al.  Can Web Courses Replace the Classroom in Principles of Microeconomics , 2002 .

[3]  David Morris,et al.  Economies of scale and scope in e‐learning , 2008 .

[4]  Pannee Suanpang,et al.  Relationship between learning outcomes and online accesses , 2004 .

[5]  H. Salzman,et al.  Making the grade , 2008, Nature.

[6]  Rose Sebastianelli,et al.  Business Statistics and Management Science Online: Teaching Strategies and Assessment of Student Learning , 2011 .

[7]  Constance H. McLaren.  A Comparison of Student Persistence and Performance in Online and Classroom Business Statistics Experiences , 2004 .

[8]  M. Ferber.  The Study of Economics: A Feminist Critique , 1995 .

[9]  Karen Swan,et al.  Measures of Learning Effectiveness in the SUNY Learning Network , 2001 .

[10]  John Kane,et al.  "No Significant Distance" between Face-to-Face and Online Instruction: Evidence from Principles of Economics , 2004 .

[11]  J. Ferguson,et al.  Online versus face‐to‐face learning: looking at modes of instruction in Master’s‐level courses , 2009 .

[12]  D. Kahneman,et al.  Experimental Tests of the Endowment Effect and the Coase Theorem , 1990, Journal of Political Economy.

[13]  Shanna Smith Jaggars,et al.  The impact of online learning on students’ course outcomes: Evidence from a large community and technical college system , 2013 .

[14]  Shanthi Ameratunga,et al.  Student engagement in very large classes: the teachers’ perspective , 2010 .

[15]  Matthew M. Chingos,et al.  Interactive Learning Online at Public Universities: Evidence from a Six-Campus Randomized Trial. , 2014 .

[16]  Steven E. Higgins,et al.  Effects of traditional, blended and e-learning on students' achievement in higher education , 2013, J. Comput. Assist. Learn..

[17]  Jo Ellen Perry,et al.  Do Online Students Perform as Well as Lecture Students? , 2001 .

[18]  David N. Figlio,et al.  Cramming: The Effects of School Accountability on College-Bound Students , 2006 .

[19]  I. E. Allen,et al.  Making the Grade: Online Education in the United States, 2006. , 2006 .

[20]  David N. Figlio,et al.  Is It Live or Is It Internet? Experimental Estimates of the Effects of Online Instruction on Student Learning , 2010, Journal of Labor Economics.

[21]  Sean Crockett,et al.  Does Classroom Time Matter? a Randomized Field Experiment of Hybrid and Traditional Lecture Formats in Economics , 2014 .

[22]  Barbara Means,et al.  Evaluation of Evidence-Based Practices in Online Learning: A Meta-Analysis and Review of Online Learning Studies , 2009 .