Do Students Know Best? Choice, Classroom Time, and Academic Performance

We compare student academic performance in traditional twice-a-week and compressed once-a-week lecture formats in introductory microeconomics between one semester in which students were randomly assigned into the formats and another semester when students were allowed to choose their format. In each semester we offered the same course with the sections taught at the same times in the same classrooms by the same professors using the same book, software and lecture slides. Our study design is modeled after a doubly randomized preference trial (DRPT), which provides insights regarding external validity beyond what is possible from a single randomized study. Our goal is to assess whether having a choice modifies the treatment effect of format. Students in the compressed format of the randomized arm of the study scored -0.19 standard deviations less on the combined midterm and final (p

[1]  John Kane,et al.  "No Significant Distance" between Face-to-Face and Online Instruction: Evidence from Principles of Economics , 2004 .

[2]  D. Rubin.  The design versus the analysis of observational studies for causal effects: parallels with the design of randomized trials , 2007, Statistics in medicine.

[3]  Daniel R. Marburger,et al.  Does Mandatory Attendance Improve Student Performance? , 2006 .

[4]  D. Kahneman,et al.  Anomalies: The Endowment Effect, Loss Aversion, and Status Quo Bias , 1991 .

[5]  I. E. Allen,et al.  Changing Course: Ten Years of Tracking Online Education in the United States. , 2013 .

[6]  W. Shadish,et al.  Experimental and Quasi-Experimental Designs for Generalized Causal Inference , 2001 .

[7]  William G. Bowen,et al.  Higher Education in the Digital Age , 2013, IEEE Trans. Prof. Commun..

[8]  James J. Heckman,et al.  Characterizing Selection Bias Using Experimental Data , 1998 .

[9]  Jeff Anstine,et al.  A Small Sample Study of Traditional and Online Courses with Sample Selection Adjustment , 2005 .

[10]  S. Devadoss,et al.  Evaluation of Factors Influencing Student Class Attendance and Performance , 1996 .

[11]  D. Romer,et al.  Do Students Go to Class? Should They? , 1993 .

[12]  Shanna Smith Jaggars,et al.  The Effectiveness of Distance Education across Virginia's Community Colleges: Evidence from Introductory College-Level Math and English Courses , 2011 .

[13]  Barbara Means,et al.  Evaluation of Evidence-Based Practices in Online Learning: A Meta-Analysis and Review of Online Learning Studies , 2009 .

[14]  D. Stanley,et al.  Teaching and Learning Principles of Microeconomics Online: An Empirical Assessment , 2009 .

[15]  G. Rücker,et al.  A two-stage trial design for testing treatment, self-selection and treatment preference effects. , 1989, Statistics in medicine.

[16]  D. Rubin.  For objective causal inference, design trumps analysis , 2008, 0811.1640.

[17]  L. Delbeke.  Quasi-experimentation - design and analysis issues for field settings - cook,td, campbell,dt , 1980 .

[18]  Daniel R. Marburger,et al.  Absenteeism and Undergraduate Exam Performance , 2001 .

[19]  Luca Stanca,et al.  The Effects of Attendance on Academic Performance: Panel Data Evidence for Introductory Microeconomics , 2004 .

[20]  Qi Long,et al.  Causal Inference in Hybrid Intervention Trials Involving Treatment Choice , 2008 .

[21]  T. Cook,et al.  Quasi-experimentation: Design & analysis issues for field settings , 1979 .

[22]  J. Wennberg,et al.  Outcomes Research, PORTs, and Health Care Reform , 1993, Annals of the New York Academy of Sciences.

[23]  Ricard Gil,et al.  Skipping class in college and exam performance: Evidence from a regression discontinuity classroom experiment , 2010 .

[24]  Neal H. Olitsky,et al.  The effect of blended courses on student learning: Evidence from introductory economics courses , 2014 .

[25]  Thad Dunning,et al.  Natural Experiments in the Social Sciences , 2012 .

[26]  English Emmenegger Patrick.  Dunning, Thad (2012): Natural Experiments in the Social Sciences: A Design­Based Approach. Cambridge: , 2012 .

[27]  Di Xu,et al.  Performance Gaps Between Online and Face-to-Face Courses: Differences Across Types of Students and Academic Subject Areas , 2014 .

[28]  E. Cohn,et al.  Class Attendance and Performance in Principles of Economics , 2006 .

[29]  Matthew M. Chingos,et al.  Interactive Learning Online at Public Universities: Evidence from a Six-Campus Randomized Trial. , 2014 .

[30]  Shanna Smith Jaggars,et al.  The impact of online learning on students’ course outcomes: Evidence from a large community and technical college system , 2013 .

[31]  Ann Kirby,et al.  The Effect of Attendance on Grade for First Year Economics Students in University College Cork , 2003 .

[32]  David N. Figlio,et al.  Is It Live or Is It Internet? Experimental Estimates of the Effects of Online Instruction on Student Learning , 2010, Journal of Labor Economics.

[33]  O. Harmon,et al.  Online, blended, and classroom teaching of economics principles: A randomized experiment , 2014 .

[34]  Theodore J. Joyce,et al.  Does classroom time matter , 2015 .

[35]  J. P. Lund,et al.  Determinants of patients' treatment preferences in a clinical trial. , 2000, Community dentistry and oral epidemiology.

[36]  Peter M. Steiner,et al.  Estimating the causal effect of randomization versus treatment preference in a doubly randomized preference trial. , 2012, Psychological methods.

[37]  Larry V. Ellis,et al.  The Effects of Attendance on Student Learning in Principles of Economics , 1995 .

[38]  H. Johnson,et al.  Online Learning and Student Outcomes in California's Community Colleges. , 2014 .

[39]  R. Lalonde.  Evaluating the Econometric Evaluations of Training Programs with Experimental Data , 1984 .

[40]  E. Bettinger,et al.  Changing Distributions: How Online College Classes Alter Student and Professor Performance. CEPA Working Paper No. 15-10. , 2015 .

[41]  Peter M. Steiner,et al.  The importance of covariate selection in controlling for selection bias in observational studies. , 2010, Psychological methods.

[42]  J. A. Dodge,et al.  The role of choice in health education intervention trials: a review and case study. , 2003, Social science & medicine.

[43]  Peter M. Steiner,et al.  Can Nonrandomized Experiments Yield Accurate Answers? A Randomized Experiment Comparing Random and Nonrandom Assignments , 2008 .

[44]  Vivian C. Wong,et al.  Three conditions under which experiments and observational studies produce comparable causal estimates: New findings from within‐study comparisons , 2008 .

[45]  C. Brewin,et al.  Patient preferences and randomised clinical trials. , 1989, BMJ.