Does regular online testing enhance student learning in the numerical sciences? Robust evidence from a large data set

While a number of studies have been conducted on the impact of online assessment and teaching methods on student learning, the field does not seem settled around the promised benefits of such approaches. It is argued that the reason for this state of affairs is that few studies have been able to control for a number of confounding factors in student performance. We report on the introduction of a regular (every 3 weeks) low-mark online assessment tool in a large, first-year business mathematics course at the University of New South Wales, a major Australian university. Using a retrospective regression methodology together with a very large and rich data set, we test the proposition that exposure to the online assessment instrument enhances student learning. Significantly, we are able to control for prior student aptitude, in-course mastery, gender and even effort via a voluntary class attendance proxy. Furthermore, the study incorporates two large, and statistically diverse cohorts as well as manipulations in the model tested to robustly examine the outcomes. Our central result is that higher exposure to the online instrument robustly leads to higher student learning, all else being equal. Various implications for online assessment design, implementation and targeting are also discussed. [ABSTRACT FROM AUTHOR]

[1]  Jerrell C. Cassady,et al.  The Effects of Internet-Based Formative and Summative Assessment on Test Anxiety, Perceptions of Threat, and Achievement. , 2001 .

[2]  B. W. Brown,et al.  Can Web Courses Replace the Classroom in Principles of Microeconomics , 2002 .

[3]  C. Ricketts,et al.  Improving Student Performance Through Computer-based Assessment: Insights from recent research , 2002 .

[4]  Holly Stillson,et al.  Smart ALEKS ... or Not? Teaching Basic Algebra Using an Online Interactive Learning System , 2003 .

[5]  Joan Wyzkoski Weiss,et al.  Assessing the math online tool: A progress report , 2003 .

[6]  D. Henly,et al.  Use of Web-based formative assessment to support student learning in a metabolism/nutrition unit. , 2003, European journal of dental education : official journal of the Association for Dental Education in Europe.

[7]  Robert J. Beichner,et al.  Comparison of Student Performance Using Web and Paper-Based Homework in College-Level Physics , 2003 .

[8]  Johann Engelbrecht,et al.  Combing Online and Paper Assessment in a Web-based Course In Undergraduate Mathematics , 2004 .

[9]  Alan J. Cann,et al.  Extended matching sets questions for online numeracy assessments: a case study , 2005 .

[10]  G. Hagerty,et al.  Using the Web-Based Interactive Software ALEKS to Enhance College Algebra , 2005 .

[11]  Trey Martindale,et al.  Effects of an Online Instructional Application on Reading And Mathematics Standardized Test Scores , 2005 .

[12]  Qing Li,et al.  Mathematics and At-Risk Adult Learners , 2005 .

[13]  Sherria L. Hoskins,et al.  Motivation and ability: which students use online learning and what influence does it have on their achievement? , 2005, Br. J. Educ. Technol..

[14]  J. Kibble,et al.  Use of unsupervised online quizzes as formative assessment in a medical physiology course: effects of incentives on student participation and performance. , 2007, Advances in physiology education.

[15]  Gary A. Smith How Does Student Performance on Formative Assessments Relate to Learning Assessed by Exams , 2007 .

[16]  Rebecca Carey,et al.  A Study of the Effectiveness of the Louisiana Algebra I Online Course , 2007 .

[17]  Ivo D. Dinov,et al.  Pedagogical utilization and assessment of the statistic online computational resource in introductory probability and statistics courses , 2008, Comput. Educ..