Combining the Formative with the Summative: The Development of a Two-Stage Online Test to Encourage Engagement and Provide Personal Feedback in Large Classes

The aim of this action research project was to improve student learning by encouraging more “time on task” and to improve self-assessment and feedback through the introduction of weekly online tests in a Year 2 lecture module in biological sciences. Initially voluntary online tests were offered to students and those who participated achieved higher exam marks than those who did not, but completion rate was low. Making the tests compulsory led to high completion rates, but class performance decreased, indicating that using the same assessment for formative and for summative purposes is not always beneficial for learning. Finally, these problems were resolved by introducing a two-stage approach: the first stage of each test was formative and provided prompt feedback. However, students had to achieve 80% to progress to the second summative stage of the test. The two-stage online tests led to significantly improved class performance. This novel test design ensures that students go through at least two attempts and therefore fully benefit from the learning opportunities presented by the formative stage. Two-stage online tests present the opportunity to provide regular feedback in large classes and to improve performance not only of good but also of “weak” students. Keywords: e-learning; e-assessment; action research; higher education (Published: 29 April 2013) Citation: Research in Learning Technology 2013, 21 : 19153 - http://dx.doi.org/10.3402/rlt.v21i0.19153

[1]  D. Nicol,et al.  Formative assessment and self‐regulated learning: a model and seven principles of good feedback practice , 2006 .

[2]  A. Chickering,et al.  Seven Principles for Good Practice in Undergraduate Education , 1987, CORE.

[3]  Judith Watson,et al.  Does regular online testing enhance student learning in the numerical sciences? Robust evidence from a large data set , 2009, Br. J. Educ. Technol..

[4]  Pru Marriott,et al.  Students' evaluation of the use of online summative assessment on an undergraduate financial accounting module , 2009, Br. J. Educ. Technol..

[5]  Xitao Fan,et al.  Statistical Significance and Effect Size in Education Research: Two Sides of a Coin , 2001 .

[6]  V. Braun,et al.  Using thematic analysis in psychology , 2006 .

[7]  Stephen E. Newstead,et al.  The Pressures of Assessment in Undergraduate Courses and their Effect on Student Behaviours , 2001 .

[8]  Mantz Yorke,et al.  Coursework Marks High, Examination Marks Low: Discuss , 2002 .

[9]  Graham Gibbs,et al.  The effects of programme assessment environments on student learning , 2007 .

[10]  John Dermo,et al.  e-Assessment and the student learning experience: A survey of student perceptions of e-assessment , 2009, Br. J. Educ. Technol..

[11]  Philip Butcher,et al.  Online assessment at the Open University using open source software: Moodle, OpenMark and more , 2008 .

[12]  D. Bennett,et al.  New uses for a familiar technology: introducing mobile phone polling in large classes , 2014 .

[13]  J. Biggs,et al.  Teaching for Quality Learning , 2007 .

[14]  How do students spend their time , 1997 .

[15]  Michael Prosser,et al.  Students' experiences in studying for multiple choice question examinations , 1994 .

[16]  Sally Jordan,et al.  Same but different, but is it fair? An analysis of the use of variants of interactive computer-marked questions , 2011 .

[17]  David R. Hampton Textbook Test File Multiple-Choice Questions can Measure (A) Knowledge, (B) Intellectual Ability, (C) Neither, (D) Both , 1993 .

[18]  P. Black,et al.  Assessment and Classroom Learning , 1998 .

[19]  Helen J. Parkin,et al.  Using technology to encourage student engagement with feedback: a literature review , 2011 .

[20]  F. Prins,et al.  Intellectual ability, learning style, personality, achievement motivation and academic success of psychology students in higher education. , 2000 .

[21]  G. Boulton‐Lewis Teaching for quality learning at university , 2008 .

[22]  Graham Gibbs,et al.  Using Assessment to Support Student Learning , 2010 .

[23]  D. Henly,et al.  Use of Web-based formative assessment to support student learning in a metabolism/nutrition unit. , 2003, European journal of dental education : official journal of the Association for Dental Education in Europe.

[24]  D. Harris,et al.  Factors affecting college grades: a review of the literature, 1930-1937. , 1940 .

[25]  D. Sadler,et al.  Formative Assessment: revisiting the territory , 1998 .

[26]  J. Biggs,et al.  Teaching For Quality Learning At University , 1999 .

[27]  Sally Jordan,et al.  Student engagement with assessment and feedback: Some lessons from short-answer free-text e-assessment questions , 2012, Comput. Educ..

[28]  Sally E. Jordan,et al.  A comparison of human and computer marking of short free-text student responses , 2010, Comput. Educ..

[29]  Robert McNabb,et al.  Gender Differences in Educational Attainment: The Case of University Students in England and Wales , 2002 .

[30]  David Robinson,et al.  Using technology to direct learning in higher education , 2009 .

[31]  George D. Kuh What We're Learning About Student Engagement From NSSE: Benchmarks for Effective Educational Practices , 2003 .

[32]  S. Lea,et al.  Higher Education Students' Attitudes to Student-centred Learning: Beyond 'educational bulimia'? , 2003 .

[33]  Mary Peat,et al.  Supporting student learning: the use of computer-based formative assessment modules , 2002, Br. J. Educ. Technol..

[34]  Sally Jordan,et al.  eAssessment and the independent learner , 2009 .

[35]  Larry Ambrose,et al.  The power of feedback. , 2002, Healthcare executive.

[36]  George D. Kuh,et al.  Student Experiences With Information Technology And Their Relationship To Other Aspects Of Student Engagement , 2005 .

[37]  Tess Miller Formative computer‐based assessment in higher education: the effectiveness of feedback in supporting student learning , 2009 .

[38]  G. Benfield,et al.  The undergraduate experience of blended e-learning: a review of UK literature and practice , 2006 .

[39]  Paula Hodgson,et al.  Effective formative e-assessment of student learning: a study on a statistics course , 2012 .

[40]  Annemarie S. Palincsar,et al.  Social constructivist perspectives on teaching and learning. , 1998, Annual review of psychology.

[41]  Caroline V. Gipps,et al.  What is the role for ICT-based assessment in universities? , 2005 .

[43]  K. Arrow Higher education as a filter , 1973 .

[44]  Paul Trowler,et al.  Student engagement evidence summary , 2010 .

[45]  J. Kibble,et al.  Use of unsupervised online quizzes as formative assessment in a medical physiology course: effects of incentives on student participation and performance. , 2007, Advances in physiology education.