Envisioning the use of online tests in assessing twenty-first century learning: a literature review

The digital world brings with it more and more opportunities to be innovative around assessment. With a variety of digital tools and the pervasive availability of information anywhere anytime, there is a tremendous capacity to creatively employ a diversity of assessment approaches to support and evaluate student learning in higher education. The challenge in a digital world is to harness the possibilities afforded by technology to drive and assess deep learning that prepares graduates for a changing and uncertain future. One widespread method of online assessment used in higher education is online tests. The increase in the use of online tests necessitates an investigation into their role in evaluating twenty-first century learning. This paper draws on the literature to explore the role of online tests in higher education, particularly their relationship to student learning in a digital and changing world, and the issues and challenges they present. We conclude that online tests, when used effectively, can be valuable in the assessment of twenty-first century learning and we synthesise the literature to extract principles for the optimisation of online tests in a digital age.

[1]  James Boyle,et al.  Using classroom communication systems to support interaction and discussion in large class settings , 2003 .

[2]  G. Brosvic,et al.  Immediate Feedback Assessment Technique Promotes Learning and Corrects Inaccurate first Responses , 2002 .

[3]  Yefim Kats,et al.  Learning Management Systems and Instructional Design : Best Practices in Online Education , 2013 .

[4]  Alvin Vista.  It’s Time to Mobilize Around a New Approach to Educational Assessment , 2017 .

[5]  J C Masters,et al.  Assessment of multiple-choice questions in selected test banks accompanying text books used in nursing education. , 2001, The Journal of nursing education.

[6]  Ulf Stödberg.  A research review of e-assessment , 2012 .

[7]  Zwelijongile Gaylard Baleni.  Online Formative Assessment in Higher Education: Its Pros and Cons. , 2015 .

[8]  Karen Clegg,et al.  Innovative Assessment in Higher Education , 2006 .

[9]  Brett J. Wheldon,et al.  The incidence of clueing in multiple choice testbank questions in accounting : some evidence from Australia , 2016 .

[10]  Anthony A. Piña,et al.  Learning Management Systems: A Look at the Big Picture , 2013 .

[11]  Elizabeth J Marsh,et al.  The positive and negative consequences of multiple-choice testing. , 2005, Journal of experimental psychology. Learning, memory, and cognition.

[12]  Judith Watson,et al.  Does regular online testing enhance student learning in the numerical sciences? Robust evidence from a large data set , 2009, Br. J. Educ. Technol..

[13]  David R. Hampton.  Textbook Test File Multiple-Choice Questions can Measure (A) Knowledge, (B) Intellectual Ability, (C) Neither, (D) Both , 1993 .

[14]  T. Lowe.  Online quizzes for distance learning of mathematics , 2015 .

[15]  Punya Mishra,et al.  What Knowledge Is of Most Worth , 2013 .

[16]  Daniel W McAllister,et al.  This is only a test: a machine-graded improvement to the multiple-choice and true-false examination , 2012 .

[17]  O. Harmon,et al.  Assessment Design and Cheating Risk in Online Instruction , 2010 .

[18]  Paul Henman,et al.  Overcoming adversity among low SES students: a study of strategies for retention , 2013 .

[19]  Guangzhi Zheng,et al.  Learning Management Systems in a Changing Environment , 2014 .

[20]  John J. Siegfried,et al.  Using Multiple-Choice Questions to Evaluate In-Depth Learning of Economics , 2006 .

[21]  Caroline V. Gipps,et al.  What is the role for ICT-based assessment in universities? , 2005 .

[22]  Gary A. Smith.  How Does Student Performance on Formative Assessments Relate to Learning Assessed by Exams , 2007 .

[23]  Terry Anderson,et al.  Theories for Learning with Emerging Technologies , 2010 .

[24]  B. Higgs,et al.  Where's the transformation? Unlocking the potential of technology-enhanced assessment , 2017 .

[25]  I. Arnold,et al.  Cheating at online formative tests: Does it pay off? , 2016, Internet High. Educ..

[26]  Christina Donnelly,et al.  The Use of Case Based Multiple Choice Questions for Assessing Large Group Teaching: Implications on Student's Learning , 2014 .

[27]  Susan Voelkel,et al.  Combining the Formative with the Summative: The Development of a Two-Stage Online Test to Encourage Engagement and Provide Personal Feedback in Large Classes , 2013 .

[28]  Caroline V. Gipps *.  What is the role for ICT‐based assessment in universities? , 2005 .

[29]  Mark G. Simkin,et al.  Multiple-Choice Tests and Student Understanding: What Is the Connection? , 2005 .

[30]  Elizabeth J Marsh,et al.  Memorial consequences of multiple-choice testing on immediate and delayed tests , 2010, Memory & cognition.

[31]  M. Schulz,et al.  Supporting graduate employability: From generalist disciplines through employer and private institution collaboration , 2014 .

[32]  Sue Bennett,et al.  Support for assessment practice: developing the Assessment Design Decisions Framework , 2016 .

[33]  Victor C. X. Wang.  Handbook of Research on Education and Technology in a Changing Society , 2014 .

[34]  Chi Baik,et al.  Crossing the interaction divide between international and domestic students in higher education , 2014 .

[35]  Sarah Davies,et al.  Effective Assessment in a Digital Age , 2010 .

[36]  Ieva Stupans,et al.  Multiple choice questions: Can they examine application of knowledge? , 2006 .

[37]  Anne-Marie Brady,et al.  Assessment of learning with multiple-choice questions. , 2005, Nurse education in practice.

[38]  A. C. Butler,et al.  Feedback enhances the positive effects and reduces the negative effects of multiple-choice testing , 2008, Memory & cognition.

[39]  D. Nicol,et al.  Peer Instruction versus Class-wide Discussion in Large Classes: A comparison of two interaction methods in the wired classroom , 2003 .

[40]  D. Nicol.  E‐assessment by design: using multiple‐choice tests to good effect , 2007 .

[41]  Joseph Kee-Kuok Wong,et al.  Are the Learning Styles of Asian International Students Culturally or Contextually Based , 2004 .

[42]  D. Nicol,et al.  Formative assessment and self‐regulated learning: a model and seven principles of good feedback practice , 2006 .

[43]  Sean F. Ennis,et al.  Multiple-choice question tests: a convenient, flexible and effective learning tool? A case study , 2012 .

[44]  J. Yonker.  The relationship of deep and surface study approaches on factual and applied test‐bank multiple‐choice question performance , 2011 .

[45]  J. Young.  Online Classes See Cheating Go High-Tech. , 2012 .

[46]  J. Kibble,et al.  Use of unsupervised online quizzes as formative assessment in a medical physiology course: effects of incentives on student participation and performance. , 2007, Advances in physiology education.

[47]  Phillip Dawson,et al.  Five ways to hack and cheat with bring-your-own-device electronic examinations , 2016, Br. J. Educ. Technol..

[48]  Sue Bennett,et al.  How technology shapes assessment design: Findings from a study of university teachers , 2017, Br. J. Educ. Technol..