Towards authentic e-Exams at scale: robust networked Moodle

In this paper we present the design and user evaluation of a resilient online e-Exam platform that is capable of working without a network for most of the exam session, including the conclusion of an exam, without loss of data. We draw upon the education and technology acceptance literature as a basis for evaluation. The technology approach takes advantage of the Moodle learning management system quiz module as a means to provide an electronic workflow for assessments and builds on a range of open source components to construct the robust solution. The approach also enables rich, constructed assessment tasks by providing authentic ‘e-tools of the trade’ software applications and a consistent operating system on each student’s BYO laptop. The robust Moodle exam deployment was trialled in two undergraduate units (subjects) at an Australian university. Students undertook a sequence of practice, mid-term and a final examination using the platform. Additional software and audio files were utilised as part of the exams. Student feedback on their experience was collected using pre and post surveys covering a range of issues related to technology acceptance.

[1]  D. Krathwohl.  A Revision of Bloom's Taxonomy: An Overview , 2002 .

[2]  David H. Jonassen,et al.  What are Cognitive Tools , 1992 .

[3]  Mathew Hillier.  e-Exams with student owned devices: Student voices , 2015 .

[4]  Andrew Fluck.  eExam symposium : design decisions and implementation experience , 2018 .

[5]  Darren Pullen,et al.  Case study of a computer based examination system , 2009 .

[6]  Cornelia Boldyreff,et al.  Successful Reuse of Software Components: A Report from the Open Source Perspective , 2011, OSS.

[7]  John Dermo,et al.  e-Assessment and the student learning experience: A survey of student perceptions of e-assessment , 2009, Br. J. Educ. Technol..

[8]  Gabriele Frankl,et al.  The "Secure Exam Environment": E-Testing with Students' Own Devices , 2017, WCCE.

[9]  Mathew Hillier,et al.  Writing e-Exams in Pre-University College , 2018, OCCE.

[10]  Mathew Hillier,et al.  Student Experiences with a Bring Your Own Laptop e-Exam System in Pre-university College , 2018, OCCE.

[11]  Andrew Fluck,et al.  Arguing again for e-exams in high stakes examinations , 2013 .

[12]  F. Wilcoxon.  Individual Comparisons by Ranking Methods , 1945 .

[13]  Secure online exams using students' devices , 2012, Proceedings of the 2012 IEEE Global Engineering Education Conference (EDUCON).

[14]  S. Jamieson.  Likert scales: how to (ab)use them , 2004, Medical education.

[15]  A. Kayode Adesemowo,et al.  The experience of introducing secure e-assessment in a South African university first-year foundational ICT networking course , 2016 .

[16]  Fred D. Davis.  Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology , 1989, MIS Q..

[17]  Shervin Farzin.  Attitude of Students Towards E-Examination System: an Application of E-Learning , 2017 .

[18]  Milton Friedman,et al.  A Correction: The Use of Ranks to Avoid the Assumption of Normality Implicit in the Analysis of Variance , 1939 .

[19]  S. Shapiro,et al.  An Analysis of Variance Test for Normality (Complete Samples) , 1965 .

[20]  Andrew E. Fluck,et al.  eExams: Strength in Diversity , 2017, WCCE.

[21]  Zakiya Al Nadabi,et al.  Features of an online English language testing interface , 2015 .

[22]  Mathew Hillier,et al.  To type or handwrite: student's experience across six eExam trials , 2015 .

[23]  Andrew Fluck,et al.  Transforming exams - how IT works for BYOD e-Exams , 2017 .

[24]  Andrew Fluck,et al.  Can tertiary eAssessment change secondary school cultures , 2007 .

[25]  P. Roberson,et al.  Analysis of paired Likert data: how to evaluate change and preference questions. , 1995, Family medicine.

[26]  H. B. Mann,et al.  On a Test of Whether one of Two Random Variables is Stochastically Larger than the Other , 1947 .

[27]  Mathew Hillier,et al.  The very idea of e-Exams: Student (pre)conceptions , 2014 .