BlueBook: A Computerized Replacement for Paper Tests in Computer Science

This paper presents BlueBook, a lightweight, cross-platform, computer-based, open source examination environment that overcomes traditional hurdles with computerized testing for computer science courses. As opposed to paper exam testing, BlueBook allows students to type coding problems on their laptops in an environment similar to their normal programming routine (e.g., with syntax highlighting), but purposefully does not provide them the ability to compile and/or run their code. We seamlessly transitioned from paper exams to BlueBook and found that students appreciated the ability to type their responses. Additionally, we are just beginning to harness the benefits to grading by having student answers in digital form. In the paper, we discuss the pedagogical benefits and trade-offs to using a computerized exam format, and we argue that both the students and the graders benefit from it.

[1]  Arvind Kumar Tiwari,et al.  Design and Implementation of Secure Computer Based Examination System Based On B / S Structure , 2016 .

[2]  Nurudeen Ajayi,et al.  Students' perceptions of computer-based assessments: A case of UKZN , 2016, 2016 IST-Africa Week Conference.

[3]  J. Noyes,et al.  Computer- vs. paper-based tasks: Are they equivalent? , 2008, Ergonomics.

[4]  Ben Matthews,et al.  Student Interaction with a Computer Tablet Exam Application Replicating the Traditional Paper Exam , 2015 .

[5]  D. Gürsoy.  Assessing novice programmers’ performance in programming exams via computer-based test , 2016 .

[6]  Antti-Jussi Lakanen,et al.  Paper-based vs computer-based exams in CS1 , 2016, Koli Calling.

[7]  Zhang Liang,et al.  A novel web-based online examination system for computer science education , 2003, 33rd Annual Frontiers in Education, 2003. FIE 2003..

[8]  F. Drasgow,et al.  Equivalence of computerized and paper-and-pencil cognitive ability tests: A meta-analysis. , 1993 .

[9]  Nell B. Dale,et al.  Computerized adaptive testing in computer science: assessing student programming abilities , 1993, SIGCSE '93.

[10]  Manfred Steffen,et al.  The GRE Computer Adaptive Test: Operational Issues , 2000 .

[11]  Anastasios A. Economides,et al.  The impact of paper-based, computer-based and mobile-based self-assessment on students' science motivation and achievement , 2016, Comput. Hum. Behav..

[12]  Sara A. Brallier,et al.  Computer-Based Testing: A Comparison of Computer-Based and Paper-and-Pencil Assessment , 2010 .

[13]  Sue Fitzgerald,et al.  Paper vs. Computer-based Exams: A Study of Errors in Recursive Binary Tree Algorithms , 2016, SIGCSE.

[14]  Erhan Delen,et al.  Enhancing a Computer-Based Testing Environment with Optimum Item Response Time , 2015 .

[15]  Roy B. Clariana,et al.  Gender Differences in Computer-Administered Versus Paper-Based Tests , 2005 .

[16]  Brian P. Bailey,et al.  Measuring Effects of Modality on Perceived Test Anxiety for Computer Programming Exams , 2016, SIGCSE.

[17]  Seyyed Morteza Hashemi Toroujeni,et al.  Replacing Paper-Based Testing with an Alternative for the Assessment of Iranian Undergraduate Students: Administration Mode Effect on Testing Performance , 2017 .

[18]  Hanho Jeong.  A comparative study of scores on computer-based tests and paper-based tests , 2014, Behav. Inf. Technol..

[19]  Eren Can Aybek,et al.  Bilgisayar Ortamında Ve Kağıt-Kalem Formunda Uygulanan Genel Yetenek Testinin Psikometrik Özelliklerinin Karşılaştırılması , 2014 .

[20]  Oscar Marcenaro-Gutierrez,et al.  MIND THE GAP: ANALYSING THE FACTORS BEHIND THE GAP IN STUDENTS’ PERFORMANCE BETWEEN PENCIL AND COMPUTER BASED ASSESSMENT METHODS , 2016 .

[21]  Iouri Belski,et al.  Developing creativity and problem-solving skills of engineering students: a comparison of web- and pen-and-paper-based approaches , 2017 .

[22]  Howard Wainer,et al.  Testlet Response Theory: An Analog for the 3PL Model Useful in Testlet-Based Adaptive Testing , 2000 .

[23]  Judithe Sheard,et al.  Summative Computer Programming Assessment Using Both Paper and Computer , 2005, ICCE.

[24]  Alfred V. Aho,et al.  A Minimum Distance Error-Correcting Parser for Context-Free Languages , 1972, SIAM J. Comput..