Speed and Performance Differences among Computer-Based and Paper-Pencil Tests

This study investigated the effect of several different modes of test administration on scores and completion times. In Experiment 1, paper-based assessment was compared to computer-based assessment. Undergraduates completed the computer-based assessment faster than the paper-based assessment, with no difference in scores. Experiment 2 assessed three different computer interfaces that provided students various levels of flexibility to change and review answers. No difference in scores was observed among the three modes, but students completed the least-flexible mode faster than the other two modes. It appears that less flexible test modes are faster and do not result in poorer performance than more flexible modes.

[1]  Frank M. Bernt,et al.  Testing by Computer: Findings in Six Years of Use 1982-1988 , 1990 .

[2]  Daniel J. Bernstein,et al.  An Examination of the Equivalence between Non-Adaptive Computer-Based and Traditional Testing , 2001 .

[3]  Michael Russell.  Testing On Computers , 1999 .

[4]  John Mazzeo.  Comparability of Computer and Paper-and-Pencil Scores for Two CLEP General Examinations. College Board Report No. 91-5. , 1991 .

[5]  Michael Russell,et al.  Testing On Computers , 1999 .

[6]  James B. Olsen,et al.  Comparisons of Paper-Administered, Computer-Administered and Computerized Adaptive Achievement Tests , 1989 .

[7]  Pat-Anthony Federico.  Computer-Based and Paper-Based Measurement of Recognition Performance. , 1989 .

[8]  Walter P. Vispoel,et al.  Reviewing and Changing Answers on Computer‐adaptive and Self‐adaptive Vocabulary Tests , 1998 .

[9]  A. Greasley,et al.  Can Computer-Based Testing Achieve Quality and Efficiency in Assessment? , 1995 .

[10]  Daniel J. Mueller,et al.  Implications of Changing Answers on Objective Test Items. , 1977 .

[11]  Douglas F. Becker,et al.  The Score Equivalence of Paper-and-Pencil and Computerized Versions of a Speeded Test of Reading Comprehension , 2002 .

[12]  Becky Smerdon,et al.  Teachers' Tools for the 21st Century: A Report on Teachers' Use of Technology. Statistical Analysis Report. , 2000 .

[13]  Martha L. Stocking,et al.  Practical Issues in Large-Scale Computerized Adaptive Testing , 1996 .

[14]  Mark D. Reckase,et al.  Effect of the Medium of Item Presentation on Examinee Performance and Item Characteristics , 1989 .

[15]  David Zandvliet,et al.  A Comparison of Computer-Administered and Written Tests , 1997 .

[16]  S DeAngelis,et al.  Equivalency of computer-based and paper-and-pencil testing. , 2000, Journal of allied health.

[17]  Roy B. Clariana,et al.  Paper-based versus computer-based assessment: key factors associated with the test mode effect , 2002, Br. J. Educ. Technol..

[18]  F. Drasgow,et al.  Equivalence of computerized and paper-and-pencil cognitive ability tests: A meta-analysis. , 1993 .

[19]  Justin Kruger,et al.  Counterfactual thinking and the first instinct fallacy. , 2005, Journal of Personality and Social Psychology.

[20]  Kathleen M. Hannafin,et al.  The Effect of Computerized Tests on the Performance and Attitudes of College Students , 1989 .

[21]  Kathleen E. Moreno,et al.  The Effects of Mode of Test Administration on Test Performance , 1986 .

[22]  G. Neuman,et al.  Computerization of Paper-and-Pencil Tests: When are They Equivalent? , 1998 .

[23]  Alysse Weinberg.  Comparaison de deux versions d'une test de classement: Version papier-crayon et version informatisee (Comparison of Two Versions of a Placement Test: Paper-Pencil Version and Computer-based Version). , 2001 .

[24]  Paul H. Dimock,et al.  The Effects of Format Differences and Computer Experience on Performance and Anxiety on a Computer-Administered Test. , 1991 .

[25]  Bert F. Green,et al.  Equivalence of Conventional and Computer Presentation of Speed Tests , 1986 .

[26]  Alysse Weinberg.  Comparaison de deux versions d'un test de classement: version papier-crayon et version informatisée , 2001 .

[27]  Robert F. McMorris,et al.  Reasons for Changing Answers: An Evaluation Using Personal Interviews. , 1991 .

[28]  Dillon K Inouye,et al.  Four generations of computerized test administration , 1986 .