Score Equivalence, Gender Difference, and Testing Mode Preference in a Comparative Study between Computer- Based Testing and Paper-Based Testing

Abstract—Score equivalency of two Computer-Based Testing (henceforth CBT) and Paper-and-Pencil-Based Testing (henceforth PBT) versions has turned into a controversial issue during the last decade in Iran. The comparability of mean scores obtained from two CBT and PBT formats of test should be investigated to see if test takers’ testing performance is influenced by the effects of testing administration mode. This research was conducted to examine score equivalency across modes as well as the relationship of gender, and testing mode preference with test takers’ performance on computerized testing. The information of testing mode preference and attitudes towards CBT and its features was supported by a focus group interview. Findings indicated that the scores of test takers were not different in both modes and there was no statistically significant relationship between moderator above variables and CBT performance.

[1]  Sue Bennett,et al.  The 'digital natives' debate: A critical review of the evidence , 2008, Br. J. Educ. Technol..

[2]  Lyle F. Bachman,et al.  语言测试实践 = Language testing in practice , 1998 .

[3]  Saad Al-Amri,et al.  Computer-based vs. Paper-based Testing: Does the test administration mode matter? , 2007 .

[4]  Ghada K. Eid.  An Investigation into the Effects and Factors Influencing Computer-Based Online Math Problem-Solving in Primary Schools , 2005 .

[5]  Mary Pommerich,et al.  Developing Computerized Versions of Paper-and-Pencil Tests: Mode Effects for Passage-Based Tests , 2004 .

[6]  Donald E. Powers,et al.  Inexperienced and Anxious Computer Users: Coping With a Computer-Administered Test of Academic Skills , 1993 .

[7]  Seyyed Morteza Hashemi Toroujeni,et al.  Computer-Based Testing: Score Equivalence and Testing Administration Mode Preference in a Comparative Evaluation Study , 2017, iJET.

[8]  Sylvia Green,et al.  On-line Mathematics Assessment: The Impact of Mode on Performance and Question Answering Strategies , 2006 .

[9]  J. Noyes,et al.  Computer- vs. paper-based tasks: Are they equivalent? , 2008, Ergonomics.

[10]  Richard Sale,et al.  International Guidelines on Computer-Based and Internet-Delivered Testing: A Practitioner's Perspective , 2006 .

[11]  Thomas Hoffmann,et al.  Examining the Effect of Computer-Based Passage Presentation on Reading Test Performance , 2005 .

[12]  Tsuyoshi Usagawa,et al.  Effectiveness of E-learning Experience through Online Quizzes: A Case Study of Myanmar Students , 2018, Int. J. Emerg. Technol. Learn..

[13]  Craig Deville,et al.  COMPUTER ADAPTIVE TESTING IN SECOND LANGUAGE CONTEXTS , 1999, Annual Review of Applied Linguistics.

[14]  Randy Elliot Bennett,et al.  How the Internet Will Help Large-Scale Assessment Reinvent Itself , 2001 .

[15]  Seyyed Morteza Hashemi Toroujeni,et al.  Comparability of Computer-Based Testing and Paper-Based Testing: Testing Mode Effect, Testing Mode Order, Computer Attitudes and Testing Mode preference , 2017 .

[16]  Mahdi M. Alamri,et al.  Undergraduate Students' Perceptions toward Social Media Usage and Academic Performance: A Study from Saudi Arabia , 2019, Int. J. Emerg. Technol. Learn..

[17]  Seyyed Morteza Hashemi Toroujeni,et al.  Cross-Mode Comparability of Computer-Based Testing (CBT) versus Paper-Pencil Based Testing (PPT): An Investigation of Testing Administration Mode among Iranian Intermediate EFL Learners. , 2017 .

[18]  Anastasios A. Economides,et al.  The acceptance and use of computer based assessment , 2011, Comput. Educ..

[19]  Jaeyool Boo,et al.  Comparability of a paper-based language test and a computer-based language test , 2003 .

[20]  J. B. Olsen,et al.  THE FOUR GENERATIONS OF COMPUTERIZED EDUCATIONAL MEASUREMENT , 1988 .

[21]  Mohamad Jafre Zainol Abidin,et al.  ScienceDirect International Conference on Current Trends in ELT Comparability of Test Results of Computer Based Tests ( CBT ) and Paper and Pencil Tests ( PPT ) among English Language Learners in Iran , 2014 .

[22]  Preston Lewis,et al.  A Comparison of Computer-Based Testing and Pencil-and-Paper Testing for Students with a Read-Aloud Accommodation , 2011 .

[23]  Hong Jiao,et al.  Comparability of Computer-Based and Paper-and-Pencil Testing in K–12 Reading Assessments , 2008 .

[24]  İ. Yurdabakan,et al.  Primary School Students' Attitudes towards Computer Based Testing and Assessment in Turkey. , 2012 .

[25]  B. Bridgeman,et al.  THE EFFECT OF COMPUTER-BASED TESTS ON RACIAL/ETHNIC, GENDER, AND LANGUAGE GROUPS , 2000 .