Comparison of On-line versus Paper Spatial Testing Methods

Spatial visualization skills have been shown to be critical to the success of engineers and engineering students, and the assessment and remediation of those skills is growing in engineering curricula across the country. At Michigan Technological University, spatial skills of freshmen engineering students have been tested with the use of the Purdue Spatial Visualization Test: Rotations (PSVT:R) since 1993. This test has traditionally been administered with paper tests where students record their answers on a scantron form. Due to changes in university computing resources in the 2013-2014 academic year, the opportunity arose to test the freshmen through a Learning Management System (LMS). In the fall of 2014, over 450 of the engineering freshmen were administered the PSVT:R with the traditional paper test method, while approximately the same number took the test through the LMS. Testing half of the students with each method allowed for a comparison to be made between the two testing methods. This paper compares scores from the paper version of the test with scores on the on-line version of the test to determine if students perform equally on the on-line and paper forms of the test.

[1]  Mark L. Berenson,et al.  Proctored versus Unproctored Online Exams: Studying the Impact of Exam Environment on Student Performance. , 2009 .

[2]  Thomas Frese,et al.  Implementing computer-based assessment - A web-based mock examination changes attitudes , 2012, Comput. Educ..

[3]  M. Shermis,et al.  Effects of Computer-Based Test Administrations on Test Anxiety and Performance , 1998 .

[4]  Edward F. Gehringer,et al.  Online Vs. On Paper Exams , 2010 .

[5]  F. Robert Wilson,et al.  Assessing the equivalence of paper-and-pencil vs. computerized tests: Demonstration of a promising methodology , 1985 .

[6]  F. Drasgow,et al.  Equivalence of computerized and paper-and-pencil cognitive ability tests: A meta-analysis. , 1993 .

[7]  Norma L. Veurink,et al.  Raising the Bar? Longitudinal Study to Determine which Students Would Benefit Most from Spatial Training , 2011 .

[8]  David M. Lane,et al.  Spatial visualization and sex differences in quantitative ability , 1979 .

[9]  M. Casey,et al.  The Influence of Spatial Ability on Gender Differences in Mathematics College Entrance Test Scores across Diverse Samples. , 1995 .

[10]  Renata S. Engel,et al.  Studying the Reliability and Validity of Test Scores for Mathematical and Spatial Reasoning Tasks for Engineering Students , 2011 .

[11]  Alper Bayazit,et al.  Performance and duration differences between online and paper–pencil tests , 2012 .

[12]  Tamara Knott,et al.  A Comparison Of On Line And Traditional Testing Methods , 2006 .

[13]  Angus S. McDonald,et al.  The impact of individual differences on the equivalence of computer-based and paper-and-pencil educational assessments , 2002, Comput. Educ..

[14]  Douglas K. Detterman,et al.  ACT and General Cognitive Ability. , 2008 .