Education is crucial to a safe and healthy working environment in construction and engaging students in the construction engineering and management programs in this very important subject is the catalyst to the success of safety education. This paper discusses the evaluation of an innovative learning assessment tool, Safety Inspector, for the education of construction safety. Safety Inspector is a 3D video game previously developed to provide a “safe” environment that engages students in recognizing comprehensive hazards, evaluates student performance, and enhances student learning interests. Evaluation strategies developed in the research take into considerations student learning objectives for construction safety, limitations of available assessment resources, logistics of the course, signals that reflect underlying cognitive learning processing, and statistical validity requirements. To implement the evaluation, game-based and paper-based tests were both administered for the experiment with a follow-up questionnaire in an undergraduate class at the University of Washington. Some patterns were identified as a result of the evaluation. The major lesson learned is that when the hazard recognition tasks are presented similarly in different test modes, testing scores could be more statistically relevant. However, certain types of hazards are difficult to identify in the game-base test because they require the change of viewing angles that do not naturally occur in a virtual model.
[1]
C. Ricketts,et al.
Improving Student Performance Through Computer-based Assessment: Insights from recent research
,
2002
.
[2]
Cynthia G. Parshall,et al.
Innovative Item Types for Computerized Testing
,
2000
.
[3]
Alija Kulenović,et al.
Standards for Educational and Psychological Testing
,
1999
.
[4]
Gail P. Baxter,et al.
Science performance assessments: benchmarks and surrogates
,
1994
.
[5]
Alan C. Bugbee,et al.
The Equivalence of Paper-and-Pencil and Computer-Based Testing.
,
1996
.
[6]
S. Sireci,et al.
Validity Issues in Computer-Based Testing
,
2005
.
[7]
Cornelis A.W. Glas,et al.
Computerized adaptive testing : theory and practice
,
2000
.
[8]
Melody W. Alexander,et al.
Testing in a Computer Technology Course: An Investigation of Equivalency in Performance Between Online and Paper and Pencil Methods
,
2001
.
[9]
Eddy M. Rojas,et al.
A pilot study of a 3D game environment for construction safety education
,
2011,
J. Inf. Technol. Constr..
[10]
Cynthia G. Parshall,et al.
Practical Considerations in Computer-Based Testing
,
2002
.