Selection and Classification Tests for Critical Military Occupational Specialties

Abstract : This report presents research on issues affecting the readiness of new Army personnel tests for implementation. These tests are from the battery developed under the Army's Project A to supplement the Armed Services Vocational Aptitude Battery (ASVAB). Specific tests were chosen for this research because they are being considered by the Department of Defense for implementation in preenlistment selection and classification. For this research, in 1990 new recruits at Fort Knox and Fort Benning took computerized tests of spatial, perceptual, and psychomotor abilities. Three possible sources of extraneous variance in the test scores were investigated: order effects, practice effects, and effects of changes in test instructions. In addition, pencil and paper versions of new biodata and spatial items were tested. As part of the work to counteract falsification on self-report instruments, forms of the Assessment of Background and Life Experiences (ABLE) were administered under various instructional sets. Finally, scores for two of the computerized tests were compared with archival scores on pencil-and-paper versions from Project A to determine possible effects of medium of administration on test performance. Approaches to dealing with the sources of variance other than ability are discussed, and needs for follow-on research are identified.