Development of an Automated Performance Test System for Environmental and Behavioral Toxicology Studies

In developing a menu of computerized performance tests for repeated-measures applications the metric properties of selected tests have been examined. Factors of chief concern have been stability and reliability, as well as the practical issue of the length of time it takes to achieve high levels of both. In this study, these factors, as well as predictive validity, are examined. 25 subjects were tested repeatedly (10 sessions) with 11 tests previously identified as “good” candidates for repeated-measures research in paper-and-pencil (marker test) versions. The 11 tests were administered concurrently in their traditional paper-and-pencil modes and newly implemented microcomputer-based versions, along with the Wechsler Adult Intelligence Scale (WAIS). Nine of the 11 microcomputer-based tests achieved stability. Reliabilities were generally high, with r ≥ .77 for 3 min. of testing. Cross-correlations of microbased tests with traditional paper-and-pencil versions suggest equivalency between the test constructs in the different media. Correlations between six of the microbased subtests and the WAIS identified common variance, and these might comprise an efficient short (6 min.) battery of tests.

[1]  Alan D. Baddeley,et al.  Automated tailored testing using Raven's Matrices and the Mill Hill Vocabulary tests: a comparison with manual administration , 1982 .

[2]  Lesa A. McComas Effects of simulated ship motion on the performance of underway officer of the decks. , 1986 .

[3]  Robert S. Kennedy,et al.  Grammatical Reasoning: A Stable Performance Yardstick , 1981 .

[4]  D. Wechsler The measurement and appraisal of adult intelligence, 4th ed. , 1958 .

[5]  Robert S. Kennedy,et al.  Selection of Performance Evaluation Tests for Environmental Research1 , 1980 .

[6]  M. R. Novick,et al.  Statistical Theories of Mental Test Scores. , 1971 .

[7]  C. Hulin,et al.  Two Explanations of Temporal Changes in Ability-Skill Relationships: A Literature Review and Theoretical Analysis , 1972 .

[8]  R J Hornick,et al.  A Study and Review of Human Response to Prolonged Random Vibration , 1966, Human factors.

[9]  D L Rock,et al.  Comparison of the Standard and Computerized Versions of the Raven Coloured Progressive Matrices Test , 1982, Perceptual and motor skills.

[10]  Norman E Lane,et al.  Issues in Performance Measurement for Military Aviation with Applications to Air Combat Maneuvering , 1986 .

[11]  Steven H. Ferris,et al.  Effects of aging and dementia upon recent visuospatial memory , 1984, Neurobiology of Aging.

[12]  R. B. Mefferd,et al.  Repetitive Psychometric Measures , 1959 .

[13]  Ruth B. Ekstrom,et al.  Manual for kit of factor-referenced cognitive tests , 1976 .

[14]  V. Leirer,et al.  Carry-over effects of marijuana intoxication on aircraft pilot performance: a preliminary report. , 1985, The American journal of psychiatry.

[15]  Norman E. Lane,et al.  Preliminary evaluation of a micro-based repeated measures testing system , 1985 .

[16]  Mark S. Crabtree,et al.  Development and Application of a Criterion Task Set for Workload Metric Evaluation , 1983 .

[17]  M. Crispin Ethical principles in the conduct of research with human participants. , 1973, The American psychologist.

[18]  Edwin A. Fleishman,et al.  On the relation between abilities, learning, and human performance. , 1972 .

[19]  Robert S. Kennedy,et al.  The Development of a Navy Performance Evaluation Test for Environmental Research (PETER). , 1978 .

[20]  Sarah L. Wilson,et al.  Automated Psychological Testing for the severely physically handicapped , 1982 .

[21]  R. Kennedy,et al.  A Video Game for Performance Testing , 1981 .

[22]  Julie M. Donnell Performance Decrement as a Function of Total Sleep Loss and Task Duration , 1969, Perceptual and motor skills.

[23]  J. W. French The description of aptitude and achievement tests in terms of rotated factors. , 1951 .

[25]  R. C. Carter,et al.  Performance Evaluation Tests for Environmental Research (Peter): Evaluation of 114 Measures , 1984, Perceptual and motor skills.

[26]  R S Kennedy,et al.  Susceptibility to seasickness: influence of hull design and steaming direction. , 1979, Aviation, space, and environmental medicine.

[27]  Robert S. Kennedy,et al.  Performance Evaluation Tests for Environmental Research (PETER): Collected Papers. , 1981 .

[28]  A D Baddeley,et al.  Influence of depth on the manual dexterity of free divers: a comparison between open sea and pressure chamber testing. , 1966, The Journal of applied psychology.

[29]  Alvah C. Bittner,et al.  Statistical Tests for Differential Stability , 1979 .

[30]  Benton J. Underwood,et al.  The Composition of Episodic Memory. , 1977 .

[31]  Norman E. Lane,et al.  Overcoming Unreliability in Operational Measures: The Use of Surrogate Measure Systems , 1986 .

[32]  Mert Kiziltan Cognitive Performance Degradation on Sonar Operator and Torpedo Data Control Unit Operator after One Night of Sleep Deprivation , 1985 .

[33]  G. Langolf,et al.  Effect of occupational exposure to elemental mercury on short term memory. , 1983, British journal of industrial medicine.

[34]  R S Kennedy,et al.  Automated Portable Test (APT) System: Overview and prospects , 1985, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[35]  Alvah C. Bittner,et al.  Estimating Reliability with Small Samples: Increased Precision with Averaged Correlations. , 1986 .

[36]  Marshall B. Jones Stabilization and Task Definition in a Performance Test Battery , 1979 .

[37]  S. Horvath,et al.  Sustained Visual Attention and Carbon Monoxide: Elimination of Adaptation Effects , 1981, Human factors.

[38]  R. Reitan,et al.  Clinical neuropsychology: Current status and applications. , 1974 .

[39]  S H Ferris,et al.  Facial recognition memory deficits in normal aging and senile dementia. , 1980, Journal of gerontology.

[40]  Performance Instability of Learning Disabled, Emotionally Handicapped, and Nonhandicapped Children , 1986 .

[41]  M. Peters,et al.  Prolonged Practice of a Simple Motor Task by Preferred and Nonpreferred Hands , 1976, Perceptual and motor skills.

[42]  A. Anastasi Individual differences. , 2020, Annual review of psychology.