EVALUATING CLASSIFICATIONS OF JOB BEHAVIOR: A CONSTRUCT VALIDATION OF THE ABILITY REQUIREMENT SCALES

This article discusses the major inferential issues arising in the development of behavioral classification systems. Subsequently, we discuss the implications of these inferential issues for evaluating the construct validity of systems designed to assess the requirements of human task performance. Fleishman's (1975b, 1982) ability requirement taxonomy and its associated job analysis system, the Manual for the Ability Requirement Scales (MARS), were then evaluated with respect to these criteria. In particular, a variety of criteria relevant to internal and external validity was reviewed. It was found that the ability requirement taxonomy and the associated measurement system provides a meaningful description of job activities with respect to these criteria. It was argued that application of these construct validity principles might contribute much to our understanding of human performance.

[1]  Edwin A. Fleishman,et al.  A comparative study of aptitude patterns in unskilled and skilled psychomotor performances. , 1957 .

[2]  K. Murphy.  Is the relationship between cognitive ability and job performance stable over time , 1989 .

[3]  E. A. Fleishman,et al.  Evaluation of an abilities classification system for integrating and generalizing human performance research findings: An application to vigilance tasks. , 1973 .

[4]  R R Sokal,et al.  Classification: Purposes, Principles, Progress, Prospects , 1974, Science.

[5]  Edwin A. Fleishman,et al.  Reliability and validity of methods for evaluating perceived physical effort. , 1980 .

[6]  Edwin A. Fleishman,et al.  Changes in factor structure of a complex psychomotor test as a function of practice , 1954 .

[7]  Michael D. Mumford,et al.  Measuring occupational difficulty: A construct validation against training criteria. , 1987 .

[8]  Edwin A. Fleishman,et al.  The Perception of Physical Effort in Job Tasks , 1986 .

[9]  H. Simon,et al.  Making Management Decisions: the Role of Intuition and Emotion , 1987 .

[10]  P. Ackerman.  Individual differences in information processing: An investigation of intellectual abilities and task performance during practice ☆ , 1986 .

[11]  Ronald A. Ash,et al.  Exploratory comparative study of four job analysis methods. , 1980 .

[12]  E A FLEISHMAN,et al.  Dimensional analysis of movement reactions. , 1958, Journal of experimental psychology.

[13]  S. Messick.  Test validity and the ethics of assessment. , 1980 .

[14]  Edwin A. Fleishman,et al.  Factorial analysis of complex psychomotor performance and related skills. , 1956 .

[15]  S. A. Fine,et al.  THE USE OF FUNCTIONAL JOB ANALYSIS IN ESTABLISHING PERFORMANCE STANDARDS FOR HEAVY EQUIPMENT OPERATORS , 1981 .

[16]  J. Horn,et al.  ON THE SUBJECTIVE CHARACTER OF THE EMPIRICAL BASE OF GUILFORD'S STRUCTURE-OF-INTELLECT MODEL , 1973 .

[17]  E. A. Fleishman,et al.  Ability requirements as a function of changes in the characteristics of an auditory signal identification task. , 1973, The Journal of applied psychology.

[18]  Edwin A. Fleishman,et al.  Identifying Ability Requirements by Decision Flow Diagrams , 1980 .

[19]  E. A. Fleishman,et al.  Toward a Taxonomy of Human Performance. , 1975 .

[20]  R. Sternberg.  Implicit theories of intelligence. creativity, and wisdom , 1985 .

[21]  Robert J. Harvey,et al.  Influence of amount of job descriptive information on job analysis rating accuracy. , 1988 .

[22]  R. Guion,et al.  “CONTENT VALIDITY” IN MODERATION , 1978 .

[23]  Frank J. Landy,et al.  Stamp collecting versus science: Validation as hypothesis testing. , 1986 .

[24]  L. Cronbach,et al.  Assessing similarity between profiles. , 1953, Psychological bulletin.

[25]  E. A. Fleishman,et al.  Role of kinesthetic and spatialvisual abilities in perceptual-motor learning. , 1963, Journal of experimental psychology.

[26]  R. Hamer,et al.  Cluster Analyzing Profile Data Confounded with Interrater Differences: A Comparison of Profile Association Measures , 1981 .

[27]  E A Fleishman,et al.  The Prediction of Total Task Performance from Prior Practice on Task Components1 , 1965, Human factors.

[28]  J. Matarazzo.  Behavioral health's challenge to academic, scientific, and professional psychology. , 1982, The American psychologist.

[29]  E A FLEISHMAN,et al.  The relation between abilities and improvement with practice in a visual discrimination reaction task. , 1955, Journal of experimental psychology.

[30]  Ruth B. Ekstrom.  Cognitive factors: Their identification and replication. , 1979 .

[31]  P. Ackerman.  Individual differences in skill learning: An integration of psychometric and information processing perspectives. , 1987 .

[32]  L. Cronbach,et al.  Construct validity in psychological tests. , 1955, Psychological bulletin.

[33]  F. Bates,et al.  The noneffect of three variables on mail survey response rate. , 1973 .

[34]  E A Fleishman,et al.  An index of the physical effort required in human task performance. , 1979, The Journal of applied psychology.

[35]  John R. Anderson.  Acquisition of cognitive skill. , 1982 .

[36]  S. Messick.  THE STANDARD PROBLEM: MEANING AND VALUES IN MEASUREMENT AND EVALUATION , 1974 .

[37]  Edwin A. Fleishman,et al.  Factor Structure in Relation to Task Difficulty in Psychomotor Performance1 , 1957 .

[38]  Robert C. Mecham,et al.  A study of job characteristics and job dimensions as based on the Position Analysis Questionnaire (PAQ). , 1972 .

[39]  R. Guion,et al.  On Trinitarian doctrines of validity. , 1980 .

[40]  J M Levine,et al.  Effects of alcohol on human performance: an integration of research findings based on an abilities classification. , 1975, The Journal of applied psychology.

[41]  J. Arnold,et al.  Validation and utility of a strength test for selecting steelworkers. , 1982 .

[42]  Michael D. Mumford,et al.  Abilities as Causes of Individual Differences in Skill Acquisition , 1989 .

[43]  Edwin A. Fleishman,et al.  SOME NEW FRONTIERS IN PERSONNEL SELECTION RESEARCH , 1988 .

[44]  E A FLEISHMAN,et al.  Component and Total Task Relations at Different Stages of Learning a Complex Tracking Task , 1965, Perceptual and motor skills.

[45]  Edwin A. Fleishman,et al.  Factor structure and predictability of successive stages of learning Morse code. , 1960 .

[46]  D. Chesler.  Reliability and comparability of different job evaluation systems. , 1948 .

[47]  Edwin A. Fleishman,et al.  Systems for describing human tasks. , 1982 .

[48]  Edwin A. Fleishman,et al.  On the relation between abilities, learning, and human performance. , 1972 .

[49]  E A FLEISHMAN,et al.  Dimensional analysis of psychomotor abilities. , 1954, Journal of experimental psychology.

[50]  Michael D. Mumford,et al.  Relations between student characteristics, course content, and training outcomes: An integrative modeling effort. , 1988 .

[51]  Mary L. Tenopyr,et al.  Validity and fairness of physical ability tests for predicting performance in craft jobs. , 1979 .

[52]  E. A. Fleishman,et al.  Prediction of transfer and other learning phenomena from ability and personality measures. , 1969, Journal of educational psychology.

[53]  Stanley A. Mulaik,et al.  Toward a Synthesis of Deterministic and Probabilistic Formulations of Causal Relations by the Functional Relation Concept , 1986, Philosophy of Science.