Assessment Center for Pilot Selection: Construct and Criterion Validity and the Impact of Assessor Type

Cette recherche a examine la validite d’un centre d’evaluation pour la selection de pilotes. Les scores de N = 1,036 participants ont ete utilises pour etudier la validite de construit. Un sous-echantillon de participants performants a ete suivi et les evaluations des pairs ont ete retenus comme mesures du critere. Les resultats demontrent une premiere evidence de validite de construit et de critere pour cet outil d’evaluation des competences interpersonnelles et liees a la performance. Par ailleurs, les resultats ont aussi montre que le type d’evaluateur (psychologue vs pilote) modere la validite predictive des scores du centre d’evaluation. Cet effet “type d’evaluateur” depend de la sorte de variables predictives. Les resultats sont discutes et des implications pratiques sont suggerees. This study examined the validity of an assessment center in pilot selection as a new field of application. Assessment center ratings of N= 1,036 applicants were used to examine the construct validity. A subsample of successful applicants was followed up and peer ratings were chosen as criterion measures. The results provide first evidence of the construct and criterion validity of this assessment center approach for rating interpersonal and performance-related skills. Furthermore the type of assessor (psychologist versus pilot) moderates the predictive validity of the assessment center ratings. This type-of-assessor effect depends on the kind of predictor variables. The results are discussed and practical implications are suggested.

[1]  A. Sagie,et al.  Assessor type, number of distinguishable dimension categories, and assessment centre construct validity , 1997 .

[2]  S. Ronen,et al.  A four-year validation study of an assessment center in a financial corporation , 1993 .

[3]  Michele Morales Olea,et al.  Predicting pilot and navigator criteria : not much more than g , 1994 .

[4]  Malcolm James Ree,et al.  The stability of g across different methods of estimation , 1991 .

[5]  T R Carretta,et al.  Central role of g in military pilot selection. , 1996, The International journal of aviation psychology.

[6]  R. Jennrich,et al.  Rotation for simple loadings , 1966, Psychometrika.

[7]  J. H. Steiger Tests for comparing elements of a correlation matrix. , 1980 .

[8]  H. A. Thomson Comparison of predictor and criterion judgments of managerial performance using the multitrait-multimethod approach. , 1970 .

[9]  Richard J. Klimoski,et al.  WHY DO ASSESSMENT CENTERS WORK? THE PUZZLE OF ASSESSMENT CENTER VALIDITY , 1987 .

[10]  D. Campbell,et al.  Convergent and discriminant validation by the multitrait-multimethod matrix. , 1959, Psychological bulletin.

[11]  Robert L. Helmreich,et al.  Group interaction and flight crew performance , 1988 .

[12]  R L Helmreich,et al.  The evolution of Crew Resource Management training in commercial aviation. , 1999, The International journal of aviation psychology.

[13]  George C. Thornton,et al.  Meta-analysis of assessment center validity. , 1987 .

[14]  Sue Margaret Norton,et al.  Peer assessments of performance and ability: An exploratory meta-analysis of statistical artifacts and contextual moderators , 1992 .

[15]  Ivan T. Robertson,et al.  The psychometric properties and design of managerial assessment centres: Dimensions into exercises won't go , 1987 .

[16]  Dave Bartram,et al.  Validation of the Cathay Pacific Airways Pilot Selection Program , 1996 .

[17]  Paul R. Sackett,et al.  Constructs and assessment center dimensions: Some troubling empirical findings , 1982 .

[18]  H. Foushee,et al.  Dyads and triads at 35,000 feet: Factors affecting group process and aircrew performance , 1984 .

[19]  L. Shore,et al.  CONSTRUCT VALIDITY OF TWO CATEGORIES OF ASSESSMENT CENTER DIMENSION RATINGS , 1990 .

[20]  H J Hormann,et al.  On the relation between personality and job performance of airline pilots. , 1996, The International journal of aviation psychology.

[21]  Michael P. Kirsch,et al.  METAANALYSES OF VALIDITY STUDIES PUBLISHED BETWEEN 1964 AND 1982 AND THE INVESTIGATION OF STUDY CHARACTERISTICS , 1984 .

[22]  R L Helmreich,et al.  Pilot personality and crew coordination: implications for training and selection. , 1991, The International journal of aviation psychology.

[23]  M Martinussen,et al.  Psychological measures as predictors of pilot performance: a meta-analysis. , 1996, The International journal of aviation psychology.

[24]  A. Jensen,et al.  What is a good g , 1994 .