Large-scale investigation of the role of trait activation theory for understanding assessment center convergent and discriminant validity.

This study used trait activation theory as a theoretical framework to conduct a large-scale test of the interactionist explanation of the convergent and discriminant validity findings obtained in assessment centers. Trait activation theory specifies the conditions in which cross-situationally consistent and inconsistent candidate performances are likely to occur. Results obtained by aggregating correlations across 30 multitrait-multimethod matrices supported the propositions of trait activation theory, shedding a more positive light on the construct validity puzzle in assessment centers. Overall, convergence among assessment center ratings was better between exercises that provided an opportunity to observe behavior related to the same trait, and discrimination among ratings within exercises was generally better for dimensions that were not expressions of the same underlying traits. Implications for assessment center research and practice are discussed.

[1]  Michael M. Harris,et al.  Does the assessment center scoring method affect the cross-situational consistency of ratings? , 1993 .

[2]  D. A. Kenny,et al.  Consensus in interpersonal perception: acquaintance and the big five. , 1994, Psychological bulletin.

[3]  N. Schmitt,et al.  An exercise design approach to understanding assessment center dimension and exercise constructs. , 1992 .

[4]  Alene S. Becker.  The effects of a reduction in assessor roles on the convergent and discriminant validity of assessment center ratings , 1990 .

[5]  A. Fredricks.  Assessment center ratings: Models and process , 1989 .

[6]  D. Funder,et al.  Behavioral manifestations of personality: an ecological approach to judgmental accuracy. , 1993, Journal of personality and social psychology.

[7]  C. Lance,et al.  Assessor cognitive processes in an operational assessment center. , 2004, The Journal of applied psychology.

[8]  S. Zedeck.  A process analysis of the assessment center method. , 1986 .

[9]  J. Conway,et al.  Analysis and Design of Multitrait-Multirater Performance Appraisal Studies , 1996 .

[10]  Filip Lievens,et al.  The construct validity of a Belgian assessment centre: A comparison of different models , 2001 .

[11]  John W. Fleenor.  Constructs and developmental assessment centers: Further troubling empirical findings , 1996 .

[12]  R. Tett,et al.  Situation Trait Relevance, Trait Expression, and Cross-Situational Consistency: Testing a Principle of Trait Activation , 2000 .

[13]  David Chan.  Criterion and construct validation of an assessment centre. , 1996 .

[14]  N. Christiansen,et al.  IMPLICATIONS OF TRAIT‐ACTIVATION THEORY FOR EVALUATING THE CONSTRUCT VALIDITY OF ASSESSMENT CENTER RATINGS , 2002 .

[15]  D. Funder,et al.  Friends and strangers: acquaintanceship, agreement, and the accuracy of personality judgment. , 1988, Journal of personality and social psychology.

[16]  J. Conway,et al.  Dimension and exercise variance in assessment center scores: a large-scale evaluation of multitrait-multimethod studies. , 2001, The Journal of applied psychology.

[17]  R. Goffin,et al.  Personality testing and the assessment center : Incremental validity for managerial selection , 1996 .

[18]  W. Mischel,et al.  A cognitive-affective system theory of personality: reconceptualizing situations, dispositions, dynamics, and invariance in personality structure. , 1995, Psychological review.

[19]  L. Newman,et al.  When the Stakes are Higher: Self-esteem Instability and Self-handicapping , 1997 .

[20]  Robert E. Wood,et al.  Self- versus others' ratings as predictors of assessment center ratings: Validation evidence for 360-degree feedback programs. , 2002 .

[21]  H. Murray,et al.  Explorations in Personality , 2007 .

[22]  F. Lievens,et al.  Predicting cross-cultural training performance: the validity of personality, cognitive ability, and dimensions measured by an assessment center and a behavior description interview. , 2003, The Journal of applied psychology.

[23]  Winfred Arthur,et al.  The Construct-Related Validity of Assessment Center Ratings: A Review and Meta-Analysis of the Role of Methodological Factors , 2003 .

[24]  Y. Trope.  Identification and Inferential Processes in Dispositional Attribution. , 1986 .

[25]  L. R. Goldberg.  THE DEVELOPMENT OF MARKERS FOR THE BIG-FIVE FACTOR STRUCTURE , 1992 .

[26]  F. Lievens.  Trying to understand the different pieces of the construct validity puzzle of assessment centers: an examination of assessor and assessee effects. , 2002, Journal of Applied Psychology.

[27]  Charles E. Lance,et al.  Assessment Center Exercise Factors Represent Cross-Situational Specificity, Not Method Bias , 2000 .

[28]  G. Dobbins,et al.  New Evidence On the Construct Validity of Diagnostic Assessment Centers: The Findings May Not Be So Troubling After All , 1997 .

[29]  D. Jackson,et al.  Analysis of Multitrait-Multirater Performance Appraisal Data: Composite Direct Product Method versus Confirmatory Factor Analysis. , 1992, Multivariate behavioral research.

[30]  F. Lievens.  Assessors and use of assessment centre dimensions: a fresh look at a troubling issue* , 2001 .

[31]  F. Lievens,et al.  Understanding the assessment center process: Where are we now? , 2001 .

[32]  R. Tett,et al.  A personality trait-based interactionist model of job performance. , 2003, The Journal of applied psychology.

[33]  Ellen M. Whitener,et al.  Confusion of confidence intervals and credibility intervals in meta-analysis. , 1990 .

[34]  A. Furnham,et al.  Validating the NEO Personality Inventory using assessor's ratings , 1997 .

[35]  D. A. Kenny,et al.  Consensus at zero acquaintance: replication, behavioral cues, and stability. , 1992, Journal of personality and social psychology.

[36]  Winfred Arthur,et al.  Convergent and Discriminant Validity of Assessment Center Dimensions: A Conceptual and Empirical Reexamination of the Assessment Center Construct-Related Validity Paradox , 2000 .

[37]  Warren S. Bobrow,et al.  Development and validation of an assessment center during organizational change. , 1997 .

[38]  Filip Lievens,et al.  Assessors' use of personality traits in descriptions of assessment centre candidates: A five-factor model perspective , 2001 .

[39]  C. Cooper,et al.  International review of industrial and organizational psychology , 1986 .

[40]  David C. Funder,et al.  Personality judgment: A realistic approach to person perception. , 1999 .

[41]  P. Bycio,et al.  Situational specificity in assessment center ratings: A confirmatory factor analysis. , 1987 .

[42]  Eric Anthony Day,et al.  A META‐ANALYSIS OF THE CRITERION‐RELATED VALIDITY OF ASSESSMENT CENTER DIMENSIONS , 2003 .

[43]  W. Mischel.  Toward a cognitive social learning reconceptualization of personality. , 1973, Psychological review.

[44]  A. Sagie,et al.  Assessor type, number of distinguishable dimension categories, and assessment centre construct validity , 1997 .

[45]  George C. Thornton,et al.  Developing Organizational Simulations : A Guide for Practitioners and Students , 2003 .

[46]  Samuel B. Pond,et al.  MANAGERIAL FUNCTIONS: AN ALTERNATIVE TO TRADITIONAL ASSESSMENT CENTER DIMENSIONS? , 1994 .

[47]  Michael M. Harris,et al.  The Measurement of Assessment Center Situations: Bem's Template Matching Technique for Examining Exercise Similarity , 1993 .

[48]  D. Funder,et al.  Differences between traits: properties associated with interjudge agreement. , 1987, Journal of personality and social psychology.

[49]  D. S. Holmes,et al.  The timing of psychosocial transitions and changes in women's lives: an examination of women aged 45 to 60. , 1986, Journal of personality and social psychology.

[50]  F. Lievens.  Factors which Improve the Construct Validity of Assessment Centers: A Review , 1998 .

[51]  O. John,et al.  Determinants of interjudge agreement on personality traits: the big five domains, observability, evaluativeness, and the unique perspective of the self. , 1993, Journal of personality.