Improving Personality Facet Scores With Multidimensional Computer Adaptive Testing

Narrowly defined personality facet scores are commonly reported and used for making decisions in clinical and organizational settings. Although these facets are typically related, scoring is usually carried out for a single facet at a time. This method can be ineffective and time consuming when personality tests contain many highly correlated facets. This article investigates the possibility of increasing the precision of the NEO PI-R facet scores by scoring items with multidimensional item response theory and by efficiently administering and scoring items with multidimensional computer adaptive testing (MCAT). The increase in the precision of personality facet scores is obtained from exploiting the correlations between the facets. Results indicate that the NEO PI-R could be substantially shorter without attenuating precision when the MCAT methodology is used. Furthermore, the study shows that the MCAT methodology is particularly appropriate for constructs that have many highly correlated facets.

[1]  Holmes W. Finch.  Item Parameter Estimation for the MIRT Model , 2010 .

[2]  Daniel O. Segall,et al.  Multidimensional adaptive testing , 1996 .

[3]  อนุสรณ์ เกิดศรี,et al.  Elements of Adaptive Testing , 2015 .

[4]  P. Fayers.  Item Response Theory for Psychologists , 2004, Quality of Life Research.

[5]  B. Veldkamp,et al.  Conscientiousness in the workplace: Applying mixture IRT to investigate scalability and predictive validity , 2010 .

[6]  Lihua Yao,et al.  A Multidimensional Item Response Modeling Approach for Improving Subscale Proficiency Estimation and Classification , 2007 .

[7]  D. Segall.  Principles of Multidimensional Adaptive Testing , 2000 .

[8]  R. Hambleton,et al.  Fundamentals of Item Response Theory , 1991 .

[9]  S. Reise,et al.  Computerization and Adaptive Administration of the NEO PI-R , 2000, Assessment.

[10]  Bernard P. Veldkamp,et al.  Multidimensional adaptive testing with constraints on test content , 2002 .

[11]  Richard M. Luecht,et al.  Multidimensional Computerized Adaptive Testing in a Certification or Licensure Context , 1996 .

[12]  R. J. Mokken,et al.  Handbook of modern item response theory , 1997 .

[13]  Chockalingam Viswesvaran,et al.  Bandwidth-fidelity dilemma in personality measurement for personnel selection , 1996 .

[14]  Jakob B. Bjorner,et al.  Multidimensional Computerized Adaptive Testing of the EORTC QLQ-C30: Basic Developments and Evaluations , 2006, Quality of Life Research.

[15]  N. Waller,et al.  Using IRT to separate measurement bias from true group differences on homogeneous and heterogeneous scales: an illustration with the MMPI. , 2000, Psychological methods.

[16]  M. Ashton.  Personality and job performance: the importance of narrow traits , 1998 .

[17]  E. Muraki.  A Generalized Partial Credit Model: Application of an EM Algorithm , 1992 .

[18]  W. Gardner,et al.  Multidimensional Adaptive Testing for Mental Health Problems in Primary Care , 2002, Medical care.

[19]  Wen-Chung Wang,et al.  Implementation and Measurement Efficiency of Multidimensional Computerized Adaptive Testing , 2004 .

[20]  Cornelis A.W. Glas,et al.  A Steps Model to Analyze Partial Credit , 1997 .

[21]  M. Reckase.  Multidimensional Item Response Theory , 2009 .

[22]  Wim J. van der Linden,et al.  Multidimensional adaptive testing with Kullback-Leibler information item selection , 2009 .

[23]  Wen-Chung Wang,et al.  Factors Influencing the Mantel and Generalized Mantel-Haenszel Methods for the Assessment of Differential Item Functioning in Polytomous Items , 2004 .

[24]  D. Jackson,et al.  Narrow reasoning about the use of broad personality measures for personnel selection , 1999 .

[25]  Karin A. Orvis,et al.  A meta-analytic investigation of conscientiousness in the prediction of job performance: examining the intercorrelations and the incremental validity of narrow traits. , 2006, The Journal of applied psychology.

[26]  M. Ashton,et al.  Big Five Predictors of Academic Achievement , 2001 .

[27]  Greg L. Stewart,et al.  Trait bandwidth and stages of job performance : Assessing differential effects for conscientiousness and its subtraits , 1999 .

[28]  J. D. L. Torre.  Multidimensional Scoring of Abilities: The Ordered Polytomous Response Case: , 2008 .

[29]  S. Haley,et al.  Measurement precision and efficiency of multidimensional computer adaptive testing of physical functioning using the pediatric evaluation of disability inventory. , 2006, Archives of physical medicine and rehabilitation.