Modeling faking good on personality items: An item-level analysis.

Research has consistently demonstrated that personality inventories can be faked; however. there is disagreement about what effect faking has on the measurement properties of tests. This research examines the effects of experimentally induced faking on item-level measurement using polytomous item response theory. Military recruits were instructed to complete a personality inventory under 1 of 3 conditions: answer honestly, fake good, or fake good with coaching. A graded response model (F. Samejima, 1969) was fit to items from 3 personality scales. Although there was a large difference in latent personality trait scores because of faking, there were few differences in the functioning of items across conditions. Results of confirmatory factor analyses suggest that faking leads to an increase in common variance that was unrelated to substantive construct variance. Implications for modeling and detection of faking are discussed.

[1]  R. Hambleton,et al.  Item Response Theory , 1984, The History of Educational Measurement.

[2]  L. Hough.  The 'Big Five' Personality Variables--Construct Confusion: Description Versus Prediction , 1992 .

[3]  Keith F Widaman,et al.  Confirmatory factor analysis and item response theory: two approaches for exploring measurement invariance. , 1993, Psychological bulletin.

[4]  Kenneth A. Bollen,et al.  Structural Equations with Latent Variables , 1989 .

[5]  Chockalingam Viswesvaran,et al.  Role of social desirability in personality testing for personnel selection: The red herring. , 1996 .

[6]  H. Levene.  Robust tests for equality of variances , 1961 .

[7]  Ann Marie Ryan,et al.  The Big Five in Personnel Selection: Factor Structure in Applicant and Nonapplicant Populations , 1993 .

[8]  W. T. Norman,et al.  Toward an adequate taxonomy of personality attributes: replicated factors structure in peer nomination personality ratings. , 1963, Journal of abnormal and social psychology.

[9]  Donald B. Rubin,et al.  Measuring the Appropriateness of Multiple-Choice Test Scores , 1979 .

[10]  Michael V. Levine,et al.  Optimal appropriateness measurement , 1988 .

[11]  L. Hough.  Effects of Intentional Distortion in Personality Measurement and evaluation of Suggested Palliatives , 1998 .

[12]  Wim J. van der Linden,et al.  IRT-Based Internal Measures of Differential Functioning of Items and Tests , 1995 .

[13]  R. Hambleton,et al.  Item Response Theory: Principles and Applications , 1984 .

[14]  N. Christiansen,et al.  CORRECTING THE 16PF FOR FAKING: EFFECTS ON CRITERION-RELATED VALIDITY AND INDIVIDUAL HIRING DECISIONS , 1994 .

[15]  Bernhard Wilpert,et al.  Applied psychology : an international review , 1989 .

[16]  Wim Jansen,et al.  Multilog: Multiple, Categorical Item Analysis and Test Scoring Using Item Response Theory , 1994 .

[17]  Newell K. Eaton,et al.  Criterion-related validities of personality constructs and the effect of response distortion on those validities , 1990 .

[18]  W. Hoeffding,et al.  Contributions to Probability and Statistics: Essays in Honor of Harold Hotelling , 1961 .

[19]  R. Kanfer,et al.  Equivalence of psychological measurement in heterogeneous populations. , 1985, The Journal of applied psychology.

[20]  Paul T. Costa,et al.  Work and personality : Use of the NEO-PI-R in industrial/organisational psychology , 1996 .

[21]  Murray R. Barrick,et al.  Effects of impression management and self-deception on the predictive validity of personality constructs. , 1996, The Journal of applied psychology.

[22]  J. S. Tanaka,et al.  A fit index for covariance structure models under arbitrary GLS estimation , 1985 .

[23]  Niels G. Waller,et al.  Exploring nonlinear models in personality assessment: Development and preliminary validation of a negative emotionality scale. , 1996 .

[24]  Murray R. Barrick,et al.  THE BIG FIVE PERSONALITY DIMENSIONS AND JOB PERFORMANCE: A META-ANALYSIS , 1991 .

[25]  Joseph G. Rosse,et al.  The impact of response distortion on preemployment personality testing and hiring decisions. , 1998 .

[26]  L. Shepard,et al.  Methods for Identifying Biased Test Items , 1994 .

[27]  R. I. Dawson,et al.  Response set and the prediction of clerical job performance. , 1961 .

[28]  M. Browne,et al.  Alternative Ways of Assessing Model Fit , 1992 .

[29]  Fritz Drasgow,et al.  Detecting Faking on a Personality Instrument Using Appropriateness Measurement , 1996 .

[30]  J. L. Warner,et al.  Inflation bias in self-assessment examinations: Implications for valid employee selection. , 1984 .

[31]  F. Baker.  Equating Tests Under the Graded Response Model , 1992 .

[32]  J. Ware,et al.  Applications of Statistics , 1978 .

[33]  Fritz Drasgow,et al.  Fitting Polytomous Item Response Theory Models to Multiple-Choice Tests , 1995 .

[34]  Karl G. Jöreskog,et al.  LISREL 7: A guide to the program and applications , 1988 .

[35]  F. Samejima.  Estimation of latent ability using a response pattern of graded scores , 1968 .

[36]  R Hogan,et al.  A socioanalytic theory of personality. , 1983, Nebraska Symposium on Motivation. Nebraska Symposium on Motivation.

[37]  Fritz Drasgow,et al.  Optimal Identification of Mismeasured Individuals. , 1996 .

[38]  David J. Woodruff,et al.  Statistical Inference for Coefficient Alpha , 1987 .

[39]  R. Holden,et al.  A model of personality test item response dissimulation. , 1992 .

[40]  Gregory L. Candell,et al.  An Iterative Procedure for Linking Metrics and Assessing Item Bias in Item Response Theory , 1988 .

[41]  Chockalingam Viswesvaran,et al.  Meta-Analyses of Fakability Estimates: Implications for Personality Measurement , 1999 .

[42]  Leonard V. Gordon,et al.  Fakability of a forced-choice personality test under realistic high school employment conditions. , 1956 .

[43]  Michael A. McDaniel,et al.  THE VALIDITY OF NON-COGNITIVE MEASURES DECAYS WHEN APPLICANTS FAKE. , 1996 .

[44]  G. Lautenschlager.  ALPHATST: Testing for Differences in Values of Coefficient Alpha , 1989 .

[45]  D. Paulhus.  Two-component models of socially desirable responding. , 1984 .

[46]  W. Turnbull,et al.  Invalidity of validity scales: The case of the MMPI. , 1975 .

[47]  L. Wheeler,et al.  Review of personality and social psychology , 1980 .

[48]  David Thissen,et al.  Data analysis using item response theory. , 1988 .