A generalizability analysis of score consistency for the Balanced Inventory of Desirable Responding.

Our goal in this investigation was to evaluate the reliability of scores from the Balanced Inventory of Desirable Responding (BIDR) more comprehensively than in prior research using a generalizability-theory framework based on both dichotomous and polytomous scoring of items. Generalizability coefficients accounting for specific-factor, transient, and random-response error ranged from .64 to .75 for the BIDR's Self-Deception Enhancement (SDE) and Impression Management (IM) subscale scores, and these values were systematically lower than corresponding alpha (.66 to .83) and 1-week test-retest (.78 to .86) coefficients. Polytomous scoring provided higher reliability than dichotomous scoring on nearly all indexes reported. Random-response (8%-17%) and specific factor error (11%-17%) exceeded transient error (3%-6%) for both subscales and scoring methods. Doubling the number of items on a single occasion provided greater improvements in generalizability (.76-.83) than aggregating scores across 2 administrations (.72-.81). Both scoring methods provided reasonably high indexes of consistency (φ coefficients≥.91) at cut scores on the IM scale for detecting faked responses when all sources of error were taken into account. Implications of these results for common uses of the BIDR are discussed.

[1]  D. Paulhus.  Measurement and control of response bias. , 1991 .

[2]  Christopher L. Martin,et al.  Socially Desirable Responding in Computerized Questionnaires: When Questionnaire Purpose Matters More Than the Mode1 , 2002 .

[3]  D. Jackson,et al.  RESPONSE STYLES ON THE MMPI: COMPARISON OF CLINICAL AND NORMAL SAMPLES1 , 1961 .

[4]  D. D. Bickerstaff,et al.  Computerized adaptive testing , 2015 .

[5]  Daryl G. Kroner,et al.  Balanced inventory of desirable responding: Factor structure, reliability, and validity with an offender sample , 1996 .

[6]  Jessica Bagger,et al.  The Balanced Inventory of Desirable Responding (BIDR) , 2007 .

[7]  D. Jackson.  Personality research form manual , 1974 .

[8]  Michael T. Kane,et al.  The Precision of Measurements , 1996 .

[9]  S. Hathaway,et al.  MMPI-2 : Minnesota Multiphasic Personality Inventory-2 : manual for administration and scoring , 1989 .

[10]  Ronald R. Holden,et al.  Comparisons among the Holden Psychological Screening Inventory (HPSI), the Brief Symptom Inventory (BSI), and the Balanced Inventory of Desirable Responding (BIDR) , 2000, Assessment.

[11]  R. Holden,et al.  A model of personality test item response dissimulation , 1992 .

[12]  P. Gendreau,et al.  Evaluating response set styles on the MMPI with prisoners: Faking good adjustment and maladjustment. , 1973 .

[13]  A. Hess,et al.  The fakability of subtle and obvious measures of aggression by male prisoners. , 1984, Journal of personality assessment.

[14]  G Becker,et al.  How important is transient error in estimating reliability? Going beyond simulation studies. , 2000, Psychological methods.

[15]  E. Keogh,et al.  Self-Deceptive Enhancement and Impression Management correlates of EPQ-R dimensions. , 1998, The Journal of psychology.

[16]  R. Cattell,et al.  Extension of meaning of objective test personality factors: especially into anxiety, neuroticism, questionaire and physical factors. , 1959, The Journal of general psychology.

[17]  Paul Rosenfeld,et al.  Impression management, social desirability, and computer administration of attitude questionnaires: Does the computer make a difference? , 1992 .

[18]  Huy Le,et al.  Beyond alpha: an empirical examination of the effects of different sources of measurement error on reliability estimates for measures of individual differences constructs. , 2003, Psychological methods.

[19]  Walter P. Vispoel,et al.  Response Biases and Their Relation to Sex Differences in Multiple Domains of Self-Concept , 2000 .

[20]  D. Marlowe,et al.  A new scale of social desirability independent of psychopathology. , 1960, Journal of consulting psychology.

[21]  Robert R. Hirschfeld,et al.  Work Alienation as an Individual‐Difference Construct for Predicting Workplace Adjustment: A Test in Two Samples1 , 2000 .

[22]  Michael T. Kane,et al.  AN INDEX OF DEPENDABILITY FOR MASTERY TESTS , 1977 .

[23]  Y. Ben-Porath,et al.  Comparability and validity of computerized adaptive testing with the MMPI-2. , 1995, Journal of personality assessment.

[24]  H. Wainer.  Computerized adaptive testing: A primer, 2nd ed. , 2000 .

[25]  Tianyou Wang,et al.  Computerized Adaptive and Fixed‐Item Testing of Music Listening Skill: A Comparison of Efficiency, Precision, and Concurrent Validity , 1997 .

[26]  Y. Ben-Porath,et al.  Comparability of computerized adaptive and conventional testing with the MMPI-2. , 1991, Journal of personality assessment.

[27]  A. L. Edwards,et al.  Response sets and factor loadings on sixty-one personality scales. , 1962 .

[28]  D. Paulhus,et al.  Effects of Self-Presentation Strategies on Personality Profiles and their Structure , 1995 .

[29]  Edward W. Miles,et al.  A quasi-experimental assessment of the effect of computerizing noncognitive paper-and-pencil measurements: A test of measurement equivalence. , 1995 .

[30]  John E. Hunter,et al.  Theory Testing and Measurement Error. , 1999 .

[31]  F. Zaldívar,et al.  Evaluation of alcohol and other drug use and the influence of social desirability: Direct and camouflaged measures. , 2009 .

[32]  R. Krueger,et al.  Handbook of research methods in personality psychology , 2007 .

[33]  Donald B. Rubin,et al.  The Dependability of Behavioral Measurements: Theory of Generalizability for Scores and Profiles. , 1974 .

[34]  L. McFarland.  Warning Against Faking on a Personality Test: Effects on Applicant Reactions and Personality Test Scores , 2003 .

[35]  Jochen Musch,et al.  Comparing Continuous and Dichotomous Scoring of the Balanced Inventory of Desirable Responding , 2002, Journal of personality assessment.

[36]  G. Walters.  Assessing dissimulation and denial on the MMPI in a sample of maximum security, male inmates. , 1988, Journal of personality assessment.

[37]  G. Bonanno,et al.  Rasch Modeling of the Self-Deception Scale of the Balanced Inventory of Desirable Responding , 2009 .

[38]  A. L. Edwards.  The social desirability variable in personality assessment and research , 1958 .

[39]  Simine Vazire,et al.  The self-report method. , 2007 .

[40]  J. S. Wiggins,et al.  Convergences Among Stylistic Response Measures from Objective Personality Tests , 1964 .

[41]  R. Krueger,et al.  Comprar Handbook of research methods in personality psychology | Robert F Krueger | 9781606236123 | Guilford Press , 2010 .

[42]  David E. Wiley,et al.  Socially Desirable Responding: The Evolution of a Construct , 2001 .

[43]  D. Schretlen,et al.  A psychological test battery to detect prison inmates who fake insanity or mental retardation , 1990 .

[44]  L. Clark,et al.  Validation of a computerized adaptive version of the Schedule for Nonadaptive and Adaptive Personality (SNAP). , 2005, Psychological assessment.

[45]  Delroy L. Paulhus,et al.  Balanced Inventory of Desirable Responding , 2012 .