How response bias affects the factorial structure of personality self-reports.

BACKGROUND Various studies have shown that acquiescence can distort the factor structure of personality questionnaires based on the five-factor model.  In the present study, we analysed how acquiescence and social desirability affect the factor structure of a measure based on this personality model and a measure of aggression. METHOD We analysed the factor structures of both tests before and after removing both biases in a sample of 532 adolescents aged between 11 and 18 (M= 14.75, SD= 2.1). RESULTS The factor structure of both tests presented a worse fit to the expected model when response bias was not controlled, and the congruence indexes for the personality and aggression measures showed a moderate (from C= .948 to C= .872) or great (from C= .931 to C= .475) decrease, respectively. Furthermore, acquiescence was largely responsible for these effects, and social desirability effects were only shown on the aggression measure. CONCLUSIONS   Response bias, and especially acquiescence, should be controlled during the development of personality measures to avoid distorting them, especially with samples of people with a high level of acquiescence (for example, those with little education, the young or the elderly). Furthermore, the use of response bias loadings as a criterion for choosing the items minimizes those distortions.

[1]  L. Tucker.  A METHOD FOR SYNTHESIS OF FACTOR ANALYSIS STUDIES , 1951 .

[2]  S. Gosling,et al.  The developmental psychometrics of big five self-reports: acquiescence, factor structure, coherence, and differentiation from ages 10 to 20. , 2008, Journal of personality and social psychology.

[3]  U. Lorenzo-Seva,et al.  I-DAQ: a New Test to Assess Direct and Indirect Aggression Free of Response Bias , 2014, The Spanish Journal of Psychology.

[4]  U. Lorenzo-Seva,et al.  The effects of ageing on self-reported aggression measures are partly explained by response bias. , 2015, Psicothema.

[5]  U. Lorenzo-Seva,et al.  The impact of social desirability on psychometric measures of aggression. , 2012, Psicothema.

[6]  Jesús F. Salgado.  PERSONALIDAD Y DESEABILIDAD SOCIAL EN CONTEXTOS ORGANIZACIONALES: IMPLICACIONES PARA LA PRÁCTICA DE LA PSICOLOGÍA DEL TRABAJO Y LAS ORGANIZACIONES , 2005 .

[7]  U. Lorenzo-Seva,et al.  Development and validation of the Overall Personality Assessment Scale (OPERAS). , 2013, Psicothema.

[8]  U. Lorenzo-Seva,et al.  Acquiescent responding in partially balanced multidimensional scales. , 2009, The British journal of mathematical and statistical psychology.

[9]  U. Lorenzo-Seva,et al.  Development and Validation of the Psychological Maturity Assessment Scale (PSYMAS) , 2013 .

[10]  M. Morren,et al.  Validation of the Dutch version of the aggression questionnaire in adolescent male offenders , 2002 .

[11]  G. Becker.  The Buss–Perry Aggression Questionnaire: Some unfinished business , 2007 .

[12]  P. J. Ferrando,et al.  Acquiescence and social desirability as item response determinants: An IRT-based study with the Marlowe–Crowne and the EPQ Lie scales , 2010 .

[13]  C. Ross,et al.  Socially-desirable response and acquiescence in a cross-cultural survey of mental health. , 1984, Journal of health and social behavior.

[14]  Ingwer Borg,et al.  The measurement equivalence of Big Five factor markers for persons with different levels of education. , 2010, Journal of research in personality.

[15]  T. Judge,et al.  IN SUPPORT OF PERSONALITY ASSESSMENT IN ORGANIZATIONAL SETTINGS , 2007 .

[16]  P M Bentler,et al.  Identification of content and style: a two-dimensional interpretation of acquiescence. , 1971, Psychological bulletin.

[17]  J. Berge.  A Legitimate Case of Component Analysis of Ipsative Measures, and Partialling the Mean as an Alternative to Ipsatization , 1999 .

[18]  M. Stones,et al.  Social desirability in measures of subjective well-being: Age comparisons , 1988 .

[19]  Beatrice Rammstedt,et al.  The impact of acquiescence on the evaluation of personality structure. , 2013, Psychological assessment.

[20]  明子 野口.  社会的要求性(Social desirability)に関する研究 , 1964 .

[21]  Chockalingam Viswesvaran,et al.  Role of social desirability in personality testing for personnel selection: The red herring. , 1996 .

[22]  Simine Vazire,et al.  The self-report method. , 2007 .

[23]  G. Meisenberg,et al.  Are acquiescent and extreme response styles related to low intelligence and education , 2008 .

[24]  T. Salthouse,et al.  Influence of social desirability on age differences in self-reports of mood and personality. , 2011, Journal of personality.

[25]  Ronald R. Holden,et al.  Socially desirable responding in personality assessment: Not necessarily faking and not necessarily substance , 2010 .

[26]  J. Berge,et al.  Tucker's congruence coefficient as a meaningful index of factor similarity. , 2006 .

[27]  U. Lorenzo-Seva,et al.  How social desirability and acquiescence affect the age-personality relationship. , 2013, Psicothema.

[28]  Beatrice Rammstedt,et al.  Measurement equivalence of the Big Five: Shedding further light on potential causes of the educational bias , 2011 .

[29]  Kathryn M. Bell,et al.  Effects of Social Desirability on Students’ Self-Reporting of Partner Abuse Perpetration and Victimization , 2007, Violence and Victims.

[30]  U. Lorenzo-Seva,et al.  A General Factor-Analytic Procedure for Assessing Response Bias in Questionnaire Measures , 2009 .