Individual response spread in self-report scales: personality correlations and consequences

Abstract We consider the phenomenon of individual differences in the use of questionnaire scales and examine some of its consequences. Results from two illustrative studies on farmers and consultant doctors are used to demonstrate that individual standard deviation of response option usage is a consistent trait which is significantly correlated with the personality dimension of conscientiousness. A mathematical model of individual response spread is also devised and it is shown that significant spurious correlations between responses to independent items can arise. This model is extended by estimating individual response thresholds from our two illustrative data sets; numerical simulation using these thresholds confirms the occurrence of spurious correlations. The distribution of correlation coefficients r is also very different from the standard form used for estimating levels of significance. There are widespread consequences of these observations for standard multivariate methods of analysing self-report data.

[1]  J. Cheek.  Aggregation, moderator variables, and the validity of personality tests: A peer-rating study. , 1982 .

[2]  Gordon W. Allport,et al.  Pattern and growth in personality , 1961 .

[3]  Karl G. Jöreskog,et al.  New developments in LISREL: analysis of ordinal variables using polychoric correlations and weighted least squares , 1990 .

[4]  K. Grønhaug,et al.  The Impact of Response Styles in Surveys: A Simulation Study , 1992 .

[5]  R. J. Foster,et al.  A Factor Analytic Study of Acquiescent and Extreme Response Set1 , 1963 .

[6]  J. Rost,et al.  Applications of Latent Trait and Latent Class Models in the Social Sciences , 1998 .

[7]  M. Snyder.  Self-monitoring of expressive behavior. , 1974 .

[8]  I. A. Berg,et al.  Personality and Group Differences in Extreme Response Sets , 1953 .

[9]  D. Bartholomew.  Latent Variable Models And Factor Analysis , 1987 .

[10]  D. Jackson,et al.  Idiographic measurement strategies for personality and prediction: Some unredeemed promissory notes , 1985 .

[11]  R. Hambleton,et al.  Handbook of Modern Item Response Theory , 1997 .

[12]  Brim Og,et al.  Individual and situational differences in desire for certainty. , 1957 .

[13]  N. Lewis,et al.  Anxiety and Extreme Response Preferences , 1955 .

[14]  W. Mischel.  Personality and Assessment , 1996 .

[15]  O. J. Harvey,et al.  Effects of personality and own stand on judgment and production of statements about a central issue , 1965 .

[16]  R. Norman.  Extreme response tendency as a function of emotional adjustment and stimulus ambiguity. , 1969, Journal of consulting and clinical psychology.

[17]  D. Watson,et al.  Health complaints, stress, and distress: exploring the central role of negative affectivity. , 1989, Psychological review.

[18]  R. Mogar.  Three versions of the F scale and performance on the semanantic differential. , 1960, Journal of abnormal and social psychology.

[19]  M. Zax,et al.  EXTREME RESPONSE TENDENCY AS A FUNCTION OF EMOTIONAL ADJUSTMENT. , 1964, Journal of abnormal psychology.

[20]  William Schneiderman.  A personality dimension of consistency versus variability without the use of self-reports or ratings. , 1980 .

[21]  S. Jackson,et al.  Maslach burnout inventory manual , 1996 .

[22]  Steven P. Reise,et al.  Traitedness and the assessment of response pattern scalability , 1993 .

[23]  I. A. Berg.  The Reliability of Extreme Position Response Sets in Two Tests , 1953 .

[24]  R. G. Turner.  Consistency, self-consciousness, and the predictive validity of typical and maximal personality measures , 1978 .

[25]  P. Costa,et al.  Four ways five factors are basic , 1992 .

[26]  J. Brengelmann.  Abnormal and personality correlates of certainty. , 1959, The Journal of mental science.

[27]  M. Scheier,et al.  Public and private self-consciousness: Assessment and theory. , 1975 .

[28]  Paul E. Spector.  Development of the Work Locus of Control Scale , 1988 .

[29]  Pt Jr Costa.  Revised NEO Personality Inventory and NEO Five-Factor Inventory , 1992 .

[30]  L. Cronbach.  Response Sets and Test Validity , 1946 .

[31]  D W FISKE,et al.  Intra-individual response variability. , 1955, Psychological bulletin.

[32]  J. Brengelmann.  Extreme response set, drive level and abnormality in questionnaire rigidity. , 1960, The Journal of mental science.

[33]  S. Hershberger,et al.  Traits and metatraits: their reliability, stability, and shared genetic influence. , 1995, Journal of personality and social psychology.

[34]  D. Jackson.  The Process of Responding in Personality Assessment , 1986 .

[35]  G. Āllport.  Personality: A Psychological Interpretation , 1938 .

[36]  Arnold H. Buss,et al.  Self-consciousness, self-report of aggressiveness, and aggression , 1978 .

[37]  L L THURSTONE,et al.  The measurement of values. , 1960, Psychological review.

[38]  Extremity of Judgment and Personality Variables: Two Empirical Investigations , 1983 .

[39]  E. Greenleaf,et al.  MEASURING EXTREME RESPONSE STYLE , 1992 .

[40]  S. Paunonen.  Trait Relevance and the Differential Predictability of Behavior , 1988 .

[41]  J. Rost.  Logistic Mixture Models , 1997 .

[42]  S. O. Hesterly,et al.  Deviant response patterns as a function of chronlogical age. , 1963, Journal of consulting psychology.

[43]  J. S. Wiggins,et al.  Personality assessment via questionnaires : current issues in theory and measurement , 1986 .

[44]  Ulf Olsson,et al.  Maximum likelihood estimation of the polychoric correlation coefficient , 1979 .

[45]  I. Deary,et al.  Models of job-related stress and personal achievement among consultant doctors. , 1996, British journal of psychology.

[46]  L. Havlicek,et al.  Effect of the violation of assumptions upon significance levels of the Pearson r. , 1977 .

[47]  Mark Snyder,et al.  "To Carve Nature at Its Joints": On the Existence of Discrete Classes in Personality , 1985 .

[48]  J. Cummings.  VARIABILITY OF JUDGEMENT AND ‘STEADINESS’ OF CHARACTER , 1939 .

[49]  D. Jackson,et al.  An Evaluation of a Threshold Theory for Personality Assessment , 1977 .

[50]  Daryl J. Bem,et al.  ON PREDICTING SOME OF THE PEOPLE SOME OF THE TIME: THE SEARCH FOR CROSS-SITUATIONAL CONSISTENCIES IN BEHAVIOR , 1974 .

[51]  J. Das,et al.  Some correlates of extreme response set. , 1969, Acta psychologica.

[52]  L. R. Goldberg,et al.  The prediction of semantic consistency in self-descriptions: characteristics of persons and of terms that affect the consistency of responses to synonym and antonym pairs. , 1985, Journal of personality and social psychology.

[53]  B. Moore,et al.  Sources of behavioral consistency , 1981 .

[54]  Traits and metatraits: their reliability, stability, and shared genetic influence. , 1995 .

[55]  R. Fazio,et al.  On the automatic activation of attitudes. , 1986, Journal of personality and social psychology.

[56]  E. Borgatta,et al.  Personality Concomitants of Extreme Response Set (ERS) , 1961 .

[57]  M. Zax,et al.  Relationship of age, sex, and intelligence level to extreme response style. , 1965, Journal of personality and social psychology.

[58]  Auke Tellegen,et al.  The Analysis of Consistency in Personality Assessment , 1988 .

[59]  S. McFarland,et al.  Age, education, and the internal consistency of personality scales. , 1985 .

[60]  L. Cronbach.  Further Evidence on Response Sets and Test Design , 1950 .

[61]  R. Koestner,et al.  To predict some of the people some of the time: A reexamination of the moderator variable approach in personality theory. , 1988 .

[62]  Fritz Drasgow,et al.  Item response theory : application to psychological measurement , 1983 .

[63]  E. Greenleaf.  Improving Rating Scale Measures by Detecting and Correcting Bias Components in Some Response Styles , 1992 .

[64]  M. I. Soueif.  Extreme response sets as a measure of intolerance of ambiguity. , 1958, British journal of psychology.

[65]  N. Endler,et al.  Multidimensional assessment of coping: a critical evaluation. , 1990, Journal of personality and social psychology.

[66]  D. Jackson,et al.  Prediction Models of Personality Item Responding. , 1989, Multivariate behavioral research.

[67]  P. Warr,et al.  Personality, involvement and extremity of judgement. , 1970, The British journal of social and clinical psychology.

[68]  E. Rundquist.  Response Sets: a Note on Consistency in Taking Extreme Positions , 1950 .

[69]  J. Guilford.  The difficulty of a test and its factor composition , 1941 .