The consequences of pairing questions: context effects in personality measurement.

The effect of context on responses to questions has been a prominent focus in social and political survey research. However, little investigation of context effects has been done for the measurement of psychological constructs. A measure of anger experience and expression in development uses vignettes describing interpersonal situations that provoke varying degrees of anger and require respondents to indicate their affective and/or expressive response to the situation. In this study, the consequences of pairing the two questions for each vignette are investigated. Pairing the anger-experience and likelihood-of-expression questions changes the item's context. Item response theory analysis similar to that used to detect differential item functioning was performed. For some of the items, responding to a single or paired question affected the extremity of responses. The findings are discussed in terms of their implications for personality measurement.

[1]  S. Stouffer,et al.  Measurement and Prediction , 1954 .

[2]  H. Wainer,et al.  Differential Item Functioning. , 1994 .

[3]  R. P. McDonald,et al.  Test Theory: A Unified Treatment , 1999 .

[4]  F. Samejima.  Estimation of latent ability using a response pattern of graded scores , 1968 .

[5]  David Thissen,et al.  Data analysis using item response theory. , 1988 .

[6]  E. S. Knowles,et al.  Item context effects on personality scales: Measuring changes the measure. , 1988 .

[7]  John W. Tukey,et al.  Controlling Error in Multiple Comparisons, with Examples from State-to-State Differences in Educational Achievement , 1999 .

[8]  Roger Tourangeau,et al.  Cognition and Survey Research , 2000, Technometrics.

[9]  N. Schwarz,et al.  Context Effects in Social and Psychological Research , 1992 .

[10]  S. Fiske,et al.  The Handbook of Social Psychology , 1935 .

[11]  Chet Robie,et al.  Modeling faking good on personality items: An item-level analysis. , 1999 .

[12]  Howard Wainer,et al.  Use of item response theory in the study of group differences in trace lines. , 1988 .

[13]  Norbert Schwarz,et al.  Assimilation and Contrast Effects in Part-Whole Question Sequences: A Conversational Logic Analysis , 1991 .

[14]  Walter W. Cook,et al.  Proposed hostility and Pharisaic-virtue scales for the MMPI. , 1954 .

[15]  P. Bentler,et al.  Cutoff criteria for fit indexes in covariance structure analysis : Conventional criteria versus new alternatives , 1999 .

[16]  L. Steinberg.  Context and serial-order effects in personality measurement : limits on the generality of measuring changes the measure , 1994 .

[17]  L. Steinberg,et al.  Assessing the MMPI-based Cook-Medley Hostility Scale: the implications of dimensionality. , 1996, Journal of personality and social psychology.

[18]  Karl G. Jöreskog,et al.  Lisrel 8: User's Reference Guide , 1997 .

[19]  N. Schwarz.  Self-reports: How the questions shape the answers. , 1999 .

[20]  M. R. Novick,et al.  Statistical Theories of Mental Test Scores. , 1971 .

[21]  A. Ryan,et al.  Effects of Item Context Specificity on the Measurement Equivalence of a Personality Inventory , 2000 .

[22]  Howard Wainer,et al.  Detection of differential item functioning using the parameters of item response models. , 1993 .

[23]  Y. Benjamini,et al.  Controlling the false discovery rate: a practical and powerful approach to multiple testing , 1995 .

[24]  W. S. Rholes,et al.  Category accessibility and impression formation , 1977 .

[25]  E. S. Knowles,et al.  Measurement-induced improvement in anxiety: mean shifts with repeated assessment. , 1996, Journal of personality and social psychology.

[26]  Roger Tourangeau,et al.  MEASURING HAPPINESS IN SURVEYS: A TEST OF THE SUBTRACTION HYPOTHESIS , 1991 .

[27]  E. S. Knowles,et al.  Reliability shifts in measurement reactivity: driven by content engagement or self-engagement? , 1996, Journal of personality and social psychology.

[28]  R. Tourangeau,et al.  Cognitive Processes Underlying Context Effects in Attitude Measurement , 1988 .