The role of item extremity in the emergence of keying-related factors: an exploration with the life orientation test.

Keying-related factors in psychological scales are variously interpreted substantively or as products of violations of the assumptions underlying item keying. The present study investigated whether the extremity of the wording of items may contribute to the emergence of item-keying factors in a commonly used psychological scale. Respondents (N = 277) completed the Life Orientation Test (M. F. Scheier & C. S. Carver, 1985) in either its original or modified, more moderately worded form. Results indicate that the interaction of item extremity and item keying significantly affected subscale means and, more important, that the more moderately worded scale was substantially more unidimensional. Results are explained partially through the association of lesser and greater extremity with the tendency for some respondents to agree or disagree with items irrespective of keying direction. These results, although demonstrated in only 1 scale, have potential relevance to any scale comprising positive and negative items.

[1]  C. Carver,et al.  Optimism, coping, and health: assessment and implications of generalized outcome expectancies. , 2009, Health psychology : official journal of the Division of Health Psychology, American Psychological Association.

[2]  H. M. van der Ploeg,et al.  Positively and Negatively Worded Items in a Self-Report Measure of Dispositional Optimism , 1992 .

[3]  Albert Maydeu-Olivares,et al.  OPTIMISM AND PESSIMISM AS PARTIALLY INDEPENDENT CONSTRUCTS: RELATIONSHIP TO POSITIVE AND NEGATIVE AFFECTIVITY AND PSYCHOLOGICAL WELL-BEING , 1997 .

[4]  J. S. Tanaka.  "How Big Is Big Enough?": Sample Size and Goodness of Fit in Structural Equation Models with Latent Variables. , 1987 .

[5]  Herbert W. Marsh,et al.  Negative item bias in ratings scales for preadolescent children: a cognitive-developmental phenomenon , 1986 .

[6]  N. Cliff,et al.  An Ordinal I Scaling Method for Questionnaire and Other Ordinal I Data , 1988 .

[7]  C. Spielberger,et al.  Manual for the State-Trait Anxiety Inventory , 1970 .

[8]  John B. Carroll,et al.  The effect of difficulty and chance success on correlations between items or between tests , 1945 .

[9]  Leonard G. Rorer.  THE GREAT RESPONSE-STYLE MYTH. , 1965 .

[10]  M. Hyland,et al.  Exploratory factor analysis of the Just World Scale using British undergraduates , 1987 .

[11]  L. Thurstone.  Attitudes Can Be Measured , 1928, American Journal of Sociology.

[12]  Robert K. Gable,et al.  The Impact of Positive and Negative Item Stems on the Validity of a Computer Anxiety Scale , 1990 .

[13]  J. Jackson Barnette,et al.  Effects of Stem and Likert Response Option Reversals on Survey Internal Consistency: If You Feel the Need, There is a Better Alternative to Using those Negatively Worded Stems , 2000 .

[14]  Michael W. Bridges,et al.  Distinguishing optimism from neuroticism (and trait anxiety, self-mastery, and self-esteem): a reevaluation of the Life Orientation Test. , 1994, Journal of personality and social psychology.

[15]  H W Marsh,et al.  Positive and negative global self-esteem: a substantively meaningful distinction or artifactors? , 1996, Journal of personality and social psychology.

[16]  P. Creed,et al.  Multidimensional Properties of the Lot-R: Effects of Optimism and Pessimism on Career and Well-Being Related Variables in Adolescents , 2002 .

[17]  Paul Kline,et al.  An easy guide to factor analysis , 1993 .

[18]  Paul E. Spector,et al.  When Two Factors Don’t Reflect Two Constructs: How Item Characteristics Can Produce Artifactual Factors , 1997 .

[19]  E. Raufaste,et al.  Dimensionality of the Revised Life Orientation Test and the status of filler items , 2003 .

[20]  C. McBride-Chang,et al.  The Factor Structure of the Life Orientation Test , 1996 .

[21]  Lei Chang,et al.  Connotatively Consistent and Reversed Connotatively Inconsistent Items are Not Fully Equivalent: Generalizability Study , 1995 .

[22]  P. Creed,et al.  Cross-Cultural Equivalence of the Career Decision-Making Self-Efficacy Scale-Short Form: An Australian and South African Comparison , 2002 .

[23]  David Andrich,et al.  The Application of an Unfolding Model of the PIRT Type to the Measurement of Attitude , 1988 .

[24]  D. Watson,et al.  Toward a consensual structure of mood. , 1985, Psychological bulletin.

[25]  Ira H. Bernstein,et al.  Factoring items and factoring scales are different: Spurious evidence for multidimensionality due to item categorization. , 1989 .

[26]  J. S. Long,et al.  Testing Structural Equation Models , 1993 .

[27]  Jeri Benson,et al.  THE IMPACT OF ITEM PHRASING ON THE VALIDITY OF ATTITUDE SCALES FOR ELEMENTARY SCHOOL CHILDREN , 1985 .

[28]  John P. Meyer,et al.  Factor analysis of the Multiple Affect Adjective Check List: A separation of positive and negative affect. , 1986 .

[29]  E. Ziegel,et al.  Basic Principles of Structural Equation Modelling , 1996 .

[30]  真士 坂本,et al.  改訂版楽観性尺度（the revised Life Orientation Test）の日本語版の検討 , 2002 .

[31]  N. Endler,et al.  Self-reports of depression and state-trait anxiety: evidence for differential assessment. , 1992, Journal of personality and social psychology.

[32]  Duane T. Wegener,et al.  Evaluating the use of exploratory factor analysis in psychological research. , 1999 .

[33]  John W. Shrum,et al.  Influence of Instrument Characteristics on Student Responses in Attitude Assessment. , 1976 .

[34]  W. Zung.  A SELF-RATING DEPRESSION SCALE. , 1965, Archives of general psychiatry.

[35]  Chester A. Schriesheim,et al.  The Effect of Grouping or Randomizing Items on Leniency Response Bias , 1981 .

[36]  P M Bentler,et al.  Bootstrap-corrected ADF test statistics in covariance structure analysis. , 1994, The British journal of mathematical and statistical psychology.

[37]  N. Kijima,et al.  Factor structures of the Zung Self-Rating Depression Scale (SDS) for undergraduates. , 1998, Journal of clinical psychology.

[38]  H W Marsh,et al.  Is More Ever Too Much? The Number of Indicators per Factor in Confirmatory Factor Analysis. , 1998, Multivariate behavioral research.

[39]  Chester A. Schriesheim,et al.  An Exploratory and Confirmatory Factor-Analytic Investigation of Item Wording Effects on the Obtained Factor Structures of Survey Questionnaire Measures , 1995 .

[40]  F. Drasgow,et al.  A Revision of the Job Diagnostic Survey: Elimination of a Measurement Artifact , 1987 .

[41]  Karl G. Jöreskog,et al.  Lisrel 8: User's Reference Guide , 1997 .

[42]  R. Likert.  “Technique for the Measurement of Attitudes, A” , 2022, The SAGE Encyclopedia of Research Design.

[43]  D. Green,et al.  Measurement error masks bipolarity in affect ratings. , 1993, Journal of personality and social psychology.

[44]  R. Corwyn,et al.  The Factor Structure of Global Self-Esteem among Adolescents and Adults ☆ , 2000 .

[45]  Michael T. Brannick,et al.  Construction of a Job in General scale: A comparison of global, composite, and specific measures. , 1989 .

[46]  L. Cronbach.  Further Evidence on Response Sets and Test Design , 1950 .

[47]  Jeffrey W. Kusulas,et al.  Distinguishing optimism from pessimism : relations to fundamental dimensions of mood and personality , 1992 .

[48]  Julian C. L. Lai.  Differential Predictive Power of the Positively versus the Negatively Worded Items of the Life Orientation Test , 1994, Psychological reports.

[49]  S. Passik,et al.  Factor analysis of the Zung Self-Rating Depression Scale in a large ambulatory oncology sample. , 2000, Psychosomatics.

[50]  Julian C. L. Lai.  Relative predictive power of the optimism versus the pessimism index of a Chinese version of the Life Orientation Test , 1997 .

[51]  K. Ahlawat.  On the Negative Valence Items in Self-Report Measures , 1985 .

[52]  Neal Schmitt,et al.  Factors Defined by Negatively Keyed Items: The Result of Careless Respondents? , 1985 .

[53]  J. V. Couch.  Another Psychometric Evaluation of the Just World Scale , 1998 .

[54]  Chester A. Schriesheim,et al.  Controlling Acquiescence Response Bias by Item Reversals: The Effect on Questionnaire Validity , 1981 .

[55]  P. Bentler,et al.  Significance Tests and Goodness of Fit in the Analysis of Covariance Structures , 1980 .

[56]  M. Maes,et al.  Effects of affective-semantic mode of item presentation in balanced self-report scales: biased construct validity of the Zung Self-rating Depression Scale , 1996, Psychological Medicine.