When Two Factors Don’t Reflect Two Constructs: How Item Characteristics Can Produce Artifactual Factors

Factor analyses of scales that contain items written in opposite directions sometimes show two factors, each of which contains items written in only one direction. Such item direction factors have been found in scales of affect and personality that have been used in organizational research. We discuss how patterns of subject responses to items that vary in direction and extremity can produce an arttfactual two factor structure in the absence of multiple constructs. Response patterns are demonstrated in Study 1 with job satisfaction data gathered from employed subjects. The production of two factors is illustrated in Study 2 with simulated data based on item response characteristic equations.

[1]  Asghar Iran-Nejad,et al.  The relationship in experience between various types of affect , 1986 .

[2]  F. Drasgow,et al.  A Revision of the Job Diagnostic Survey: Elimination of a Measurement Artifact , 1987 .

[3]  M. Aldenderfer,et al.  Cluster Analysis. Sage University Paper Series On Quantitative Applications in the Social Sciences 07-044 , 1984 .

[4]  J. Hackman,et al.  Development of the Job Diagnostic Survey , 1975 .

[5]  David Andrich,et al.  The Application of an Unfolding Model of the PIRT Type to the Measurement of Attitude , 1988 .

[6]  Henk A. L. Kiers,et al.  Why Factor Analysis Often is the Incorrect Model for Analyzing Bipolar Concepts, and What Model to Use Instead , 1994 .

[7]  C. Carver,et al.  Optimism, coping, and health: assessment and implications of generalized outcome expectancies. , 2009, Health psychology : official journal of the Division of Health Psychology, American Psychological Association.

[8]  D. Watson,et al.  Positive and negative affectivity and their relation to anxiety and depressive disorders. , 1988, Journal of abnormal psychology.

[9]  D. Watson,et al.  Toward a consensual structure of mood. , 1985, Psychological bulletin.

[10]  N. Cliff,et al.  An Ordinal I Scaling Method for Questionnaire and Other Ordinal I Data , 1988 .

[11]  Chester A. Schriesheim,et al.  The Effect of Negation and Polar Opposite Item Reversals on Questionnaire Reliability and Validity: An Experimental Investigation , 1991 .

[12]  J. George,et al.  The role of negative affectivity in understanding relations between self-reports of stressors and strains: a comment on the applied psychology literature. , 1993, The Journal of applied psychology.

[13]  Robert K. Gable,et al.  The Impact of Positive and Negative Item Stems on the Validity of a Computer Anxiety Scale , 1990 .

[14]  Paul E. Spector Summated Rating Scale Construction: An Introduction , 1992 .

[15]  Chester A. Schriesheim,et al.  Controlling Acquiescence Response Bias by Item Reversals: The Effect on Questionnaire Validity , 1981 .

[16]  D. Watson,et al.  Development and validation of brief measures of positive and negative affect: the PANAS scales. , 1988, Journal of personality and social psychology.

[17]  Carl E. Ferguson,et al.  Role conflict and role ambiguity: Do the scales measure these two constructs? , 1989 .

[18]  Neal Schmitt,et al.  Factors Defined by Negatively Keyed Items: The Result of Careless Respondents? , 1985 .

[19]  A. Beck,et al.  An inventory for measuring depression. , 1961, Archives of general psychiatry.

[20]  Jennifer M. George,et al.  Time Structure and Purpose as a Mediator of Work‐Life Linkages , 1991 .

[21]  S. Lirtzman,et al.  Role Conflict and Ambiguity in Complex Organizations. , 1970 .

[22]  Arthur P. Brief,et al.  Job Attitude Organization: An Exploratory Study1 , 1989 .

[23]  Michael T. Brannick,et al.  Construction of a Job in General scale: A comparison of global, composite, and specific measures. , 1989 .

[24]  K. Jöreskog,et al.  Analysis of linear structural relationships by maximum likelihood and least squares methods , 1983 .

[25]  Jeffrey W. Kusulas,et al.  Distinguishing optimism from pessimism : relations to fundamental dimensions of mood and personality , 1992 .

[26]  John Cordery,et al.  Responses to the original and revised Job Diagnostic Survey: Is education a factor in responses to negatively worded items? , 1993 .

[27]  John P. Meyer,et al.  Testing the "Side-Bet Theory" of Organizational Commitment: Some Methodological Considerations , 1984 .

[28]  John P. Meyer,et al.  Factor analysis of the Multiple Affect Adjective Check List: A separation of positive and negative affect. , 1986 .

[29]  L. Covi,et al.  The Hopkins Symptom Checklist (HSCL): a self-report symptom inventory. , 1974, Behavioral science.

[30]  Paul E. Spector Development of the Work Locus of Control Scale , 1988 .

[31]  S. Dunn Attitudes Can Be Measured , 1988 .

[32]  Larry J. Williams,et al.  A Confirmatory Factor Analysis Examination of Reverse Coding Effects in Meyer and Allen's Affective and Continuance Commitment Scales , 1996 .

[33]  C. Spielberger,et al.  Manual for the State-Trait Anxiety Inventory , 1970 .