Self-Report Measures: An Overview of Concerns and Limitations of Questionnaire Use in Occupational Stress Research

As in the case with many domains of organizational behaviuor, occupational stress research has for many years been characterised by the use of self-report methodologies, in particular the written quetionnaire, as the primary means of data collection. Reliance on self-report for the measurement of both dependent and independent variables raises concern about the validity of causal conclusions for a range of reasons, including systematic response distortions, method variance and monomethod bias, and the psychometric properties of quetionnaire scales.

[1]  Paul E. Spector.  Method variance as an artifact in self-reported affect and perceptions at work: Myth or significant problem? , 1987 .

[2]  Allen L. Edwards,et al.  The Relationship Between the Judged Desirability of a Trait and the Probability That the Trait Will Be Endorsed , 1953 .

[3]  George S. Howard,et al.  Why do people say nasty things about self-reports? , 1994 .

[4]  M. Duffy,et al.  The organization man. , 1994, Time.

[5]  R. H. Moorman,et al.  A meta‐analytic review and empirical test of the potential confounding effects of social desirability response sets in organizational behaviour research , 1992 .

[6]  Vicki L. Goodwin,et al.  Cognitive-affective stress propensity: a field study , 1999 .

[7]  R. Kessler.  The interplay of research design strategies and data analysis procedures in evaluating the effects of stress on health. , 1995 .

[8]  Fred Luthans,et al.  Social Desirability Response Effects: Three Alternative Models , 1983 .

[9]  A. Furnham,et al.  The good, the bad and the mad: Response bias in self-report measures , 1982 .

[10]  Susy Macqueen,et al.  Validity , 1973, Just Algorithms.

[11]  Neal Schmitt,et al.  Factors Defined by Negatively Keyed Items: The Result of Careless Respondents? , 1985 .

[12]  Katharine R. Parkes,et al.  The effects of objective workload on cognitive performance in a field setting: A two‐period cross‐over trial , 1995 .

[13]  D. Marlowe,et al.  A new scale of social desirability independent of psychopathology. , 1960, Journal of consulting psychology.

[14]  K. Parkes.  Coping, negative affectivity, and the work environment: additive and interactive predictors of mental health. , 1990, The Journal of applied psychology.

[15]  Harry C. Triandis,et al.  Effects of Culture and Response Format on Extreme Response Style , 1989 .

[16]  Frank J. Landy,et al.  Stamp collecting versus science: Validation as hypothesis testing. , 1986 .

[17]  G. Marín,et al.  Extreme Response Style and Acquiescence among Hispanics , 1992 .

[18]  D. Watson,et al.  Health complaints, stress, and distress: exploring the central role of negative affectivity. , 1989, Psychological review.

[19]  R. Bornstein,et al.  Face Validity and Fakability of Objective and Projective Measures of Dependency , 1994 .

[20]  Robert Hogan,et al.  The construct validity of social desirability. , 1990 .

[21]  M. Roberton,et al.  Causes, coping and consequences of stress at work , 1995 .

[22]  Cary L. Cooper,et al.  Stress and health : issues in research methodology , 1988 .

[23]  John P. Robinson,et al.  Measures Of Personality And Social Psychological Attitudes , 1991 .

[24]  Allen I. Huffcutt,et al.  Psychometric properties of multisource performance ratings: A meta-analysis of subordinate, supervisor, peer, and self-ratings. , 1997 .

[25]  S. Oakland,et al.  Measuring Coping: A Review and Critique , 1996 .

[26]  Mary L. Tenopyr,et al.  Artifactual reliability of forced-choice scales. , 1988 .

[27]  Dave Bartram,et al.  The relationship between ipsatized and normative measures of personality , 1996 .

[28]  John Schaubroeck,et al.  A meta-analysis of self-supervisor, self-peer, and peer-supervisor ratings. , 1988 .

[29]  Paul E. Spector,et al.  Negative affectivity as the underlying cause of correlations between stressors and strains. , 1991, The Journal of applied psychology.

[30]  M J Burke,et al.  Should negative affectivity remain an unmeasured variable in the study of job stress? , 1988, The Journal of applied psychology.

[31]  Tom Cox,et al.  Measurement of the subjective work environment , 1994 .

[32]  D. Marlowe,et al.  The Approval Motive: Studies in Evaluative Dependence , 1980 .

[33]  K. Parkes.  Social desirability, defensiveness and self-report psychiatric inventory scores , 1980, Psychological Medicine.

[34]  M. Frese,et al.  Longitudinal studies in organizational stress research: a review of the literature with reference to methodological issues. , 1996, Journal of occupational health psychology.

[35]  O. Vassend.  Dimensions of negative affectivity, self-reported somatic symptoms, and health-related behaviors. , 1989, Social science & medicine.

[36]  Graham F. Wagstaff,et al.  Personality assessment , 1980, Nature.

[37]  Terry M. Coalter,et al.  Context, Cognition, and Common Method Variance: Psychometric and Verbal Protocol Evidence , 1996 .

[38]  J. George,et al.  Negative affectivity and the reporting of stressful life events. , 1990, Health psychology : official journal of the Division of Health Psychology, American Psychological Association.

[39]  D. Paulhus.  Two-component models of socially desirable responding. , 1984 .

[40]  N. Tallent.  Psychological testing. , 1960, The American journal of nursing.

[41]  Fernando Silva,et al.  Psychometric Foundations and Behavioral Assessment , 1993 .

[42]  K. Parkes,et al.  Social Support and the Demand–Discretion Model of Job Stress: Tests of Additive and Interactive Effects in Two Samples , 1994 .

[43]  D. Hamilton,et al.  Personality attributes associated with extreme response style. , 1968, Psychological bulletin.

[44]  J. Everett,et al.  Response Styles in a Cross-Cultural Managerial Study , 1984 .

[45]  L. Cronbach.  Coefficient alpha and the internal structure of tests , 1951 .

[46]  Richard I. Lanyon,et al.  Personality assessment, 3rd ed. , 1997 .

[47]  N. Schmitt.  Method bias: The importance of theory and measurement , 1994 .

[48]  D. Paulhus.  Measurement and control of response bias. , 1991 .

[49]  Eva Nick,et al.  The dependability of behavioral measurements: theory of generalizability for scores and profiles , 1973 .

[50]  P. Bentler,et al.  Desirability of various life change events among adolescents: Effects of exposure, sex, age, and ethnicity. , 1986 .

[51]  P. Saville,et al.  The reliability and validity of normative and ipsative approaches in the measurement of personality , 1991 .

[52]  R. Linn.  Educational measurement, 3rd ed. , 1989 .

[53]  Donald B. Rubin,et al.  The Dependability of Behavioral Measurements: Theory of Generalizability for Scores and Profiles. , 1974 .

[54]  K. Parkes.  Occupational stress among student nurses: a natural experiment. , 1982, The Journal of applied psychology.

[55]  Delroy L. Paulhus,et al.  Enhancement and Denial in Socially Desirable Responding , 1991 .

[56]  More remarks on social desirability. , 1990 .

[57]  K. Parkes,et al.  The effects of transition stress: A relocation study , 1999 .

[58]  S. Urbina,et al.  Psychological testing, 7th ed. , 1997 .

[59]  R. Hogan,et al.  The meaning of personality test scores. , 1988 .

[60]  J. Crandall.  Sex Differences in Extreme Response Style: Differences in Frequency of Use of Extreme Positive and Negative Ratings , 1973 .

[61]  Adrian Furnham,et al.  Congruence of self and subordinate ratings of managerial practices as a correlate of supervisor evaluation , 1994 .

[62]  A. L. Edwards.  Construct validity and social desirability. , 1990 .

[63]  D. Ganster,et al.  Work Stress and Employee Health , 1991 .

[64]  Larry J. Williams,et al.  An Alternative Approach to Method Effects by Using Latent-Variable Models: Applications in Organizational Behavior Research , 1994 .

[65]  R. Sitgreaves.  Psychometric theory (2nd ed.). , 1979 .

[66]  Paul E. Spector.  Using self‐report questionnaires in OB research: A comment on the use of a controversial method , 1994 .

[67]  Paul E. Spector,et al.  The nature and effects of method variance in organizational research , 1995 .

[68]  D. Campbell,et al.  Convergent and discriminant validation by the multitrait-multimethod matrix. , 1959, Psychological bulletin.

[69]  Steve Blinkhorn,et al.  Spuriouser and spuriouser: The use of ipsative personality tests , 1988 .