Percept-Percept Inflation in Microorganizational Research: An Investigation of Prevalence and Effect

Analysis of 42,934 correlations published in 581 articles not only revealed general evidence that self-report methods have produced percept-percept inflation in microresearch on organizations but also suggested that this effect is diminished when 1 or both covariates are demographic variables. Further analysis of a subsample of 11,710 correlations indicated that percept-percept inflation has influenced research on particular bivariate relationships but has not had the broad, comprehensive effects envisioned by critics. These findings challenge the validity of general condemnations of self-report methods, suggesting instead that domain-specific investigations are required to determine which areas of research are especially susceptible to percept-percept effects

[1]  William G. Cochran,et al.  Experimental Designs, 2nd Edition , 1950 .

[2]  William G. Cochran,et al.  Experimental designs, 2nd ed. , 1957 .

[3]  R. Kirk Experimental Design: Procedures for the Behavioral Sciences , 1970 .

[4]  K. Weick The social psychology of organizing , 1969 .

[5]  H. Scheffé Practical Solutions of the Behrens-Fisher Problem , 1970 .

[6]  J. Pfeffer,et al.  A social information processing approach to job attitudes and task design. , 1978, Administrative science quarterly.

[7]  Lyman W. Porter,et al.  On the Use of Incumbent-Supplied Job-Characteristics Data , 1978 .

[8]  R. Rosenthal The file drawer problem and tolerance for null results , 1979 .

[9]  John P. Campbell,et al.  Editorial: Some Remarks From the Outgoing Editor. , 1982 .

[10]  Gregg B. Jackson,et al.  Meta-Analysis: Cumulating Research Findings Across Studies , 1982 .

[11]  J. S. Phillips,et al.  Notes on the Practical and Theoretical Consequences of Implicit Leadership Theories for the Future of Leadership Measurement , 1986 .

[12]  P. M. Podsakoff,et al.  Self-Reports in Organizational Research: Problems and Prospects , 1986 .

[13]  William H. Glick,et al.  Method Versus Substance: How Strong are Underlying Relationships Between Job Characteristics and Attitudinal Outcomes? , 1986 .

[14]  C. Cooper,et al.  International review of industrial and organizational psychology , 1986 .

[15]  Joseph A. Cote,et al.  Estimating Trait, Method, and Error Variance: Generalizing across 70 Construct Validation Studies: , 1987 .

[16]  R. Gooding,et al.  Effects of Societal Trends on Participation Research. , 1987 .

[17]  John A. Wagner,et al.  Shared influence and organizational behavior: A meta-analysis of situational variables expected to moderate participation-outcome relationships. , 1987 .

[18]  Paul E. Spector Method variance as an artifact in self-reported affect and perceptions at work: Myth or significant problem? , 1987 .

[19]  Paul E. Spector,et al.  Relation of job stressors to affective, health, and performance outcomes: a comparison of multiple data sources. , 1988, The Journal of applied psychology.

[20]  H. Marsh Confirmatory Factor Analyses of Multitrait-Multimethod Data: Many Problems and a Few Solutions , 1989 .

[21]  John E. Hunter,et al.  Methods of Meta-Analysis , 1989 .

[22]  Joseph A. Cote,et al.  Lack of method variance in self-reported affect and perceptions at work: Reality or artifact? , 1989 .

[23]  Ronald A. Ash,et al.  A comparative study of mentoring among men and women in managerial, professional, and technical positions. , 1990 .

[24]  R. Bagozzi,et al.  Assessing method variance in multitrait-multimethod matrices: The case of self-reported affect and perceptions at work. , 1990 .

[25]  Paul E. Spector,et al.  Estimation Problems in the Block-Diagonal Model of the Multitrait-Multimethod Matrix , 1990 .

[26]  Roger E. Millsap,et al.  A cautionary note on the detection of method variance in multitrait-multimethod data , 1990 .

[27]  Paul E. Spector,et al.  Relations of job characteristics from multiple data sources with employee affect, absence, turnover intentions, and health. , 1991, The Journal of applied psychology.

[28]  F. Yammarino,et al.  Identifying Common Methods Variance With Data Collected From A Single Source: An Unresolved Sticky Issue , 1991 .

[29]  Paul E. Spector A Consideration of the Validity and Meaning of Self-Report Measures of Job Conditions , 1992 .