Common method biases in behavioral research: a critical review of the literature and recommended remedies.

Interest in the problem of method biases has a long history in the behavioral sciences. Despite this, a comprehensive summary of the potential sources of method biases and how to control for them does not exist. Therefore, the purpose of this article is to examine the extent to which method biases influence behavioral research results, identify potential sources of method biases, discuss the cognitive processes through which method biases influence responses to measures, evaluate the many different procedural and statistical techniques that can be used to control method biases, and provide recommendations for how to select appropriate procedural and statistical remedies for different types of research settings.

[1]  L. Cronbach.  Response Sets and Test Validity , 1946 .

[2]  L. Cronbach.  Further Evidence on Response Sets and Test Design , 1950 .

[3]  J. Guilford.  Psychometric methods, 2nd ed. , 1954 .

[4]  C. Osgood,et al.  The principle of congruity in the prediction of attitude change. , 1955, Psychological review.

[5]  F. Heider.  The psychology of interpersonal relations , 1958 .

[6]  D. Campbell,et al.  Convergent and discriminant validation by the multitrait-multimethod matrix. , 1959, Psychological bulletin.

[7]  G. Freytag.  [CORRELATION AND CAUSALITY]. , 1964, Psychiatrie, Neurologie, und medizinische Psychologie.

[8]  H. Blalock.  Causal Inferences in Nonexperimental Research , 1966 .

[9]  William J. McGuire,et al.  The Current Status of Cognitive Consistency Theories1 , 1966 .

[10]  L. J. Chapman,et al.  Genesis of popular but erroneous psychodiagnostic observations. , 1967, Journal of abnormal psychology.

[11]  D T Campbell,et al.  Methods Factors In Multitrait-Multimethod Matrices : Multiplicative Rather Than Additive? , 1967, Multivariate behavioral research.

[12]  L. J. Chapman,et al.  Illusory correlation as an obstacle to the use of valid psychodiagnostic signs. , 1969, Journal of abnormal psychology.

[13]  W. Collins.  INTERVIEWERS' VERBAL IDIOSYNCRASIES AS A SOURCE OF BIAS , 1970 .

[14]  Michael J. Shapiro.  DISCOVERING INTERVIEWER BIAS IN OPEN-ENDED SURVEY RESPONSES , 1970 .

[15]  E. E. Jones,et al.  The actor and the observer: Divergent perceptions of the causes of behavior. , 1972 .

[16]  Charles N. Greene,et al.  An Evaluation of Causal Models Linking the Received Role with Job Satisfaction. , 1973 .

[17]  R. Kilmann,et al.  The Social Desirability Variable in Organizational Research: An Alternative Explanation for Reported Findings , 1975 .

[18]  Barry M. Staw,et al.  Attribution of the "causes" of performance: A general alternative interpretation of cross-sectional research on organizations. , 1975 .

[19]  D Eden,et al.  Implicit leadership theory as a determinant of the factor structure underlying supervisory behavior scales. , 1975, The Journal of applied psychology.

[20]  D. A. Kenny,et al.  Correlational bias in observer ratings. , 1976 .

[21]  J. Pfeffer,et al.  An examination of need-satisfaction models of job attitudes. , 1977 .

[22]  I. Ajzen,et al.  Belief, Attitude, Intention, and Behavior: An Introduction to Theory and Research , 1977 .

[23]  Robert G. Lord,et al.  The effect of performance cues and leader behavior on questionnaire ratings of leadership behavior , 1978 .

[24]  C. Schriesheim.  The Similarity of Individual Directed and Group Directed Leader Behavior Descriptions , 1979 .

[25]  C. Schriesheim,et al.  The effect of leniency on leader behavior descriptions , 1979 .

[26]  R. Sitgreaves.  Psychometric theory (2nd ed.). , 1979 .

[27]  D. Marlowe,et al.  The Approval Motive: Studies in Evaluative Dependence , 1980 .

[28]  Peter V. Miller,et al.  Research on Interviewing Techniques , 1981 .

[29]  G. Bower.  Mood and memory. , 1981, The American psychologist.

[30]  Charles N. Greene,et al.  The Effects of Formalization on Professional Involvement: A Compensatory Process Approach. , 1981 .

[31]  David E. Kanouse,et al.  Controlling for Acquiescence Response Set in Scale Development , 1982 .

[32]  David Brinberg,et al.  Forms of validity in research , 1982 .

[33]  Fred Luthans,et al.  Social Desirability Response Effects: Three Alternative Models , 1983 .

[34]  D. Watson,et al.  Negative affectivity: the disposition to experience aversive emotional states. , 1984, Psychological bulletin.

[35]  Eugene F. Stone.  Misperceiving and/or Misrepresenting the Facts: A Reply to Salancik , 1984 .

[36]  Hal G. Gueutal,et al.  On the Premature Death of Need-Satisfaction Models: An Investigation of Salancik and Pfeffer's Views on Priming and Consistency Artifacts , 1984 .

[37]  Gerald R. Salancik,et al.  On Priming, Consistency, and Order Effects in Job Attitude Assessment: With a Note on Current Research , 1984 .

[38]  M. Browne,et al.  The decomposition of multitrait-multimethod matrices. , 1984, The British journal of mathematical and statistical psychology.

[39]  William D. Todor,et al.  Relationships Between Leader Reward and Punishment Behavior and Group Processes and Productivity , 1985 .

[40]  A. Nederhof.  Methods of coping with social desirability bias: A review. , 1985 .

[41]  R. Harvey,et al.  Confirmatory factor analysis of the Job Diagnostic Survey: Good news and bad news. , 1985 .

[42]  H. P. Sims,et al.  On Avoiding the Influence of Implicit Leadership Theories in Leader Behavior Descriptions , 1985 .

[43]  William P. Dunlap,et al.  Partialling Factor Scores Does Not Control Method Variance: A Reply to Podsakoff and Todor , 1986 .

[44]  J. S. Phillips,et al.  Notes on the Practical and Theoretical Consequences of Implicit Leadership Theories for the Future of Leadership Measurement , 1986 .

[45]  P. M. Podsakoff,et al.  Self-Reports in Organizational Research: Problems and Prospects , 1986 .

[46]  P. H. Blaney.  Affect and memory: a review. , 1986, Psychological bulletin.

[47]  Richard A. Guzzo,et al.  Implicit theories and the evaluation of group process and performance , 1986 .

[48]  Neal Schmitt,et al.  Methodology Review: Analysis of Multitrait-Multimethod Matrices , 1986 .

[49]  C. Cooper,et al.  International review of industrial and organizational psychology , 1986 .

[50]  R. Abelson,et al.  Social Information Processing and Survey Methodology. , 1987 .

[51]  F. Drasgow,et al.  A Revision of the Job Diagnostic Survey: Elimination of a Measurement Artifact , 1987 .

[52]  Joseph A. Cote,et al.  Estimating Trait, Method, and Error Variance: Generalizing across 70 Construct Validation Studies , 1987 .

[53]  E. E. Jones.  Attribution: Perceiving the Causes of Behavior , 1987 .

[54]  F. Strack,et al.  Thinking, Judging, and Communicating: A Process Account of Context Effects in Attitude Surveys , 1987 .

[55]  John A. Wagner,et al.  Shared influence and organizational behavior: A meta-analysis of situational variables expected to moderate participation-outcome relationships. , 1987 .

[56]  Paul E. Spector.  Method variance as an artifact in self-reported affect and perceptions at work: Myth or significant problem? , 1987 .

[57]  Howard Wainer,et al.  Item Clusters and Computerized Adaptive Testing: A Case for Testlets , 1987 .

[58]  M. Ronald Buckley,et al.  Measurement Error and Theory Testing in Consumer Research: An Illustration of the Importance of Construct Validation , 1988 .

[59]  John Schaubroeck,et al.  A meta-analysis of self-supervisor, self-peer, and peer-supervisor ratings. , 1988 .

[60]  M J Burke,et al.  Should negative affectivity remain an unmeasured variable in the study of job stress? , 1988, The Journal of applied psychology.

[61]  James W. Smither,et al.  When ratee satisfaction influences performance evaluations: A case of illusory correlation. , 1989 .

[62]  H. Marsh.  Confirmatory Factor Analyses of Multitrait-Multimethod Data: Many Problems and a Few Solutions , 1989 .

[63]  Christopher L. Martin,et al.  Some effects of computerized interviewing on job applicant responses. , 1989 .

[64]  M. Appelbaum,et al.  Psychometric methods. , 1989, Annual review of psychology.

[65]  Joseph A. Cote,et al.  Lack of method variance in self-reported affect and perceptions at work: Reality or artifact? , 1989 .

[66]  R. Bagozzi,et al.  Assessing method variance in multitrait-multimethod matrices: The case of self-reported affect and perceptions at work. , 1990 .

[67]  Scott B. MacKenzie,et al.  Transformational leader behaviors and their effects on followers' trust in leader, satisfaction, and organizational citizenship behaviors , 1990 .

[68]  Paul E. Spector,et al.  Estimation Problems in the Block-Diagonal Model of the Multitrait-Multimethod Matrix , 1990 .

[69]  M. Browne,et al.  The direct product model for the mtmm matrix parameterized as a second order factor analysis model , 1990 .

[70]  John Sabini,et al.  Mood and memory under natural conditions: Evidence for mood incongruent recall. , 1990 .

[71]  J. R. Larson,et al.  Research strategies and tactics in industrial and organizational psychology. , 1990 .

[72]  Roger E. Millsap,et al.  A cautionary note on the detection of method variance in multitrait-multimethod data , 1990 .

[73]  H. Marsh,et al.  Confirmatory Factor Analyses of Multitrait-Multimethod Data: A Comparison of Alternative Models , 1991 .

[74]  Scott B. MacKenzie,et al.  Organizational citizenship behavior and objective productivity as determinants of managerial evaluations of salespersons' performance , 1991 .

[75]  Jon A. Krosnick,et al.  Some dynamic properties of attitude structures: Context-induced response facilitation and polarization. , 1991 .

[76]  Roger Tourangeau,et al.  Attitude structure and belief accessibility , 1991 .

[77]  Richard P. Bagozzi,et al.  Assessing Construct Validity in Organizational Research , 1991 .

[78]  Paul E. Spector,et al.  Negative affectivity as the underlying cause of correlations between stressors and strains. , 1991, The Journal of applied psychology.

[79]  R. Lennox,et al.  Conventional wisdom on measurement: A structural equation perspective. , 1991 .

[80]  Max H. Bazerman,et al.  Power balance and the rationality of outcomes in matching markets. , 1991 .

[81]  F. J. Fowler,et al.  How unclear terms affect survey data. , 1992, Public opinion quarterly.

[82]  W. R. Dillon,et al.  An Integrative Look at the Use of Additive and Multiplicative Covariance Structure Models in the Analysis of MTMM Data , 1992 .

[83]  Paul E. Spector.  A Consideration of the Validity and Meaning of Self-Report Measures of Job Conditions , 1992 .

[84]  J. George,et al.  The role of negative affectivity in understanding relations between self-reports of stressors and strains: a comment on the applied psychology literature. , 1993, The Journal of applied psychology.

[85]  D A Harrison,et al.  Cognitive processes in self-report responses: tests of item context effects in work attitude measures. , 1993, The Journal of applied psychology.

[86]  Scott B. MacKenzie,et al.  The impact of organizational citizenship behavior on evaluations of salesperson performance , 1993 .

[87]  Arvind Parkhe.  Strategic Alliance Structuring: A Game Theoretic and Transaction Cost Examination of Interfirm Cooperation , 1993 .

[88]  R. MacCallum,et al.  The use of causal indicators in covariance structure models: some practical issues. , 1993, Psychological bulletin.

[89]  Richard P. Bagozzi,et al.  Multitrait-Multimethod Matrices in Consumer Research , 1991 .

[90]  Larry J. Williams,et al.  An Alternative Approach to Method Effects by Using Latent-Variable Models: Applications in Organizational Behavior Research , 1994 .

[91]  Larry J. Williams,et al.  Method Variance in Organizational Behavior and Human Resources Research: Effects on Correlations, Path Coefficients, and Hypothesis Testing , 1994 .

[92]  Gary Johns,et al.  How often were you absent? A review of the use of self-reported absence data , 1994 .

[93]  L. Thurstone.  A law of comparative judgment. , 1994 .

[94]  Paul E. Spector.  Using self‐report questionnaires in OB research: A comment on the use of a controversial method , 1994 .

[95]  Joseph A. Cote,et al.  Additive and Multiplicative Method Effects in Applied Psychological Research: An Empirical Assessment of Three Models , 1994 .

[96]  Scott B. MacKenzie,et al.  Organizational Citizenship Behaviors and Sales Unit Effectiveness , 1994 .

[97]  J. Wagner,et al.  Percept-Percept Inflation in Microorganizational Research: An Investigation of Prevalence and Effect , 1994 .

[98]  R. Bagozzi,et al.  A general approach to representing multifaceted personality constructs: Application to state self‐esteem , 1994 .

[99]  N. Schmitt.  Method bias: The importance of theory and measurement , 1994 .

[100]  Brian Bemmels.  The Determinants of Grievance Initiation , 1994 .

[101]  M. Korsgaard,et al.  Procedural Justice in Performance Evaluation: The Role of Instrumental and Non-Instrumental Voice in Performance Appraisal Discussions , 1995 .

[102]  Timothy R. Hinkin.  A Review of Scale Development Practices in the Study of Organizations , 1995 .

[103]  R. H. Moorman,et al.  Individualism‐collectivism as an individual difference predictor of organizational citizenship behavior , 1995 .

[104]  Earl R. Nason,et al.  The Impact of Method Effects on Structural Parameters in Validation Research , 1995 .

[105]  M. Audrey Korsgaard,et al.  Procedural Justice in Performance Evaluation: The Role of Instrumental and Non-Instrumental Voice in Performance Appraisal Discussions , 1995 .

[106]  Jeffrey D. Facteau,et al.  The influence of General Perceptions of the Training Environment on Pretraining Motivation and Perceived Training Transfer , 1995 .

[107]  Kevin B. Lowe,et al.  Effectiveness correlates of transformational and transactional leadership: A meta-analytic review of the mlq literature , 1996 .

[108]  Seymour Sudman,et al.  Thinking about Answers: The Application of Cognitive Process to Survey Methodology , 1996 .

[109]  Donna Y. Stringer,et al.  A Quantitative Review of Research on Charismatic Leadership , 1996 .

[110]  Terry M. Coalter,et al.  Context, Cognition, and Common Method Variance: Psychometric and Verbal Protocol Evidence , 1996 .

[111]  Paul E. Spector,et al.  The impact of negative affectivity on stressor-strain relations: A replication and extension , 1996 .

[112]  Larry J. Williams,et al.  Measurement and nonmeasurement processes with negative affectivity and employee attitudes , 1996 .

[113]  Lynne Andersson,et al.  Cynicism in the workplace: some causes and effects , 1997 .

[114]  Charlotte R. Gerstner,et al.  Meta-Analytic Review of Leader-Member Exchange Theory: Correlates and Construct Issues , 1997 .

[115]  J. Conway.  Understanding Method Variance in Multitrait-Multirater Performance Appraisal Matrices: Examples Using General Impressions and Interpersonal Affect as Measured Method Factors , 1998 .

[116]  T. Bechger.  Browne's composite direct product model for MTMM correlation matrices , 1998 .

[117]  K. W. Mossholder,et al.  Relationships between Bases of Power and Work Reactions: The Mediational Role of Procedural Justice , 1998 .

[118]  H. Marsh,et al.  The Lability of Psychological Ratings: The Chameleon Effect in Global Self-Esteem , 1999 .

[119]  Scott B. MacKenzie,et al.  Do citizenship behaviors matter more for managers than for salespeople? , 1999 .

[120]  S. Scullen.  Using Confirmatory Factor Analysis of Correlated Uniquenesses to Estimate Method Variance in Multitrait-Multimethod Matrices , 1999 .

[121]  R. Peterson.  Constructing Effective Questionnaires , 1999 .

[122]  Christopher P. Parker,et al.  A Test of Alternative Hierarchical Models of Psychological Climate: PCg, Satisfaction, or Common Method Variance? , 1999 .

[123]  Robert S. Dooley,et al.  Attaining Decision Quality and Commitment From Dissent: The Moderating Effects of Loyalty and Competence in Strategic Decision-Making Teams , 1999 .

[124]  A. Elangovan,et al.  Effects of perceived power of supervisor on subordinate stress and motivation: the moderating role of subordinate characteristics , 1999 .

[125]  K. Law,et al.  Multidimensional constructs in structural equation analysis: An illustration using the job perception and job satisfaction constructs , 1999 .

[126]  Dawn S. Carlson,et al.  The Role of Social Support in the Stressor-Strain Relationship: An Examination of Work-Family Conflict , 1999 .

[127]  Fritz Drasgow,et al.  A Meta-Analytic Study of Social Desirability Distortion in Computer- Administered Questionnaires, Traditional Questionnaires, and Interviews , 1999 .

[128]  Paul E. Spector,et al.  A longitudinal study of relations between job stressors and job strains while controlling for prior negative affectivity and strains. , 2000, The Journal of applied psychology.

[129]  M. Lindell,et al.  Climate quality and climate consensus as mediators of the relationship between organizational antecedents and outcomes. , 2000, The Journal of applied psychology.

[130]  Daniel G. Bachrach,et al.  Organizational Citizenship Behaviors: A Critical Review of the Theoretical and Empirical Literature and Suggestions for Future Research , 2000 .

[131]  Dawn S. Carlson,et al.  Work–Family Conflict in the Organization: Do Life Role Values make a Difference? , 2000 .

[132]  Preet S. Aulakh,et al.  International Principal–Agent Relationships , 2000 .

[133]  T. Kline,et al.  Common Method Variance and Specification Errors: A Practical Approach to Detection , 2000, The Journal of psychology.

[134]  Catherine Maguire,et al.  The Relationship between Job and Life Satisfaction: Evidence from a Remote Mining Community , 2000 .

[135]  R. N. Kanungo,et al.  Charismatic leadership and follower effects , 2000 .

[136]  M. Lindell,et al.  Accounting for common method variance in cross-sectional research designs. , 2001, The Journal of applied psychology.

[137]  V. González-Romá,et al.  Analysis of Multitrait-Multioccasion Data: Additive versus Multiplicative Models , 2002, Multivariate behavioral research.

[138]  M. Larsen,et al.  The Psychology of Survey Response , 2002 .

[139]  Steven E. Scullen,et al.  A critique of the correlated trait-correlated method and correlated uniqueness models for multitrait-multimethod data. , 2002, Psychological methods.

[140]  N. Schwarz,et al.  Thinking About Answers: The Application of Cognitive Processes to Survey Methodology , 1995, Quality of Life Research.

[141]  M. D. Dunnette.  Handbook of Industrial and Organizational Psychology , 2005 .