Marker Variable Choice, Reporting, and Interpretation in the Detection of Common Method Variance

This article investigates in two ways the use and reporting of marker variables to detect common method variance (CMV) in organizational research. First, a review of 398 empirical articles and 41 unpublished dissertations that employ marker variables indicates that authors are not reporting adequate information regarding marker variable choice and use, are choosing inappropriate marker variables, and are possibly making errors in their assessment of CMV effects. Second, two data sets are presented that investigate the properties of six prospective markers to assess the degree to which they capture specific, measurable causes of CMV and the conclusions these markers produce when applied to substantive relationships. Results from the review and empirical investigation are used to expand the set of conditions scholars should consider when determining whether to employ a marker technique over other alternatives for detecting and controlling CMV and how best to do so.

[1]  Joseph A. Cote,et al.  Lack of method variance in self-reported affect and perceptions at work: Reality or artifact? , 1989 .

[2]  Scott B. MacKenzie,et al.  Working memory: theories, models, and controversies. , 2012, Annual review of psychology.

[3]  C. Lance,et al.  What Reviewers Should Expect from Authors Regarding Common Method Bias in Organizational Research , 2010 .

[4]  M. Lindell,et al.  Accounting for common method variance in cross-sectional research designs. , 2001, The Journal of applied psychology.

[5]  Donald H. Kluemper,et al.  Overclaiming as a measure of faking , 2011 .

[6]  D. Marlowe,et al.  The Approval Motive: Studies in Evaluative Dependence , 1980 .

[7]  Paul E. Spector.  Method variance as an artifact in self-reported affect and perceptions at work: Myth or significant problem? , 1987 .

[8]  L. J. Williams,et al.  An Alternative Approach to Method Effects by Using Latent-Variable Models: Applications in Organizational Behavior Research , 1994 .

[9]  John P. Robinson,et al.  CHAPTER 1 – Criteria for Scale Selection and Evaluation , 1991 .

[10]  Joseph A. Cote,et al.  Estimating Trait, Method, and Error Variance: Generalizing across 70 Construct Validation Studies , 1987 .

[11]  Margaret L. Williams.  Antecedents of Employee Benefit Level Satisfaction: A Test of a Model , 1995 .

[12]  Lucy R. Ford,et al.  It’s Not Me, It’s You , 2014 .

[13]  N. Schmitt.  Method bias: The importance of theory and measurement , 1994 .

[14]  Bert Weijters,et al.  Assessing response styles across modes of data collection , 2008 .

[15]  Timothy A. Judge,et al.  Does affective disposition moderate the relationship between job satisfaction and voluntary turnover , 1993 .

[16]  Marcia J. Simmering,et al.  A Tale of Three Perspectives , 2009 .

[17]  Richard G. Netemeyer,et al.  Handbook of Marketing Scales: Multi-Item Measures for Marketing and Consumer Behavior Research , 1993 .

[18]  D. Paulhus.  Two-component models of socially desirable responding. , 1984 .

[19]  Scott B. MacKenzie,et al.  Common method biases in behavioral research: a critical review of the literature and recommended remedies. , 2003, The Journal of applied psychology.

[20]  Richard G. Netemeyer,et al.  Handbook of Marketing Scales , 1999 .

[21]  H. P. Sims,et al.  The Measurement of Job Characteristics , 1976 .

[22]  J. Hackman,et al.  Development of the Job Diagnostic Survey , 1975 .

[23]  David Chan,et al.  So Why Ask Me? Are Self-Report Data Really That Bad? , 2009 .

[24]  Hans Baumgartner,et al.  Response Styles in Marketing Research: A Cross-National Investigation , 2001 .

[25]  Torben Hansen,et al.  The Moderating Influence of Broad‐Scope Trust on Customer–Seller Relationships , 2012 .

[26]  J. George,et al.  The role of negative affectivity in understanding relations between self-reports of stressors and strains: a comment on the applied psychology literature. , 1993, The Journal of applied psychology.

[27]  D. Watson,et al.  Development and validation of brief measures of positive and negative affect: the PANAS scales. , 1988, Journal of personality and social psychology.

[28]  Terry M. Coalter,et al.  Context, Cognition, and Common Method Variance: Psychometric and Verbal Protocol Evidence , 1996 .

[29]  Bryan Dawson,et al.  Method Effects, Measurement Error, and Substantive Conclusions , 2010 .

[30]  Victoria L. Pace.  Method Variance From the Perspectives of Reviewers: Poorly Understood Problem or Overemphasized Complaint? , 2010 .

[31]  G. Graen,et al.  Generalizability of the vertical dyad linkage model of leadership. , 1980 .

[32]  Naresh K. Malhotra,et al.  Common Method Variance in IS Research: A Comparison of Alternative Approaches and a Reanalysis of Past Research , 2006, Manag. Sci..

[33]  Paul E. Spector.  Method Variance in Organizational Research , 2006 .

[34]  David Chan,et al.  What Is Method Variance and How Can We Cope With It? A Panel Discussion , 2010 .

[35]  Paul E. Spector.  Using self‐report questionnaires in OB research: A comment on the use of a controversial method , 1994 .

[36]  S. Lirtzman,et al.  Role Conflict and Ambiguity in Complex Organizations. , 1970 .

[37]  Fred Luthans,et al.  Social Desirability Response Effects: Three Alternative Models , 1983 .

[38]  Paul E. Spector,et al.  Why negative affectivity should not be controlled in job stress research: don't throw out the baby with the bath water , 2000, Journal of Organizational Behavior.

[39]  Nathan S. Hartman,et al.  Method Variance and Marker Variables: A Review and Comprehensive CFA Marker Technique , 2010 .

[40]  Paul E. Spector,et al.  Common Method Issues: An Introduction to the Feature Topic in Organizational Research Methods , 2010 .

[41]  Enno Siemsen,et al.  Common Method Bias in Regression Models With Linear, Quadratic, and Interaction Effects , 2010 .

[42]  Larry J. Williams,et al.  Method Variance in Organizational Behavior and Human Resources Research: Effects on Correlations, Path Coefficients, and Hypothesis Testing , 1994 .

[43]  J. Weitz.  A Neglected Concept in the Study of Job Satisfaction , 1952 .

[44]  J. Wagner,et al.  Percept-Percept Inflation in Microorganizational Research: An Investigation of Prevalence and Effect , 1994 .

[45]  Jixia Yang,et al.  Supervisory procedural justice effects: The mediating roles of cognitive and affective trust , 2009 .

[46]  J. A. Robinson,et al.  Temporal reference systems and autobiographical memory , 1986 .

[47]  G. Graen,et al.  Relationship-based approach to leadership: Development of leader-member exchange (LMX) theory of leadership over 25 years: Applying a multi-level multi-domain perspective , 1995 .

[48]  John P. Robinson,et al.  Measures Of Personality And Social Psychological Attitudes , 1991 .

[49]  Measuring implicit content and processes at work: A new frontier within the organizational sciences , 2013 .

[50]  Larry J. Williams,et al.  An Alternative Approach to Method Effects by Using Latent-Variable Models: Applications in Organizational Behavior Research , 1994 .

[51]  Gordon C. Bruner,et al.  Marketing Scales Handbook: A Compilation of Multi-Item Measures , 1992 .

[52]  Jean-Paul Fox,et al.  Reducing Social Desirability Bias through Item Randomized Response: An Application to Measure Underreported Desires , 2010 .

[53]  D. Watson,et al.  Negative affectivity: the disposition to experience aversive emotional states. , 1984, Psychological bulletin.

[54]  Larry J. Williams,et al.  Measurement and nonmeasurement processes with negative affectivity and employee attitudes , 1996 .

[55]  P. Tierney,et al.  Creative Self-Efficacy: Its Potential Antecedents and Relationship to Creative Performance , 2002 .

[56]  D. Watson,et al.  Beyond negative affectivity: Measuring stress and satisfaction in the workplace. , 1987 .

[57]  Christopher C. Rosen,et al.  Assessing the impact of common method variance on higher order multidimensional constructs. , 2011, The Journal of applied psychology.

[58]  D. Paulhus,et al.  The over-claiming technique: measuring self-enhancement independent of ability. , 2003, Journal of personality and social psychology.

[59]  J. Colquitt.  On the dimensionality of organizational justice: a construct validation of a measure. , 2001, The Journal of applied psychology.

[60]  Paul E. Spector,et al.  The role of negative affectivity in employee reactions to job characteristics: Bias effect or substantive effect? , 1999 .