Common Method Variance in Advertising Research: When to Be Concerned and How to Control for It

In this article we discuss and analyze the critical issues related to common method variance (CMV) that are particularly relevant to advertising research and recommend best practices for assessing the effects of CMV in this domain. Specifically, we cover the development of CMV as a domain-specific methodological concern and the underlying sources of CMV that are likely to operate in cross-sectional survey-based studies in the field of advertising. We discuss in detail the available procedural and statistical techniques that can be applied to control for and/or measure the effects of sources of CMV in a single study and across research domains. In addition, we provide a critical look at how these techniques have been employed in past research and make recommendations for future examinations of CMV in advertising research.

[1]  Gary L. Frazier,et al.  Distributor Sharing of Strategic Information with Suppliers , 2009 .

[2]  N. Schmitt.  Method bias: The importance of theory and measurement , 1994 .

[3]  P. M. Podsakoff,et al.  Self-Reports in Organizational Research: Problems and Prospects , 1986 .

[4]  Arjen van Witteloostuijn,et al.  From the Editors: Common method variance in international business research , 2010 .

[5]  Terry M. Coalter,et al.  Context, Cognition, and Common Method Variance: Psychometric and Verbal Protocol Evidence , 1996 .

[6]  Scott B. MacKenzie,et al.  Common Method Bias in Marketing: Causes, Mechanisms, and Procedural Remedies , 2012 .

[7]  George S. Howard,et al.  Why do people say nasty things about self-reports? , 1994 .

[8]  Detmar W. Straub,et al.  Validating Instruments in MIS Research , 1989, MIS Q..

[9]  David Chan,et al.  What Is Method Variance and How Can We Cope With It? A Panel Discussion , 2010 .

[10]  Hans Baumgartner,et al.  Response Styles in Marketing Research: A Cross-National Investigation , 2001 .

[11]  Naresh K. Malhotra,et al.  Common Method Variance in IS Research: A Comparison of Alternative Approaches and a Reanalysis of Past Research , 2006, Manag. Sci..

[12]  I. Janis,et al.  An experimental study of psychological resistance to fear-arousing communications. , 1962, Journal of abnormal and social psychology.

[13]  John O. Summers.  Guidelines for conducting research and publishing in marketing: From conceptualization through the review process , 2001, How to Get Published in the Best Marketing Journals.

[14]  Shelley D. Dionne,et al.  Neutralizing substitutes for leadership theory: leadership effects and common-source bias. , 2002, The Journal of applied psychology.

[15]  Bryan Dawson,et al.  Method Effects, Measurement Error, and Substantive Conclusions , 2010 .

[16]  Kineta H. Hung,et al.  Why Celebrity Sells: A Dual Entertainment Path Model of Brand Endorsement , 2014 .

[17]  S. Donaldson,et al.  Understanding Self-Report Bias in Organizational Behavior Research , 2002 .

[18]  Alyssa K. McGonagle,et al.  Four Research Designs and a Comprehensive Analysis Strategy for Investigating Common Method Variance with Self-Report Measures Using Latent Variables , 2016 .

[19]  U. Orth.  How Large Are Actor and Partner Effects of Personality on Relationship Satisfaction? The Importance of Controlling for Shared Method Variance , 2013, Personality & social psychology bulletin.

[20]  C. Lance,et al.  What Reviewers Should Expect from Authors Regarding Common Method Bias in Organizational Research , 2010 .

[21]  Neal Schmitt,et al.  Methodology Review: Analysis of Multitrait-Multimethod Matrices , 1986 .

[22]  Paul E. Spector.  Using self‐report questionnaires in OB research: A comment on the use of a controversial method , 1994 .

[23]  Nathan P. Podsakoff,et al.  Surveying for "artifacts": the susceptibility of the OCB-performance evaluation relationship to common rater, item, and measurement context effects. , 2013, The Journal of applied psychology.

[24]  Nathan S. Hartman,et al.  Method Variance and Marker Variables: A Review and Comprehensive CFA Marker Technique , 2010 .

[25]  Bradley J. Alge,et al.  Information privacy in organizations: empowering creative and extrarole performance. , 2006, The Journal of applied psychology.

[26]  P. Levy,et al.  Performance appraisal reactions: measurement, modeling, and method bias. , 2000, The Journal of applied psychology.

[27]  Xin Lai,et al.  A Monte Carlo Study of the Effects of Common Method Variance on Significance Testing and Parameter Bias in Hierarchical Linear Modeling , 2013 .

[28]  Philip H. Winne,et al.  Using a multitrait-multimethod analysis to examine conceptual similarities of three self-regulated learning inventories. , 2007, The British journal of educational psychology.

[29]  D. Campbell,et al.  Convergent and discriminant validation by the multitrait-multimethod matrix. , 1959, Psychological bulletin.

[30]  Christie M. Fuller,et al.  Common methods variance detection in business research , 2016 .

[31]  Jack M. Feldman,et al.  Self-generated validity and other effects of measurement on belief, attitude, intention, and behavior. , 1988 .

[32]  J. Krosnick,et al.  Comparing questions with agree/ disagree response options to questions with item-specific response options , 2010 .

[33]  Cheri Ostroff,et al.  Substantive and operational issues of response bias across levels of analysis: an example of climate-satisfaction relationships. , 2002, The Journal of applied psychology.

[34]  William P. Dunlap,et al.  Partialling Factor Scores Does Not Control Method Variance: A Reply to Podsakoff and Todor , 1986 .

[35]  R. Peterson.  Ruminations on Theory and Research Scholarship in Marketing , 2005 .

[36]  Qing Hu,et al.  Assimilation of Enterprise Systems: The Effect of Institutional Pressures and the Mediating Role of Top Management , 2007, MIS Q..

[37]  N. Malhotra,et al.  Alternative Techniques for Assessing Common Method Variance , 2015 .

[38]  A. Vishwanath.  Common Method Bias , 2017 .

[39]  Victoria L. Pace.  Method Variance From the Perspectives of Reviewers: Poorly Understood Problem or Overemphasized Complaint? , 2010 .

[40]  Christopher C. Rosen,et al.  Assessing the impact of common method variance on higher order multidimensional constructs. , 2011, The Journal of applied psychology.

[41]  Christopher P. Parker,et al.  A Test of Alternative Hierarchical Models of Psychological Climate: PCg, Satisfaction, or Common Method Variance? , 1999 .

[42]  Christie M. Fuller,et al.  Marker Variable Choice, Reporting, and Interpretation in the Detection of Common Method Variance , 2015 .

[43]  Jörg Matthes,et al.  The Skeptical Green Consumer Revisited: Testing the Relationship Between Green Consumerism and Skepticism Toward Advertising , 2014 .

[44]  E. Mao,et al.  UNDERSTANDING THE ACCEPTANCE OF MOBILE SMS ADVERTISING AMONG YOUNG CHINESE CONSUMERS , 2008 .

[45]  Richard P. Bagozzi,et al.  Assessing Construct Validity in Organizational Research , 1991 .

[46]  Bert Weijters,et al.  Commentary on “Common Method Bias in Marketing: Causes, Mechanisms, and Procedural Remedies” , 2012 .

[47]  A W Stacy,et al.  Validity of self-reports of alcohol and other drug use: a multitrait-multimethod assessment. , 1985, Journal of personality and social psychology.

[48]  Paul E. Spector.  Method Variance in Organizational Research , 2006 .

[49]  Paul E. Spector.  Method variance as an artifact in self-reported affect and perceptions at work: Myth or significant problem? , 1987 .

[50]  L. J. Williams,et al.  Ideal, nonideal, and no-marker variables: The confirmatory factor analysis (CFA) marker technique works when it matters. , 2015, The Journal of applied psychology.

[51]  F. Mavondo,et al.  Integrated Marketing Communication Capability and Brand Performance , 2015 .

[52]  Paul E. Spector,et al.  Common Method Issues: An Introduction to the Feature Topic in Organizational Research Methods , 2010 .

[53]  J. Wagner,et al.  Percept-Percept Inflation in Microorganizational Research: An Investigation of Prevalence and Effect , 1994 .

[54]  William H. Glick,et al.  Method Versus Substance: How Strong are Underlying Relationships Between Job Characteristics and Attitudinal Outcomes? , 1986 .

[55]  Ajay K. Kohli.  From the Editor: Reflections on the Review Process , 2011 .

[56]  D. Straub.  Validating Instruments in MIS Research 1 , 2002 .

[57]  Marcia J. Simmering,et al.  A Tale of Three Perspectives , 2009 .

[58]  C. Moorman,et al.  Cross-Sectional versus Longitudinal Survey Research: Concepts, Findings, and Guidelines , 2008 .

[59]  Barbara B. Stern,et al.  Sympathy and Empathy: Emotional Responses to Advertising Dramas , 2003 .

[60]  Ryan T. Wright,et al.  Assessing Common Method Bias: Problems with the ULMC Technique , 2012, MIS Q..

[61]  Gerard Prendergast,et al.  A Hong Kong study of advertising credibility , 2009 .

[62]  K. Ruyter,et al.  Social Capital Production in a Virtual P3 Community , 2008 .

[63]  Darrel D. Muehling,et al.  “I Eat Organic for My Benefit and Yours”: Egoistic and Altruistic Considerations for Purchasing Organic Food and Their Implications for Advertising Strategists , 2014 .

[64]  David A. Askay,et al.  Crafting a Successful Manuscript: Lessons from 131 Reviews , 2009 .

[65]  Michael J. Palombo,et al.  The Brand Communication Effects of using a Headline to Prompt the Key Benefit in ADS with Pictorial Metaphors , 2012 .

[66]  R. Bagozzi.  Assessing Construct Validity in Personality Research: Applications to Measures of Self-Esteem , 1993 .

[67]  John P. Campbell,et al.  Editorial: Some Remarks From the Outgoing Editor. , 1982 .

[68]  Enno Siemsen,et al.  Common Method Bias in Regression Models With Linear, Quadratic, and Interaction Effects , 2010 .

[69]  Joseph A. Cote,et al.  Estimating Trait, Method, and Error Variance: Generalizing across 70 Construct Validation Studies , 1987 .

[70]  G. Prendergast,et al.  Online word of mouth and consumer purchase intentions , 2010 .

[71]  R. Bagozzi,et al.  Multitrait–multimethod matrices in consumer research: Critique and new developments , 1993 .

[72]  Hairong Li,et al.  The Effect of Agency Creativity on Campaign Outcomes: The Moderating Role of Market Conditions , 2008 .

[73]  M. Lindell,et al.  Accounting for common method variance in cross-sectional research designs. , 2001, The Journal of applied psychology.

[74]  Scott B. MacKenzie,et al.  Working memory: theories, models, and controversies. , 2012, Annual review of psychology.

[75]  Christopher J. L. Cunningham,et al.  The ubiquity of common method variance: The case of the Big Five , 2011 .

[76]  Murray R. Barrick,et al.  Validity of observer ratings of the big five personality factors , 1994 .

[77]  Yu-Kang Lee.  Gender stereotypes as a double-edged sword in political advertising , 2014 .

[78]  D. Stewart.  Academic publishing in marketing: best and worst practices , 2008, How to Get Published in the Best Marketing Journals.

[79]  Sönke Albers,et al.  The Impact of Technological and Organizational Implementation of CRM on Customer Acquisition, Maintenance, and Retention , 2009 .

[80]  J. Colquitt,et al.  Taking the Mystery Out of AMJ'S Reviewer Evaluation Form , 2009 .

[81]  Bert Weijters,et al.  Misresponse to Reversed and Negated Items in Surveys: A Review , 2012 .

[82]  Adam W. Meade,et al.  Assessing Common Methods Bias in Organizational Research , 2007 .

[83]  John T. Cacioppo,et al.  Persuasiveness of Communications is Affected by Exposure Frequency and Message Quality: A Theoretical and Empirical Analysis of Persisting Attitude Change , 1980, Current Issues and Research in Advertising.

[84]  Sukki Yoon,et al.  Advertising Creativity in Korea , 2010 .

[85]  A. Greenwald.  6 – Cognitive Learning, Cognitive Response to Persuasion, and Attitude Change1 , 1968 .

[86]  R. Bagozzi,et al.  Assessing method variance in multitrait-multimethod matrices: The case of self-reported affect and perceptions at work. , 1990 .

[87]  Brian S. Connelly,et al.  Separating method factors and higher order traits of the Big Five: a meta-analytic multitrait-multimethod approach. , 2012, Journal of personality and social psychology.

[88]  Joseph A. Cote,et al.  Lack of method variance in self-reported affect and perceptions at work: Reality or artifact? , 1989 .

[89]  A. Gottlob,et al.  Monte-Carlo study , 1998 .

[90]  Rajeev Sharma,et al.  Estimating the effect of common method variance: the method-method pair technique with an illustration from TAM research , 2009 .

[91]  Scott B. MacKenzie,et al.  Common method biases in behavioral research: a critical review of the literature and recommended remedies. , 2003, The Journal of applied psychology.

[92]  提携研究機関誌からの論文紹介 The Advertising Research Foundation 『Journal of Advertising Research』より A Multi-Country Examination Of Hard-Sell and Soft-Sell Advertising : Comparing Global Consumer Positioning In Holistic- and Analytic-Thinking Cultures , 2013 .

[93]  Detmar W. Straub,et al.  Veni, Vidi, Vici: Breaking the TAM Logjam , 2007, J. Assoc. Inf. Syst..

[94]  Gerry McNamara,et al.  Publishing in AMJ—Part 2: Research Design , 2011 .