Method Variance and Marker Variables: A Review and Comprehensive CFA Marker Technique

Lindell and Whitney introduced a partial correlation technique, now referred to as the correlational marker technique, for controlling method variance using a marker variable that is theoretically unrelated to substantive variables in a study. This article (a) first reviews their specific analysis plan, and then (b) reviews empirical studies that have followed all or part of this plan. The authors also (c) describe a structural equation method that has been applied to the analysis of marker variables and (d) review empirical studies using this analytical approach. Next, the authors (e) develop a comprehensive confirmatory factor analysis (CFA) marker technique analysis plan, and (f) demonstrate this plan with an empirical example. Finally, the authors (g) describe how marker variables can be examined along with other method variance processes, (h) discuss the important role of theory in the critical step of selecting marker variables, and (i) discuss assumptions and limitations of the Comprehensive CFA Marker Technique.

[1]  James C. Anderson,et al.  STRUCTURAL EQUATION MODELING IN PRACTICE: A REVIEW AND RECOMMENDED TWO-STEP APPROACH , 1988 .

[2]  M. L. Fox,et al.  Dispositional affect and work-related stress. , 1992, The Journal of applied psychology.

[3]  Scott B. MacKenzie,et al.  Common method biases in behavioral research: a critical review of the literature and recommended remedies. , 2003, The Journal of applied psychology.

[4]  William D. Spangler,et al.  CEO transformational leadership and organizational outcomes: The mediating role of human–capital-enhancing human resource management , 2005 .

[5]  G. Graen,et al.  The effects of leader–member exchange and job design on productivity and satisfaction: Testing a dual attachment model. , 1982 .

[6]  James E. Burroughs,et al.  The Safety of Objects: Materialism, Existential Insecurity, and Brand Connection , 2009 .

[7]  Sung S. Kim,et al.  Internet Users' Information Privacy-Protective Responses: A Taxonomy and a Nomological Model , 2008, MIS Q..

[8]  Larry J. Williams,et al.  An Alternative Approach to Method Effects by Using Latent-Variable Models: Applications in Organizational Behavior Research , 1994 .

[9]  Jixia Yang,et al.  Supervisory procedural justice effects: The mediating roles of cognitive and affective trust , 2009 .

[10]  Kent Grayson,et al.  Friendship versus Business in Marketing Relationships , 2007 .

[11]  William H. Glick,et al.  Common Methods Bias: Does Common Methods Variance Really Bias Results? , 1998 .

[12]  Yuan Sun,et al.  Extending technology usage to work settings: The role of perceived work compatibility in ERP implementation , 2009, Inf. Manag..

[13]  J. Conway,et al.  Method Variance and Method Bias in Industrial and Organizational Psychology , 2008 .

[14]  Todd J. Arnold,et al.  THE RELATIONSHIP BETWEEN JUSTICE AND BENEFITS SATISFACTION , 2006 .

[15]  Stan Malos,et al.  Benefit System and Benefit Level Satisfaction: An Expanded Model of Antecedents and Consequences , 2002 .

[16]  Todd J. Arnold,et al.  An appraisal perspective of justice, structure, and job control as antecedents of psychological distress , 2007 .

[17]  William R. Darden,et al.  Causal Models in Marketing , 1980 .

[18]  P. M. Podsakoff,et al.  Self-Reports in Organizational Research: Problems and Prospects , 1986 .

[19]  Paul E. Spector Using self‐report questionnaires in OB research: A comment on the use of a controversial method , 1994 .

[20]  Sönke Albers,et al.  The Impact of Technological and Organizational Implementation of CRM on Customer Acquisition, Maintenance, and Retention , 2009 .

[21]  S. Lirtzman,et al.  Role Conflict and Ambiguity in Complex Organizations. , 1970 .

[22]  Barton A. Weitz,et al.  Creativity in Buyer-Seller Relationships: The Role of Governance , 2008 .

[23]  R. Arvey,et al.  The determinants of leadership role occupancy: Genetic and personality factors. , 2006 .

[24]  H. P. Sims,et al.  The Measurement of Job Characteristics , 1976 .

[25]  Roger Tourangeau,et al.  Cognitive Aspects of Survey Measurement and Mismeasurement , 2003 .

[26]  Andrea Hall,et al.  The prediction of safe lifting behavior: an application of the theory of planned behavior. , 2005, Journal of safety research.

[27]  S. Oreg Personality, context, and resistance to organizational change , 2006 .

[28]  Murray R. Barrick,et al.  Effects of impression management and self-deception on the predictive validity of personality constructs. , 1996, The Journal of applied psychology.

[29]  Mark A. Griffin,et al.  Refining individualized consideration: Distinguishing developmental leadership and supportive leadership , 2006 .

[30]  Xin Li,et al.  Why do we trust new technology? A study of initial trust formation with organizational information systems , 2008, J. Strateg. Inf. Syst..

[31]  J. Dawson,et al.  The impact of leadership and quality climate on hospital performance. , 2008, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[32]  Timothy R. Konold,et al.  Are there methodological and substantive roles for affectivity in job diagnostic survey relationships , 1996 .

[33]  L. J. Williams,et al.  An Alternative Approach to Method Effects by Using Latent-Variable Models: Applications in Organizational Behavior Research , 1994 .

[34]  Earl R. Nason,et al.  Likability and Similarity as Potential Sources of Predictor-Related Criterion Bias in Validation Research , 1996 .

[35]  Lucy R. Ford,et al.  Basic and Advanced Measurement Models for Confirmatory Factor Analysis , 2008 .

[36]  M. Griffin,et al.  Dimensions of transformational leadership: Conceptual and empirical extensions , 2004 .

[37]  Steven S. Lui,et al.  The Roles of Competence Trust, Formal Contract, and Time Horizon in Interorganizational Learning , 2009 .

[38]  J. George,et al.  The role of negative affectivity in understanding relations between self-reports of stressors and strains: a comment on the applied psychology literature. , 1993, The Journal of applied psychology.

[39]  Bradley J. Alge,et al.  Information privacy in organizations: empowering creative and extrarole performance. , 2006, The Journal of applied psychology.

[40]  Kevin B. Lowe,et al.  Crisis, charisma, values, and voting behavior in the 2004 presidential election , 2009 .

[41]  Herman Aguinis,et al.  Sample Size Rules of Thumb: Evaluating Three Common Practices , 2009 .

[42]  N. Noorderhaven,et al.  When Does Trust Matter to Alliance Performance , 2006 .

[43]  D. F. Coleman,et al.  The Moderating Effect of Negative Affectivity in the Procedural Justice-Job Satisfaction Relation. , 2005 .

[44]  D. F. Coleman,et al.  The Moderating Effect of Different Forms of Commitment on Role Ambiguity‐Job Tension Relations , 2009 .

[45]  Brian S. Fugate,et al.  Linking improved knowledge management to operational and organizational performance , 2009 .

[46]  K. Jöreskog,et al.  Intraclass Reliability Estimates: Testing Structural Assumptions , 1974 .

[47]  I. Densten,et al.  How leaders woo followers in the romance of leadership , 2007 .

[48]  Margaret L. Williams Antecedents of Employee Benefit Level Satisfaction: A Test of a Model , 1995 .

[49]  Zinta S. Byrne,et al.  Different Media for Organizational Communication: Perceptions of Quality and Satisfaction , 2006 .

[50]  J. Benson,et al.  Understanding performance appraisal fairness , 2007 .

[51]  M. Lindell,et al.  Accounting for common method variance in cross-sectional research designs. , 2001, The Journal of applied psychology.

[52]  Larry J. Williams,et al.  Measurement and nonmeasurement processes with negative affectivity and employee attitudes , 1996 .

[53]  Karoline Strauss,et al.  Proactivity Directed Toward the Team and Organization: The Role of Leadership, Commitment and Role-Breadth Self-Efficacy , 2009 .

[54]  M. Butts,et al.  Statistical and Methodological Myths and Urban Legends: Doctrine, Verity and Fable in the Organizational and Social Sciences , 2008 .

[55]  Peter R. Magnusson,et al.  Technology readiness and usage: a global-identity perspective , 2009 .

[56]  William D. Todor,et al.  Relationships Between Leader Reward and Punishment Behavior and Group Processes and Productivity , 1985 .

[57]  Bruce J. Avolio,et al.  The impact of efficacy on work attitudes across cultures , 2006 .

[58]  R. Lusch,et al.  Getting Marketers to Invest in Firm-Specific Capital , 2007 .

[59]  Christopher L. Tucci,et al.  Exploring the structural effects of Internetworking , 2004 .

[60]  N. Schmitt Method bias: The importance of theory and measurement , 1994 .

[61]  Theresa M. Glomb,et al.  Employer‐supported volunteering benefits: Gift exchange among employers, employees, and volunteer organizations , 2009 .

[62]  Peter M. Bentler,et al.  Practical Issues in Structural Modeling , 1987 .

[63]  William P. Dunlap,et al.  Partialling Factor Scores Does Not Control Method Variance: A Reply to Podsakoff and Todor , 1986 .

[64]  David Chan,et al.  So Why Ask Me? Are Self-Report Data Really That Bad? , 2009 .

[65]  D. Waldman,et al.  Charismatic leadership at the strategic level: A new application of upper echelons theory , 2004 .

[66]  T. Begley,et al.  Organizational level as a moderator of the relationship between justice perceptions and work-related reactions , 2006 .

[67]  Fred Luthans,et al.  Social Desirability Response Effects: Three Alternative Models , 1983 .

[68]  Jun Ye,et al.  Strategic Change Implementation and Performance Loss in the Front Lines , 2007 .