Ideal, nonideal, and no-marker variables: The confirmatory factor analysis (CFA) marker technique works when it matters.

A persistent concern in the management and applied psychology literature is the effect of common method variance on observed relations among variables. Recent work (i.e., Richardson, Simmering, & Sturman, 2009) evaluated 3 analytical approaches to controlling for common method variance, including the confirmatory factor analysis (CFA) marker technique. Their findings indicated significant problems with this technique, especially with nonideal marker variables (those with theoretical relations with substantive variables). Based on their simulation results, Richardson et al. concluded that not correcting for method variance provides more accurate estimates than using the CFA marker technique. We reexamined the effects of using marker variables in a simulation study and found the degree of error in estimates of a substantive factor correlation was relatively small in most cases, and much smaller than error associated with making no correction. Further, in instances in which the error was large, the correlations between the marker and substantive scales were higher than that found in organizational research with marker variables. We conclude that in most practical settings, the CFA marker technique yields parameter estimates close to their true values, and the criticisms made by Richardson et al. are overstated.

[1]  Robert E. Ployhart,et al.  Multilevel Influences on Voluntary Workplace Green Behavior: Individual Differences, Leader Behavior, and Coworker Advocacy , 2017 .

[2]  Crystal X. Jiang,et al.  Examining the Complementary Effect of Political Networking Capability With Absorptive Capacity on the Innovative Performance of Emerging-Market Firms , 2017 .

[3]  P. Harms,et al.  Does it take two to Tangle? Subordinates’ Perceptions of and Reactions to Abusive Supervision , 2015 .

[4]  A. Engelen,et al.  Enemy or friend? The cultural impact of cross-functional behavior on the EO–performance link , 2015 .

[5]  Y. Connie Yuan,et al.  The Roles and Interplay of Intragroup Conflict and Team Emotion Management on Information Seeking Behaviors in Team Contexts , 2015, Commun. Res..

[6]  G. Notelaers,et al.  Implications of Family Business Employment for Employees’ Innovative Work Involvement , 2015 .

[7]  R. Morgan,et al.  Why people quit: Explaining employee turnover intentions among export sales managers , 2015 .

[8]  Lis Senta Strenger,et al.  Entrepreneurial Orientation, Firm Performance, and the Moderating Role of Transformational Leadership Behaviors , 2015 .

[9]  A. Tumasjan,et al.  Do Business Ethics Pay Off , 2015 .

[10]  Aron O'Cass,et al.  The role of intellectual resources, product innovation capability, reputational resources and marketing capability combinations in firm growth , 2014 .

[11]  Priit Vahter,et al.  Learning from openness: The dynamics of breadth in external innovation linkages , 2014 .

[12]  D. Griffith,et al.  The performance effects of vertical and horizontal subsidiary knowledge outflows in multinational corporations , 2014 .

[13]  Benno Torgler,et al.  Superstars as drivers of organizational identification : empirical findings from professional soccer , 2014 .

[14]  D. Harrison,et al.  Adaptation to Temporal Shocks: Influences of Strategic Interpretation and Spatial Distance , 2014 .

[15]  James Agarwal,et al.  Erratum to: Corporate Reputation Measurement: Alternative Factor Structures, Nomological Validity, and Organizational Outcomes , 2014 .

[16]  Jennica R. Webster,et al.  Core Work Evaluation: The Viability of a Higher-order Work Attitude Construct , 2014 .

[17]  Yau-De Wang,et al.  Employees' reactions to psychological contract breach: A moderated mediation analysis , 2014 .

[18]  Christian Homburg,et al.  Internal and external price search in industrial buying: The moderating role of customer satisfaction , 2014 .

[19]  Dirk De Clercq,et al.  Servant Leadership and Work Engagement: The Contingency Effects of Leader–Follower Social Capital , 2014 .

[20]  Gianfranco Walsh,et al.  Impact of Customer‐Based Corporate Reputation on Non‐Monetary and Monetary Outcomes: The Roles of Commitment and Service Context Risk , 2014 .

[21]  M. Lin,et al.  Knowledge Creation and New Product Performance: The Role of Creativity , 2014 .

[22]  Lihua Yang,et al.  Firm capability and performance in China: The moderating role of guanxi and institutional forces in domestic and foreign contexts , 2014 .

[23]  Felix T Mavondo,et al.  Performance or learning goal orientation: Implications for business performance , 2014 .

[24]  Adam Rapp,et al.  Feeling Good by Doing Good: Employee CSR-Induced Attributions, Job Satisfaction, and the Role of Charismatic Leadership , 2013 .

[25]  F. Evangelista,et al.  Does it pay for firms in Asia's emerging markets to be market oriented? Evidence from Vietnam , 2013 .

[26]  Junfeng Zhang,et al.  Social capital and new product development outcomes: The mediating role of sensing capability in Chinese high-tech firms , 2013 .

[27]  L. Ngo,et al.  Innovation and business success: The mediating role of customer participation , 2013 .

[28]  Pinar Bayhan Karapinar,et al.  The mediating effects of emotional exhaustion cynicism and learned helplessness on organizational justice-turnover intentions linkage. , 2013 .

[29]  Scott D. Swain,et al.  Corporate Social Responsibility, Customer Orientation, and the Job Performance of Frontline Employees , 2013 .

[30]  Michael T. Krush,et al.  Enhancing organizational sensemaking: An examination of the interactive effects of sales capabilities and marketing dashboards , 2013 .

[31]  K. Sengupta,et al.  Knowledge management and innovation performance in a high-tech SMEs industry , 2013 .

[32]  Todd C. Darnold,et al.  Perceived leader integrity: Supporting the construct validity and utility of a multi-dimensional measure in two samples , 2013 .

[33]  Caren B. Goldberg,et al.  Antecedents and outcomes of targeting older applicants in recruitment , 2013 .

[34]  Dan S. Chiaburu,et al.  Employees' motivation for personal initiative: The joint influence of status and communion striving , 2013 .

[35]  Pankaj C. Patel,et al.  Measuring entrepreneurial passion: Conceptual foundations and scale validation , 2013 .

[36]  Christina W.Y. Wong,et al.  Leveraging Environmental Information Integration to Enable Environmental Management Capability and Performance , 2013 .

[37]  Christina W. Y. Wong,et al.  Green Service Practices: Performance Implications and the Role of Environmental Management Systems , 2013 .

[38]  K. Sanders,et al.  Employee perceptions of management relations as influences on job satisfaction and quit intentions , 2013 .

[39]  Cecily D. Cooper,et al.  Making things happen through challenging goals: leader proactivity, trust, and business-unit performance. , 2013, The Journal of applied psychology.

[40]  V. Story,et al.  Entrepreneurial orientation and market orientation as drivers of product innovation success: A study of exporters from a developing economy , 2013 .

[41]  Jeffrey J. Haynie,et al.  A combined model of uncertainty management theory and the group engagement model of identity , 2013 .

[42]  R Deepa,et al.  Controlling Common Method Variance while Measuring the Impact of Emotional Intelligence on Well-being , 2013 .

[43]  Shijin Yoo,et al.  Paths to Success: How Do Market Orientation and Entrepreneurship Orientation Produce New Product Success? , 2013 .

[44]  C. Fritz,et al.  Don't Interrupt Me! An Examination of the Relationship Between Intrusions at Work and Employee Strain , 2013 .

[45]  Won‐Woo Park,et al.  Work status, gender, and organizational commitment among Korean workers: The mediating role of person-organization fit , 2012 .

[46]  Rolf van Dick,et al.  How do transformational leaders foster positive employee outcomes? A self-determination-based analysis of employees' needs as mediating links† , 2012 .

[47]  K. Lai,et al.  Green operations and the moderating role of environmental management capability of suppliers on manufacturing firm performance , 2012 .

[48]  P. Whiteley,et al.  Leaders' conceptions of followers: Implications for naturally occurring Pygmalion effects , 2012 .

[49]  V. Story,et al.  Complementary effect of entrepreneurial and market orientations on export new product success under differing levels of competitive intensity and financial capital , 2012 .

[50]  Natalia Martin-Cruz,et al.  Influence of Affective Traits on Entrepreneur's Goals and Satisfaction , 2012 .

[51]  A. Salter,et al.  Open for Ideation: Individual-level Openness and Idea Generation in R&D , 2012 .

[52]  Upasna A. Agarwal,et al.  Linking LMX, innovative work behaviour and turnover intentions , 2012 .

[53]  J. Sarros,et al.  The impact of organizational culture and social desirability on Australian CEO leadership , 2012 .

[54]  Kevin Zheng Zhou,et al.  Governing interfirm knowledge transfer in the Chinese market: The interplay of formal and informal mechanisms , 2012 .

[55]  Cristiana Raquel Lages,et al.  Key Drivers of Frontline Employee Generation of Ideas for Customer Service Improvement , 2012 .

[56]  Óscar Martín Martín,et al.  Knowledge ambiguity, innovation and subsidiary performance , 2012 .

[57]  C. Hallin,et al.  Revisiting the external impact of MNCs: An empirical study of the mechanisms behind knowledge spillovers from MNC subsidiaries , 2012 .

[58]  M. Forsgren,et al.  Headquarters involvement and efficiency of innovation development and transfer in multinationals : A matter of sheer ignorance? , 2012 .

[59]  A. Bakker,et al.  Motivating Employees to Work Beyond Retirement: A Multi‐Level Study of the Role of I‐Deals and Unit Climate , 2012 .

[60]  Marshall J. Magnusen,et al.  Differential effects of identification on extra‐role behavior , 2012 .

[61]  Deborah L Bandalos,et al.  Simulation Methods in Structural Equation Modeling , 2012 .

[62]  Larisa Niedle A Comparison of LMX, Communication, and Demographic Differences in Remote and Co-located Supervisor-Subordinate Dyads , 2012 .

[63]  Scott B. MacKenzie,et al.  Working memory: theories, models, and controversies. , 2012, Annual review of psychology.

[64]  D. Gann,et al.  The Effects of Culture and Structure on Strategic Flexibility During Business Model Innovation , 2012 .

[65]  L. Ngo,et al.  Examining the Firm's Value Creation Process: A Managerial Perspective of the Firm's Value Offering Strategy and Performance , 2011 .

[66]  Dan S. Chiaburu,et al.  Does Psychological Contract Breach Decrease Proactive Behaviors? The Moderating Effect of Emotion Regulation , 2011 .

[67]  Andreas Kuckertz,et al.  Exploration and Exploitation Strategies, Profit Performance, and the Mediating Role of Strategic Learning: Escaping the Exploitation Trap , 2011 .

[68]  Francesco Ciabuschi,et al.  Internal Embeddedness, Headquarters Involvement, and Innovation Importance in Multinational Enterprises , 2011 .

[69]  M. Kotabe,et al.  Reducing distributor opportunism in the export market: Effects of monitoring mechanisms, norm-based information exchange, and market orientation , 2011 .

[70]  Choton Basu,et al.  The innovativeness of Born-Globals and customer orientation: Learning from Indian Born-Globals , 2011 .

[71]  Christopher C. Rosen,et al.  Assessing the impact of common method variance on higher order multidimensional constructs. , 2011, The Journal of applied psychology.

[72]  Fernando Jaramillo,et al.  Workplace Stressors, Job Attitude, and Job Behaviors: Is Interpersonal Conflict the Missing Link? , 2011 .

[73]  Katherine M White,et al.  Predicting employee intentions to support organizational change: an examination of identification processes during a re-brand. , 2011, The British journal of social psychology.

[74]  Harjinder Gill,et al.  Antecedents of trust in supervisors, subordinates, and peers , 2011 .

[75]  S. Birken Where the rubber meets the road: A mixed-method study of middle managers' role in innovation implementation in health care organizations , 2011 .

[76]  Jane Webster,et al.  Relational Outcomes of Multicommunicating: Integrating Incivility and Social Exchange Perspectives , 2011, Organ. Sci..

[77]  Anthony R. Wheeler,et al.  The mediating role of organizational job embeddedness in the LMX-outcomes relationships , 2011 .

[78]  C. Tillman CHARACTER, CONDITIONS, AND COGNITIONS: THE ROLE OF PERSONALITY, CLIMATE, INTENSITY, AND MORAL DISENGAGEMENT IN THE UNETHICAL DECISION-MAKING PROCESS , 2011 .

[79]  Philippe Jacquart,et al.  On making causal claims: A review and recommendations , 2010 .

[80]  Douglas R. Vogel,et al.  Can learning be virtually boosted? An investigation of online social networking impacts , 2010, Comput. Educ..

[81]  Bilal Bin Saeed,et al.  Subordinate’s trust in the supervisor and its impact on organizational effectiveness , 2010 .

[82]  Nerina L. Jimmieson,et al.  Team change climate: A group-level analysis of the relationships among change information and change participation, role stressors, and well-being , 2010 .

[83]  J. Edwards,et al.  The Presence of Something or the Absence of Nothing: Increasing Theoretical Precision in Management Research , 2010 .

[84]  David Jobber,et al.  Measuring State, Effect, and Response Uncertainty: Theoretical Construct Development and Empirical Validation , 2010 .

[85]  Paul E. Spector,et al.  Common Method Issues: An Introduction to the Feature Topic in Organizational Research Methods , 2010 .

[86]  James Blustein,et al.  A conceptual model for dimensions impacting employees' participation in enterprise social tagging , 2010, MSM '10.

[87]  Nathan S. Hartman,et al.  Method Variance and Marker Variables: A Review and Comprehensive CFA Marker Technique , 2010 .

[88]  Nathan A. Bowling,et al.  Effects of Job Satisfaction and Conscientiousness on Extra-Role Behaviors , 2010 .

[89]  K. W. Mossholder,et al.  Examining the effects of trust in leaders: A bases-and-foci approach☆ , 2010 .

[90]  N. Jimmieson,et al.  Self-Determination as a Moderator of Demands and Control: Implications for Employee Strain and Engagement. , 2010 .

[91]  J. Bustamante Investigating the effects of racioethnic diversity on organizational outcomes: The mediating role of social capital and the moderating role of diversity climate , 2010 .

[92]  Karoline Strauss,et al.  Proactivity Directed Toward the Team and Organization: The Role of Leadership, Commitment and Role-Breadth Self-Efficacy , 2009 .

[93]  Lynne Andersson,et al.  Top management credibility and employee cynicism: A comprehensive model , 2009 .

[94]  Anju Mehta Examining the role of personal, social exchange, and contextual fit variables in employee work outcomes under continuous change: A field investigation , 2009 .

[95]  Jixia Yang,et al.  Supervisory procedural justice effects: The mediating roles of cognitive and affective trust , 2009 .

[96]  Marcia J. Simmering,et al.  A Tale of Three Perspectives , 2009 .

[97]  Theresa M. Glomb,et al.  Employer‐supported volunteering benefits: Gift exchange among employers, employees, and volunteer organizations , 2009 .

[98]  Dan J. Putka,et al.  The Multifaceted Nature of Measurement Artifacts and Its Implications for Estimating Construct-Level Relationships , 2009 .

[99]  J. Dawson,et al.  The impact of leadership and quality climate on hospital performance. , 2008, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[100]  A. Tiwana Does technological modularity substitute for control? A study of alliance performance in software outsourcing , 2008 .

[101]  Katherine M. White,et al.  Utilizing the Theory of Planned Behavior to Inform Change Management , 2008 .

[102]  Lucy R. Ford,et al.  Basic and Advanced Measurement Models for Confirmatory Factor Analysis , 2008 .

[103]  I. Densten,et al.  How leaders woo followers in the romance of leadership , 2007 .

[104]  Jeremy B. Bernerth,et al.  Is personality associated with perceptions of LMX? An empirical study , 2007 .

[105]  Jeremy B. Bernerth,et al.  Justice, Cynicism, and Commitment , 2007 .

[106]  J. Benson,et al.  Understanding performance appraisal fairness , 2007 .

[107]  R. Goffin,et al.  The self‐rater's personality and self‐other disagreement in multi‐source performance ratings: Is disagreement healthy? , 2007 .

[108]  Thomas J. Housel,et al.  Leveraging Competence in the Use of Leveraging Collaborative Tools Competence: Facilitating an Open Architecture Approach to Acquiring Integrated Warfare Systems , 2006 .

[109]  J. Poon,et al.  Trust‐in‐supervisor and helping coworkers: moderating effect of perceived politics , 2006 .

[110]  Paul E. Spector Method Variance in Organizational Research , 2006 .

[111]  Mark A. Griffin,et al.  Refining individualized consideration: Distinguishing developmental leadership and supportive leadership , 2006 .

[112]  J. Poon,et al.  TRUST-IN-SUPERVISOR: ANTECEDENTS AND EFFECT ON AFFECTIVE ORGANIZATIONAL COMMITMENT , 2006 .

[113]  Bradley J. Alge,et al.  Information privacy in organizations: empowering creative and extrarole performance. , 2006, The Journal of applied psychology.

[114]  Adam W. Meade,et al.  A Monte Carlo Investigation of Assessment Center Construct Validity Models , 2007 .

[115]  Steven P. Brown,et al.  On the use of beta coefficients in meta-analysis. , 2005, The Journal of applied psychology.

[116]  Steven E. Scullen,et al.  Bias in the Correlated Uniqueness Model for MTMM Data , 2004 .

[117]  D. Waldman,et al.  Charismatic leadership at the strategic level: A new application of upper echelons theory , 2004 .

[118]  M. Griffin,et al.  Dimensions of transformational leadership: Conceptual and empirical extensions , 2004 .

[119]  Scott B. MacKenzie,et al.  Common method biases in behavioral research: a critical review of the literature and recommended remedies. , 2003, The Journal of applied psychology.

[120]  M. Lindell,et al.  Accounting for common method variance in cross-sectional research designs. , 2001, The Journal of applied psychology.

[121]  A. Boomsma,et al.  Robustness Studies in Covariance Structure Modeling , 1998 .

[122]  Larry J. Williams,et al.  Method Variance in Organizational Behavior and Human Resources Research: Effects on Correlations, Path Coefficients, and Hypothesis Testing , 1994 .

[123]  John E. Hunter,et al.  Methods of Meta-Analysis: Correcting Error and Bias in Research Findings , 1991 .

[124]  H. Marsh,et al.  Confirmatory Factor Analyses of Multitrait-Multimethod Data: A Comparison of Alternative Models , 1991 .

[125]  P. Meehl Appraising and Amending Theories: The Strategy of Lakatosian Defense and Two Principles that Warrant It , 1990 .

[126]  H. Marsh Confirmatory Factor Analyses of Multitrait-Multimethod Data: Many Problems and a Few Solutions , 1989 .

[127]  P. M. Podsakoff,et al.  Self-Reports in Organizational Research: Problems and Prospects , 1986 .

[128]  C Loehlin John,et al.  Latent variable models: an introduction to factor, path, and structural analysis , 1986 .

[129]  William R. Darden,et al.  Causal Models in Marketing , 1980 .

[130]  D. A. Kenny,et al.  Correlation and causality , 1979 .

[131]  Karl G. Jöreskog,et al.  Analyzing psychological data by structural analysis of covariance matrices , 1974 .

[132]  K. G. Jöreskog,et al.  Statistical analysis of sets of congeneric tests , 1971 .

[133]  D. Lykken Statistical significance in psychological research. , 1968, Psychological bulletin.