Control Variable Use and Reporting in Macro and Micro Management Research

This study explores the use of control variables in management research, as reflected in both macro and micro management studies published in four leading management journals. Based on a review of 812 empirical articles published from 2005 to 2009—a much larger sample than was employed by earlier studies of control variables—the authors make several important observations. One key finding is that, given it is not at all uncommon for the control variables included in studies to account for more variance than the main effects, it is surprising how infrequently adequate justification for inclusion is provided. In addition, even when justification is provided, often no expectation of the nature of the relationship between control and dependent variables is offered. The authors also make several recommendations for both authors and reviewers. The most important may be to avoid simple mimicry of others and think more deeply about the theoretical foundation for the control variables included in empirical studies.

[1]  Paul E. Spector,et al.  Methodological Urban Legends: The Misuse of Statistical Control Variables , 2011 .

[2]  H. Commandeur,et al.  Value Creation and Value Claiming in Strategic Outsourcing Decisions: A Resource Contingency Perspective , 2009 .

[3]  J. Breaugh.  Important considerations in using statistical procedures to control for nuisance variables in non-experimental studies , 2008 .

[4]  J. F. Veiga,et al.  The impact of professional isolation on teleworker job performance and turnover intentions: does time spent teleworking, interacting face-to-face, or having access to communication-enhancing technology matter? , 2008, The Journal of applied psychology.

[5]  David J. Ketchen,et al.  Research Methodology in Strategic Management , 2008 .

[6]  Sze-Sze Wong,et al.  A Power Perspective to Interunit Knowledge Transfer: Linking Knowledge Attributes to Unit Power and the Transfer of Knowledge , 2008 .

[7]  Julie B. Olson-Buchanan,et al.  The Use of Communication Technologies After Hours: The Role of Work Attitudes and Work-Life Conflict , 2007 .

[8]  J. Breaugh,et al.  Controlling Nuisance Variables by Using a Matched-Groups Design , 2007 .

[9]  James A. Breaugh,et al.  Rethinking the Control of Nuisance Variables in Theory Testing , 2006 .

[10]  R. Keller,et al.  Transformational leadership, initiating structure, and substitutes for leadership: a longitudinal study of research and development project team performance. , 2006, The Journal of applied psychology.

[11]  Thomas E. Becker.  Potential Problems in the Statistical Control of Variables in Organizational Research: A Qualitative Analysis With Recommendations , 2005 .

[12]  M. Bolino,et al.  The personal costs of citizenship behavior: the relationship between individual initiative and role overload, job stress, and work-family conflict. , 2005, The Journal of applied psychology.

[13]  D. Mackinnon,et al.  Equivalence of the Mediation, Confounding and Suppression Effect , 2000, Prevention Science.

[14]  Donald P. Schwab,et al.  Research Methods for Organizational Studies , 1998 .

[15]  John W. Meyer,et al.  Institutional Environments and Organizations: Structural Complexity and Individualism , 1994 .

[16]  W. Paul Vogt,et al.  The SAGE Dictionary of Statistics & Methodology: A Nontechnical Guide for the Social Sciences , 2015 .

[17]  J. George,et al.  The role of negative affectivity in understanding relations between self-reports of stressors and strains: a comment on the applied psychology literature. , 1993, The Journal of applied psychology.

[18]  Deborah G. . Ancona,et al.  Demography and Design: Predictors of New Product Team Performance , 1992 .

[19]  Elazar J. Pedhazur,et al.  Measurement, Design, and Analysis: An Integrated Approach , 1994 .

[20]  B. Bass.  Bass & Stogdill's handbook of leadership: Theory, research, and managerial applications, 3rd ed. , 1990 .

[21]  B. Tabachnick,et al.  Using Multivariate Statistics , 1983 .

[22]  Morgan W. McCall,et al.  Stogdill's Handbook of Leadership , 1982 .

[23]  T. Cook,et al.  Quasi-experimentation: Design & analysis issues for field settings , 1979 .

[24]  J. Pfeffer,et al.  The External Control of Organizations. , 1978 .

[25]  Paul E. Meehl,et al.  High school yearbooks: A reply to Schwarz. , 1971 .

[26]  Leslie Kish,et al.  Some Statistical Problems in Research Design , 1959 .

[27]  W. Powell,et al.  The iron cage revisited institutional isomorphism and collective rationality in organizational fields , 1983 .