The Role of Sampling in Strategic Management Research on Performance: A Two-Study Analysis

Strategic management researchers often note the inability of many phenomena to consistently explain organizational performance. Using a two-study format, we examine the possibility that sampling practices may contribute to this inability. We chronicle sampling practices within 437 studies investigating the determinants of organizational performance published between 1980 and 1999 in the Academy of Management Journal, Administrative Science Quarterly, Journal of Management, Organization Science, and Strategic Management Journal. Our results reveal that fewer than one in five studies rely on a random sample and that researchers offer little a priori acknowledgement of sample limitations. Although the first study suggests that sampling issues have been problematic, it cannot offer direct evidence. Thus, in the second study, we examine the effect of sample selection on empirical results by testing one popular relationship from the strategy literature (chief executive officer duality and performance) using fou...

[1]  Barbara W. Keats,et al.  A Causal Model of Linkages Among Environmental Dimensions, Macro Organizational Characteristics, and Performance , 1988 .

[2]  Graham Kalton,et al.  Introduction to Survey Sampling , 1983 .

[3]  Charles R. Schwenk,et al.  TOP MANAGEMENT TEAM STRATEGIC CONSENSUS, DEMOGRAPHIC HOMOGENEITY AND FIRM PERFORMANCE: A REPORT OF RESOUNDING NONFINDINGS , 1996 .

[4]  S. Finkelstein,et al.  Top Management Team Size, CEO Dominance, and firm Performance: The Moderating Roles of Environmental Turbulence and Discretion , 1993 .

[5]  Paula L. Rechner,et al.  CEO duality and organizational performance: A longitudinal analysis , 1991 .

[6]  Richard A. Bettis,et al.  Strategic Management and the Straightjacket: An Editorial Essay , 1991 .

[7]  Howard E. Aldrich,et al.  Comparing Organizational Sampling Frames , 1990 .

[8]  A. Zaheer,et al.  Does Trust Matter? Exploring the Effectsof Interorganizational and Interpersonaltrust on Performance , 1998 .

[9]  B. McKelvey.  Guidelines for the Empirical Classification of Organizations. , 1975 .

[10]  M. Lubatkin,et al.  Relative standing and the performance of recently acquired European firms , 1997 .

[11]  Henry Mintzberg,et al.  Tracking Strategy in an Entrepreneurial Firm1 , 1982 .

[12]  Marc J. Dollinger,et al.  Interorganizational and Collective Strategies in Small Firms: Environmental Effects and Performance , 1992 .

[13]  L. Vogel,et al.  Strategy and Structure , 1986 .

[14]  Lex Donaldson,et al.  Stewardship Theory or Agency Theory: CEO Governance and Shareholder Returns , 1991 .

[15]  Joseph T. Mahoney,et al.  An empirical investigation of the effect of corporate charter antitakeover amendments on stockholder wealth , 1993 .

[16]  Donald D. Bergh,et al.  Problems with Repeated Measures Analysis: Demonstration with A Study of the Diversification and Performance Relationship , 1995 .

[17]  Robert E. Hoskisson,et al.  Strategic groups: Untested assertions and research proposals , 1990 .

[18]  J. L. Stimpert,et al.  Seeing The Big Picture: The Influence Of Industry, Diversification, And Business Strategy On Performance , 1997 .

[19]  W Q Judge,et al.  Antecedents and Outcomes of Decision Speed in Different Environmental Contexts , 1991, Academy of Management journal. Academy of Management.

[20]  John E. Hunter,et al.  Methods of Meta-Analysis: Correcting Error and Bias in Research Findings , 1991 .

[21]  A. Tahai,et al.  A revealed preference study of management journals' direct influences , 1999 .

[22]  Jacob Cohen,et al.  A power primer. , 1992, Psychological bulletin.

[23]  David Rogers,et al.  Selecting Samples of Organizations , 1982 .

[24]  K. Weick.  The social psychology of organizing , 1969 .

[25]  J. Dutton,et al.  Advances in strategic management , 1994 .

[26]  Sanjay Sharma.  Managerial Interpretations and Organizational Context as Predictors of Corporate Choice of Environmental Strategy , 2000 .

[27]  R. Rumelt.  Strategy, structure, and economic performance , 1974 .

[28]  Michael Dowling,et al.  Cooperative strategy and new venture performance: The role of business strategy and management experience , 1995 .

[29]  Brian K. Boyd,et al.  CEO DUALITY AND FIRM PERFORMANCE: A CONTINGENCY MODEL , 1995 .

[30]  Richard L. Scheaffer,et al.  Elementary Survey Sampling , 1971 .

[31]  Rachel Davis,et al.  Diversification, vertical integration, and industry analysis: New perspectives and measurement , 1992 .

[32]  A. Huff,et al.  STRATEGIC GROUPS: A COGNITIVE PERSPECTIVE , 1993 .

[33]  Michael Lubatkin,et al.  Diversification, Systematic Risk, and Shareholder Return: A Capital Market Extension of Rumelt's 1974 Study , 1989 .

[34]  E. Fama,et al.  Separation of Ownership and Control , 1983, The Journal of Law and Economics.

[35]  J. Fredrickson,et al.  TOP MANAGEMENT TEAM AGREEMENT ABOUT THE STRATEGIC DECISION PROCESS: A TEST OF SOME OF ITS DETERMINANTS AND CONSEQUENCES , 1997 .

[36]  R. Daft,et al.  Can Organization Studies Begin to Break Out of the Normal Science Straitjacket? An Editorial Essay , 1990 .

[37]  G. T. Lumpkin,et al.  Simplicity as a Strategy-Making Process: The Effects of Stage of Organizational Development and Environment on Performance , 1995 .

[38]  Donald D. Bergh,et al.  Assessment and redirection of longitudinal analysis : Demonstration with a study of the diversification and divestiture relationship , 1997 .

[39]  B. McKelvey.  Organizational Systematics-Taxonomy, Evolution, Classification , 1982 .

[40]  Karel Cool,et al.  Rivalry, Strategic Groups and Firm Profitability , 1993 .

[41]  John H. Grant,et al.  Doctoral Education in the Field of Business Policy and Strategy , 1990 .

[42]  K BoydB.  CEO(経営執行役員)の二元性と企業業績 状況適応型モデル , 1995 .

[43]  Daniel E. Vetter,et al.  Replication in strategic management: scientific testing for validity, generalizability, and usefulness , 1998 .

[44]  Masoud Hemmasi,et al.  Assessment of statistical power in contemporary strategy research , 1987 .

[45]  J. Hair.  Multivariate data analysis , 1972 .

[46]  T. Cook,et al.  Quasi-experimentation: Design & analysis issues for field settings , 1979 .

[47]  T. Jick.  Mixing Qualitative and Quantitative Methods: Triangulation in Action. , 1979 .

[48]  John E. Delery,et al.  Modes of theorizing in strategic human resource management: Tests of universalistic, contingency, and configurational performance predictions , 1996 .

[49]  M. C. Jensen,et al.  Harvard Business School; SSRN; National Bureau of Economic Research (NBER); European Corporate Governance Institute (ECGI); Harvard University - Accounting & Control Unit , 1976 .

[50]  Laura B. Cardinal,et al.  Curvilinearity in the diversification–performance linkage: an examination of over three decades of research , 2000 .

[51]  David P. Boyd,et al.  A Comparison of Entrepreneurs and Managers of Small Business Firms , 1987 .

[52]  David J. Ketchen,et al.  Organizational configurations and performance: the role of statistical power in extant research , 1999 .

[53]  Howard B. Lee,et al.  Foundations of Behavioral Research , 1973 .

[54]  Donald D. Bergh,et al.  Watch the Time Carefully: The Use and Misuse of Time Effects in Management Research , 1993 .

[55]  Jonathan L. Johnson,et al.  META-ANALYTIC REVIEWS OF BOARD COMPOSITION, LEADERSHIP STRUCTURE, AND FINANCIAL PERFORMANCE , 1998 .