Vicarious Learning, Undersampling of Failure, and the Myths of Management

Organizations learn from other organizations. However, the observations available to them are typically a biased sample. The organizations that can be observed at any point in time are the survivors of a selective process that has eliminated a large fraction of the underlying population. In addition, there is a strong tendency to focus on successful organizations in books and the business press. As a result, the available sample of organizations usually undersamples failure. This paper shows that such undersampling of failure can contribute to a variety of false beliefs about effective management. Simply by observing existing organizations, laymen may get a misleading picture of the determinants of corporate performance. In particular, risky practices, even if they are unrelated to performance in the full population of organizations, may seem to be positively related to performance in a sample of survivors. I argue that this bias frequently implies that the organizational theories of managers and other observers of organizations will be systematically biased. Observations of existing organizations will show that unreliable, uninformed practices and practices that involve concentrated resource allocation are superior to reliable, informed practices or practices that involve diversified resource allocation. I show that this implies that observations of existing organizations will produce compelling but potentially misleading evidence for the significance several common managerial practices.

[1]  J. Cedarbaum Survival , 2004 .

[2]  Jesper B. Sørensen The Strength of Corporate Culture and the Reliability of Firm Performance , 2002 .

[3]  Pamela R. Haunschild,et al.  Network Learning: The Effects of Partners' Heterogeneity of Experience on Corporate Acquisitions , 2002 .

[4]  Chester S. Spell Management Fashions , 2001 .

[5]  J. March,et al.  Adaptation as Information Restriction: The Hot Stove Effect , 2001 .

[6]  Michael W. Macy,et al.  In Search of Excellence: Fads, Success Stories, and Adaptive Emulation1 , 2001, American Journal of Sociology.

[7]  J. Richard Harrison,et al.  Innovation and Industry Bifurcation: the Evolution of R&D Strategy , 2001 .

[8]  C. Zook Profit from the core , 2001 .

[9]  J. Ruiz Moreno [Organizational learning]. , 2001, Revista de enfermeria.

[10]  O. Sorenson The Effect of Population Level Learning on Market Entry : The American Automobile Industry , 1998 .

[11]  Steven Klepper,et al.  The Making of an Oligopoly: Firm Survival and Technological Change in the Evolution of the U.S. Tire Industry , 2000, Journal of Political Economy.

[12]  H. Rao,et al.  The Demography of Corporations and Industries , 1999 .

[13]  Henrich R. Greve,et al.  The Effect of Core Change on Performance: Inertia and Regression toward the Mean , 1999 .

[14]  D. Barron,et al.  The Structuring of Organizational Populations , 1999, American Sociological Review.

[15]  S. Finkelstein,et al.  The Influence of Organizational Acquisition Experience on Acquisition Performance: A Behavioral Learning Perspective , 1999 .

[16]  Anne S. Miner,et al.  Interorganizational Imitation: A Hidden Engine of Selection , 1999 .

[17]  L. Argote Organizational Learning: Creating, Retaining and Transferring Knowledge , 1999 .

[18]  Matthew S. Kraatz Learning by Association? Interorganizational Networks and Adaptation to Environmental Change , 1998 .

[19]  Leland K. Bassett Risk taking: A managerial perspective , 1998 .

[20]  J. Papastavrou,et al.  Accounting for Endogeneity When Assessing Strategy Performance: Does Entry Mode Choice Affect Fdi Survival , 1998 .

[21]  H. Greve Performance, Aspirations, and Risky Organizational Change , 1998 .

[22]  Carolyn Y. Woo,et al.  Survival of the Fittest? Entrepreneurial Human Capital and the Persistence of Underperforming Firms , 1997 .

[23]  Pamela R. Haunschild,et al.  Modes of Interorganizational Imitation: The Effects of Outcome Salience and Uncertainty , 1997 .

[24]  Daniel A. Levinthal Adaptation on rugged landscapes , 1997 .

[25]  Sten Jönsson Institutions and Organizations , 1997 .

[26]  W. P. Barnett,et al.  The Dynamics of Competitive Intensity , 1997 .

[27]  Tudor Rickards,et al.  Built to last: successful habits of visionary companies , 1997 .

[28]  James M. Utterback,et al.  Mastering the Dynamics of Innovation , 1996 .

[29]  Philip J. Cook,et al.  The Winner-Take-All Society: Why the Few at the Top Get So Much More Than the Rest of Us , 1996 .

[30]  Pamela R. Haunschild,et al.  FRUITS OF FAILURE: ORGANIZATIONAL FAILURE AND POPULATION LEVEL LEARNING. , 1996 .

[31]  Henrich R. Greve,et al.  Patterns of Competition: The Diffusion of a Market Position in Radio Broadcasting , 1996 .

[32]  Anne S. Miner,et al.  Ugly Duckling No More: Pasts and Futures of Organizational Learning Research , 1996 .

[33]  S. Klepper Entry, Exit, Growth, and Innovation over the Product Life Cycle , 1996 .

[34]  L. Palich,et al.  Using Cognitive Theory to Explain Entrepreneurial Risk-Taking: Challenging Conventional Wisdom , 1995 .

[35]  W. P. Barnett,et al.  MODELING INTERNAL ORGANIZATIONAL CHANGE , 1995 .

[36]  Richard E. Caves,et al.  The Dynamics of Industrial Competition: A North American Perspective , 1995 .

[37]  Christopher R. Blake,et al.  Survivorship Bias and Mutual Fund Performance , 1995 .

[38]  R. H. Waterman,et al.  In Search of Excellence: Lessons from America's Best-run Companies , 1995 .

[39]  Robert O. Keohane,et al.  Designing Social Inquiry: Scientific Inference in Qualitative Research. , 1995 .

[40]  W. P. Barnett,et al.  An Evolutionary Model of Organizational Performance , 1994 .

[41]  J. Mata,et al.  Life Duration of New Firms , 1994 .

[42]  Boyan Jovanovic,et al.  The Life Cycle of a Competitive Industry , 1993, Journal of Political Economy.

[43]  M. Sobel,et al.  Identification Problems in the Social Sciences , 1996 .

[44]  Daniel A. Levinthal,et al.  The myopia of learning , 1993 .

[45]  David J. Miller,et al.  The Architecture of Simplicity , 1993 .

[46]  G. Kunda,et al.  Engineering Culture: Control and Commitment in a High-Tech Corporation , 1993 .

[47]  G. Gordon,et al.  Predicting Corporate Performance From Organizational Culture , 1992 .

[48]  J. Kotter,et al.  Corporate Culture and Performance , 1992 .

[49]  J. Brüderl,et al.  Survival Chances of Newly Founded Business Organizations , 1992 .

[50]  S. Mezias,et al.  An Organizational Learning Model of Convergence and Reorientation , 1992 .

[51]  A. Pakes,et al.  The Dynamics of Productivity in the Telecommunications Equipment Industry , 1992 .

[52]  S. Sitkin Learning Through Failure : The Strategy of Small Losses , 1992 .

[53]  J. March,et al.  Variable risk preferences and the focus of attention , 1992 .

[54]  Christopher Winship,et al.  Models for Sample Selection Bias , 1992 .

[55]  Daniel A. Levinthal Random Walks and Organizational Mortality , 1991 .

[56]  Joel A. C. Baum,et al.  Institutional Linkages and Organizational Mortality , 1991 .

[57]  Daniel A. Levinthal,et al.  Honeymoons and the Liability of Adolescence: A New Perspective on Duration Dependence in Social and Organizational Relationships , 1991 .

[58]  G. Huber Organizational Learning: The Contributing Processes and the Literatures , 1991 .

[59]  T. Gilovich,et al.  How We Know What Isn't So: The Fallibility of Human Reason in Everyday Life , 1991 .

[60]  D. Denison,et al.  Corporate Culture and Organizational Effectiveness. , 1991 .

[61]  S. Mezias,et al.  MANAGING DISCONTINUOUS CHANGE: A SIMULATION STUDY OF ORGANIZATIONAL LEARNING AND ENTREPRENEURSHIP , 1990 .

[62]  Marshall W. Meyer,et al.  Permanently Failing Organizations. , 1991 .

[63]  K. Eisenhardt Agency Theory: An Assessment and Review , 1989 .

[64]  G. S. Saffold Culture Traits, Strength, and Organizational Performance: Moving Beyond “Strong” Culture , 1988 .

[65]  Robert Jacobsen,et al.  The persistence of abnormal returns , 1988 .

[66]  J. Kagan,et al.  Rational choice in an uncertain world , 1988 .

[67]  Dennis C. Mueller,et al.  Profits in the Long Run , 1987 .

[68]  M. Tushman,et al.  Technological Discontinuities and Organizational Environments , 1986 .

[69]  Nils Brunsson The Irrational Organization: Irrationality as a Basis for Organizational Action and Change , 1985 .

[70]  M. Hannan,et al.  Social Dynamics: Models and Methods. , 1986 .

[71]  B. Wernerfelt,et al.  Competitive Strategy Under Uncertainty. , 1984 .

[72]  M. Hannan,et al.  Structural Inertia and Organizational Change , 1984 .

[73]  P. Schmidt,et al.  Limited-Dependent and Qualitative Variables in Econometrics. , 1984 .

[74]  Baruch Fischhoff,et al.  Diagnosticity and pseudodiagnosticity. , 1983 .

[75]  G. Carroll,et al.  The Liability of Newness: Age Dependence in Organizational Death Rates , 1983 .

[76]  R. Berk An introduction to sample selection bias in sociological data. , 1983 .

[77]  G. Maddala Limited-dependent and qualitative variables in econometrics: Introduction , 1983 .

[78]  Pamela S. Tolbert,et al.  Institutional Sources of Change in the Formal Structure of Organizations: The Diffusion of Civil Service Reform, 1880-1935 , 1983 .

[79]  S. Winter,et al.  An evolutionary theory of economic change , 1983 .

[80]  S. Klepper,et al.  Time Paths in the Diffusion of Product Innovations , 1982 .

[81]  G. A. Miller,et al.  Book Review Nisbett, R. , & Ross, L.Human inference: Strategies and shortcomings of social judgment.Englewood Cliffs, N.J.: Prentice-Hall, 1980. , 1982 .

[82]  Gavin J. Wright An evolutionary theory of economic change , 1982 .

[83]  Hillel J. Einhorn,et al.  Judgment under uncertainty: Learning from experience and suboptimal rules in decision making , 1982 .

[84]  Daniel A. Levinthal,et al.  A model of adaptive organizational search , 1981 .

[85]  Boyan Jovanovic Selection and the evolution of industry , 1981 .

[86]  L. Ross,et al.  Human Inference: Strategies and Shortcomings of Social Judgment. , 1981 .

[87]  Timothy D. Wilson,et al.  Insensitivity to sample bias: Generalizing from atypical cases , 1980 .

[88]  B. Brehmer In one word: Not from experience. , 1980 .

[89]  William G. Ouchi,et al.  Markets, Bureaucracies, and Clans. , 1980 .

[90]  B. Loasby The External Control of Organizations. A Resource Dependence Perspective , 1979 .

[91]  A. Tversky,et al.  Prospect theory: analysis of decision under risk , 1979 .

[92]  J. Heckman Sample selection bias as a specification error , 1979 .

[93]  Robert N. Stern,et al.  The External Control of Organizations: A Resource Dependence Perspective. , 1979 .

[94]  R. Hogarth,et al.  Confidence in judgment: Persistence of the illusion of validity. , 1978 .

[95]  O. Williamson,et al.  Markets and Hierarchies: Analysis and Antitrust Implications. , 1977 .

[96]  John W. Meyer,et al.  Institutionalized Organizations: Formal Structure as Myth and Ceremony , 1977, American Journal of Sociology.

[97]  R. Richard Ritti,et al.  The Production of Cynical Knowledge in Organizations , 1977 .

[98]  M. Hannan,et al.  The Population Ecology of Organizations , 1977, American Journal of Sociology.

[99]  M. C. Jensen,et al.  Theory of the Firm , 1976 .

[100]  B. Fischhoff,et al.  Hindsight is not equal to foresight: The effect of outcome knowledge on judgment under uncertainty. , 1975 .

[101]  B. Fischhoff,et al.  I knew it would happen: Remembered probabilities of once—future things , 1975 .

[102]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[103]  H. Demsetz Industry Structure, Market Rivalry, and Public Policy , 1973, The Journal of Law and Economics.

[104]  Jay R. Galbraith Designing Complex Organizations , 1973 .

[105]  E. Prescott,et al.  Investment Under Uncertainty , 1971 .

[106]  P. Lawrence,et al.  Organization and environment , 1967 .

[107]  J. Smedslund THE CONCEPT OF CORRELATION IN ADULTS , 1963 .

[108]  J. Thoday Population Genetics , 1956, Nature.

[109]  W. G. Cochran,et al.  Improvement by Means of Selection , 1951 .