Avoiding Complexity Catastrophe in Coevolutionary Pockets: Strategies for Rugged Landscapes

Can firms and coevolutionary groups suffer from too much interdependent complexity? Is complexity theory an alternative explanation to competitive selection for the emergent order apparent in coevolutionary industry groups? The biologist Stewart Kauffman suggests a theory of complexity catastrophe offering universal principles explaining phenomena normally attributed to Darwinian natural selection theory. Kauffman's complexity theory seems to apply equally well to firms in coevolutionary pockets. Based on complexity theory, four kinds of complexity are identified. Kauffman's "NK[C] model" is positioned "at the edge of chaos" between complexity driven by "Newtonian" simple rules and rule-driven deterministic chaos. Kauffman's insight, which is the basis of the findings in this paper, is that complexity is both a consequence and a cause. Multicoevolutionary complexity in firms is defined by moving natural selection processes inside firms and down to a "parts" level of analysis, in this instance Porter's value chain level, to focus on microstate activities by agents. The assumptions of stochastically idiosyncratic microstates and coevolution in firms are analyzed. Competitive advantage, as a dependent variable, is defined in terms of Nash equilibrium fitness levels. This allows a translation of Kauffman's theory to firms, paying particular attention to (1) how value chain landscapes might be modeled, (2) assumptions underlying Kauffman's models making them amenable to firms, and (3) a delineation of seven of Kauffman's computational experiments. As part of the translation, possible parallels between the application of complexity catastrophe theory to coevolutionary pockets and studies by institutional theorists and social network analysts are discussed. The models derive from spin-glass microstate models resulting in Boolean games. Kauffman's Boolean statistical mechanics is introduced in developing the logic underlying the somewhat simplified NKM[C] model. The model allows the use of computational experiments to better understand how the dependent variable-value chain fitness-is affected by changes in the number of internal interdependencies K, the number of coevolutionary links with opponents C, the size of the coevolutionary pocket S, and the number of simultaneous adaptive changes, among other things. Various computational experiments are presented that suggest strategic organizing approaches most likely to foster competitive advantage. High or low Nash equilibrium fitness levels are shown to result from internal and external coevolutionary densities as a function of links among value chain competencies within a firm and between a firm and an opponent. Complexity phenomena appear to suggest a number of expected (and thus validating) and surprising strategies with respect to complex organizational interdependencies. For example, moderate complexity fares best and external coevolutionary complexity sets an upper bound to advantages likely to be gained from internal complexity. Various complexity "lessons" are discussed. Models such as the NK[C] could offer insights into strategic organizing.

[1]  W. Powell,et al.  The iron cage revisited institutional isomorphism and collective rationality in organizational fields , 1983 .

[2]  S. Wright,et al.  Evolution in Mendelian Populations. , 1931, Genetics.

[3]  E. Schrödinger What is life? : the physical aspect of the living cell , 1944 .

[4]  Philip Selznick TVA and the grass roots , 1949 .

[5]  A. Alchian Uncertainty, Evolution, and Economic Theory , 1950, Journal of Political Economy.

[6]  Milton Friedman,et al.  Essays in Positive Economics , 1954 .

[7]  Amitai Etzioni,et al.  A Comparative Analysis of Complex Organizations. , 1962 .

[8]  Charles Perrow,et al.  THE ANALYSIS OF GOALS IN COMPLEX ORGANIZATIONS , 1961 .

[9]  James D. Thompson Organizations in Action , 1967 .

[10]  A. Stinchcombe Constructing Social Theories , 1970 .

[11]  Michael X Cohen,et al.  A Garbage Can Model of Organizational Choice. , 1972 .

[12]  J. Child Organizational Structure, Environment and Performance: The Role of Strategic Choice , 1972 .

[13]  A. L. Bertrand,et al.  The Theory of Organizations. , 1972 .

[14]  J. Eugene Haas,et al.  Complex Organizations: A Sociological Perspective , 1973 .

[15]  S. Kauffman The large scale structure and dynamics of gene control circuits: an ensemble approach. , 1974, Journal of theoretical biology.

[16]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[17]  Henry Mintzberg,et al.  The Structure of "Unstructured" Decision Processes , 1976 .

[18]  J. Roughgarden Resource partitioning among competing species--a coevolutionary approach. , 1976, Theoretical population biology.

[19]  M. Hannan,et al.  The Population Ecology of Organizations , 1977, American Journal of Sociology.

[20]  Richard H. Hall,et al.  Organizations: Structure and process , 1977 .

[21]  M. Porter,et al.  From Entry Barriers to Mobility Barriers: Conjectural Decisions and Contrived Deterrence to New Competition , 1977 .

[22]  J. Hirshleifer Economics from a Biological Viewpoint , 1977, The Journal of Law and Economics.

[23]  M. Eigen,et al.  The hypercycle. A principle of natural self-organization. Part A: Emergence of the hypercycle. , 1977, Die Naturwissenschaften.

[24]  Mark S. Granovetter Threshold Models of Collective Behavior , 1978, American Journal of Sociology.

[25]  M. Eigen,et al.  The Hypercycle: A principle of natural self-organization , 2009 .

[26]  Howard E. Aldrich Organizations and Environments , 1979 .

[27]  P. Holland,et al.  An Exponential Family of Probability Distributions for Directed Graphs , 1981 .

[28]  I. Prigogine,et al.  From Being to Becoming: Time and Complexity in the Physical Sciences , 1982 .

[29]  George A. Agoston,et al.  From Being to Becoming: Time and Complexity in the Physical Sciences by Ilya Prigogine (review) , 1982 .

[30]  Gavin J. Wright An evolutionary theory of economic change , 1982 .

[31]  S. Winter,et al.  An evolutionary theory of economic change , 1983 .

[32]  Robert A. Burgelman Corporate Entrepreneurship and Strategic Management: Insights from a Process Study , 1983 .

[33]  Bill McKelvey,et al.  Organizational Systematics: Taxonomy, Evolution, Classification. , 1984 .

[34]  B. Wernerfelt,et al.  A Resource-Based View of the Firm , 1984 .

[35]  David J. Teece,et al.  Economic Analysis and Strategic Management , 1984 .

[36]  W. G. Astley The Two Ecologies: Population and Community Perspectives on Organizational Evolution. , 1985 .

[37]  Yvonna S. Lincoln,et al.  Organizational theory and inquiry , 1985 .

[38]  David Krackhardt,et al.  When friends leave: A structural analysis of the relationship between turnover and stayers' attitudes. , 1985 .

[39]  Henry Mintzberg,et al.  Of strategies, deliberate and emergent , 1985, Strategic Management Journal.

[40]  G. Marwell,et al.  A Theory of the Critical Mass. I. Interdependence, Group Heterogeneity, and the Production of Collective Action , 1985, American Journal of Sociology.

[41]  E. M. Leifer,et al.  Toward a Structural Theory of Action: Network Models of Social Structure, Perception, and Action.By Ronald S. Burt. Academic Press, 1982. 381 pp. $29.50 , 1985 .

[42]  J. Marcus,et al.  Strategic Alliances , 1986, Bio/Technology.

[43]  J. Alexander,et al.  Images of Organization , 1988 .

[44]  Kenneth D. Mackenzie,et al.  Organizational design : the organizational audit and analysis technology , 1986 .

[45]  R. Rohwer Order out of Chaos: Man's New Dialogue with Nature , 1986 .

[46]  Robin M. Hogarth,et al.  Rational Choice: The Contrast Between Economics and Psychology. , 1988 .

[47]  M. Nei Molecular Evolutionary Genetics , 1987 .

[48]  Tommaso Toffoli,et al.  Cellular automata machines - a new environment for modeling , 1987, MIT Press series in scientific computation.

[49]  Tommaso Toffoli,et al.  Cellular Automata Machines , 1987, Complex Syst..

[50]  Dietrich Stauffer On forcing functions in Kauffman's random Boolean networks , 1987 .

[51]  James Gleick Chaos: Making a New Science , 1987 .

[52]  D. Stauffer,et al.  Random Boolean networks: Analogy with percolation , 1987 .

[53]  G. Marwell,et al.  Social Networks and Collective Action: A Theory of the Critical Mass. III , 1988, American Journal of Sociology.

[54]  W. Arthur,et al.  The Economy as an Evolving Complex System II , 1988 .

[55]  Paul DiMaggio Interest and Agency in Institutional Theory , 1988 .

[56]  K. Eisenhardt,et al.  Strategic decision processes in high velocity environments: four cases in the microcomputer industry , 1988 .

[57]  Edmund H. Durfee,et al.  Coordination of distributed problem solvers , 1988 .

[58]  I. Prigogine,et al.  Exploring Complexity: An Introduction , 1989 .

[59]  Kathleen M. Eisenhardt,et al.  Making Fast Strategic Decisions In High-Velocity Environments , 1989 .

[60]  E. Rasmussen Games and Information , 1989 .

[61]  M. Masuch,et al.  Beyond Garbage Cans: An AI Model of Organizational Choice , 1989 .

[62]  Marshall W. Meyer,et al.  Permanently Failing Organizations. , 1991 .

[63]  Philip D. Wasserman,et al.  Neural computing - theory and practice , 1989 .

[64]  L. Zucker Institutional patterns and organizations : culture and environment , 1989 .

[65]  C. Prahalad,et al.  The Core Competence of the Corporation , 1990 .

[66]  Toward an ecological life cycle model of organizational success and failure , 1990 .

[67]  W. Baker Market Networks and Corporate Behavior , 1990, American Journal of Sociology.

[68]  David M. Kreps,et al.  Game Theory and Economic Modelling , 1992 .

[69]  D. Krackhardt Assessing the political landscape: Structure, cognition, and power in organizations. , 1990 .

[70]  M. Porter The Competitive Advantage Of Nations , 1990 .

[71]  Wriston Wb The state of American management. , 1990 .

[72]  Michael W. Macy,et al.  Learning Theory and the Logic of Critical Mass , 1990 .

[73]  M. Porter Towards a dynamic theory of strategy , 1991 .

[74]  Vernon L. Smith,et al.  Rational Choice: The Contrast between Economics and Psychology , 1991, Journal of Political Economy.

[75]  Stuart A. Kauffman,et al.  The origins of order , 1993 .

[76]  E. Schein Organizational Culture and Leadership , 1991 .

[77]  Kathleen M. Carley A Theory of Group Stability , 1991 .

[78]  M. Macy Chains of Cooperation: Threshold Effects in Collective Action , 1991 .

[79]  C. Freeman Networks of innovators: A synthesis of research issues , 1991 .

[80]  Colin F. Camerer,et al.  Does Strategy Research Need Game Theory , 1991 .

[81]  K. R. Conner A Historical Comparison of Resource-Based Theory and Five Schools of Thought Within Industrial Organization Economics: Do We Have a New Theory of the Firm? , 1991 .

[82]  Ralph Stacey,et al.  The Chaos Frontier: Creative Strategic Control for Business , 1991 .

[83]  J. Barney Firm Resources and Sustained Competitive Advantage , 1991 .

[84]  John D. Barrow,et al.  Theories of Everything , 1991 .

[85]  Leonard K. Kaczmarek,et al.  The Neuron: Cell and Molecular Biology , 1991 .

[86]  Kathleen M. Carley Organizational Learning and Personnel Turnover , 1992 .

[87]  R. Eccles,et al.  Networks and Organizations: Structure, Form, and Action , 1992 .

[88]  H. R. Priesmeyer The art of modeling dynamic systems: Forecasting for chaos, randomness, and determinism: F. Morrison, 1991, (Wiley-Interscience, John Wiley & Sons, Inc., New York), pp. 387, ISBN 0-471-52004-7, $54.95 , 1992 .

[89]  D. Krackhardt The strength of strong ties: The importance of Philos in organizations , 2003 .

[90]  J. M. McPherson,et al.  Social Networks and Organizational Dynamics , 1992 .

[91]  Massimo Warglien,et al.  Artificial Intelligence in Organization and Management Theory , 1992 .

[92]  E. E. Zajac,et al.  Dynamics of Organizational populations , 1992 .

[93]  Charles Leave Neural Networks: Algorithms, Applications and Programming Techniques , 1992 .

[94]  Dan Dimancescu,et al.  The Seamless Enterprise: Making Cross-Functional Management Work , 1992 .

[95]  Steven B. Andrews,et al.  Structural Holes: The Social Structure of Competition , 1995, The SAGE Encyclopedia of Research Design.

[96]  P. Pattison Algebraic models for social networks , 1993 .

[97]  G. Marwell,et al.  The critical mass in collective action : a micro-social theory , 1993 .

[98]  Jay R. Galbraith,et al.  Organizing for the future: the new logic for managing complex organizations , 1993 .

[99]  R. T. Beaty,et al.  The competitive challenge , 1993 .

[100]  Howard Thomas,et al.  Paradigm Shift: Parallels in the Origin, Evolution and Function of the Strategic Group Concept with the Resource-Based Theory of the Firm , 1993 .

[101]  Daniel A. Levinthal,et al.  The myopia of learning , 1993 .

[102]  Philip D. Wasserman,et al.  Advanced methods in neural computing , 1993, VNR computer library.

[103]  G. Marwell,et al.  The critical mass in collective action , 1993 .

[104]  Roger V. Gould Collective Action and Network Structure , 1993 .

[105]  F. Cramer Chaos and Order: The Complex Structure of Living Systems , 1993 .

[106]  Morris A. Graham,et al.  The Horizontal Revolution: Reengineering Your Organization Through Teams , 1994 .

[107]  Amalya L. Oliver,et al.  Social Networks, Learning, and Flexibility: Sourcing Scientific Knowledge in New Biotechnology Firms , 1994 .

[108]  Richard A. D'Aveni,et al.  Hypercompetition: Managing the Dynamics of Strategic Maneuvering , 1994 .

[109]  Gérard Weisbuch,et al.  Complex Systems Dynamics , 1994 .

[110]  Bernardo A. Huberman,et al.  Social dilemmas and fluid organizations , 1994 .

[111]  J. Sutherland The Quark and the Jaguar , 1994 .

[112]  Kathleen M. Carley,et al.  The nature of the social agent , 1994 .

[113]  S. Kauffman,et al.  Divide to Coordinate: Coevolutionary Problem Solving , 1994 .

[114]  Joel A. C. Baum,et al.  Evolutionary dynamics of organizations , 1996 .

[115]  Massimo Warglien,et al.  The Logic of Organizational Disorder , 1996 .

[116]  O. Williamson,et al.  Transaction Cost Economics , 1995 .

[117]  Kathleen M. Carley,et al.  Radar‐soar: Towards an artificial organization composed of intelligent agents* , 1995 .

[118]  John Hagedoorn,et al.  Strategic technology partnering during the 1980s: Trends, networks and corporate patterns in non-core technologies , 1995 .

[119]  D. Wilson Darwinism Evolving: Systems Dynamics and the Genealogy of Natural Selection. , 1995, Artificial Life.

[120]  R. Thietart,et al.  Chaos Theory and Organization , 1995 .

[121]  I. Stewart,et al.  The collapse of chaos : discovering simplicity in a complex world , 1995 .

[122]  Brad M. Barber,et al.  The Friendly and Predatory Acquisition of Large U.S. Corporations in the 1960s: The Other Contested Terrain , 1995 .

[123]  R. Stacey The science of complexity: An alternative perspective for strategic change processes , 1995 .

[124]  Jack McGourty,et al.  The seamless enterprise: Making cross-functional management work , 1995 .

[125]  K. Weick FROM SENSEMAKING IN ORGANIZATIONS , 2021, The New Economic Sociology.

[126]  Kathleen M. Carley,et al.  Organizational designs suited to high performance under stress , 1995, IEEE Trans. Syst. Man Cybern..

[127]  Kathleen M. Carley,et al.  DYCORP : a computational framework for examining organizational performance under dynamic conditions , 1995 .

[128]  Tim Jones Evolutionary Algorithms, Fitness Landscapes and Search , 1995 .

[129]  G. Hendrikse Fundamental Issues in Strategy , 1995 .

[130]  Arantxa Etxeverria The Origins of Order , 1993 .

[131]  Bernard Johann Designing Cross-Functional Business Processes , 1995 .

[132]  Max H. Garzon,et al.  Models of Massive Parallelism , 1995, Texts in Theoretical Computer Science. An EATCS Series.

[133]  F. Westhoff,et al.  Complexity, organization, and Stuart Kauffman's The Origins of Order , 1996 .

[134]  John F. Padgett The Emergence of Simple Ecologies of Skill: A Hypercycle Approach to Economic Organization , 1996 .

[135]  Toby E. Stuart,et al.  Networks, Knowledge, and Niches: Competition in the Worldwide Semiconductor Industry, 1984-1991 , 1996, American Journal of Sociology.

[136]  Michael D. Cohen Organizational learning of routines: a model from the garbage can family , 1996 .

[137]  C. Baden‐Fuller,et al.  Rejuvenating the Mature Business , 1996 .

[138]  K. Eisenhardt,et al.  The Evolution of Intracorporate Domains: Divisional Charter Losses in High-Technology, Multidivisional Corporations , 1996 .

[139]  Ron Sanchez,et al.  Competence-based Strategic Management , 1996 .

[140]  Massimo Warglien Learning in a garbage can situation: a network model , 1996 .

[141]  B. Mark Organizational culture. , 1996, Annual review of nursing research.

[142]  R. Stacey Complexity and Creativity in Organizations , 1996 .

[143]  Kathleen M. Carley,et al.  Modeling Organizational Adaptation as a Simulated Annealing Process , 1996 .

[144]  L. G. Thomas The Two Faces of Competition: Dynamic Resourcefulness and the Hypercompetitive Shift , 1996 .

[145]  Christina L. Ahmadjian,et al.  Keiretsu Networks and Corporate Performance in Japan , 1996 .

[146]  B. Uzzi,et al.  The Sources and Consequences of Embeddedness for the Economic Performance of Organizations: The Network Effect , 1996 .

[147]  W. Powell,et al.  Interorganizational Collaboration and the Locus of Innovation: Networks of Learning in Biotechnology. , 1996 .

[148]  D. Krackhardt Organizational viscosity and the diffusion of controversial innovations , 1997 .

[149]  Daniel A. Levinthal Adaptation on rugged landscapes , 1997 .

[150]  Hyojoung Kim,et al.  The structure and dynamics of movement participation , 1997 .

[151]  Elaine Mosakowski,et al.  Strategy Making Under Causal Ambiguity: Conceptual Issues and Empirical Evidence , 1997 .

[152]  Richard N. Langlois,et al.  The Coevolution of Technology and Organization in the Transition to the Factory System , 1997 .

[153]  Sten Jönsson Institutions and Organizations , 1997 .

[154]  D. Teece,et al.  DYNAMIC CAPABILITIES AND STRATEGIC MANAGEMENT , 1997 .

[155]  Stewart Clegg,et al.  Handbook of organization studies , 1997 .

[156]  B. McKelvey Perspective—Quasi-Natural Organization Science , 1997 .

[157]  Kathleen M. Carley,et al.  A Theoretical Study of Organizational Performance Under Information Distortion , 1997 .

[158]  Michael T. Hannan,et al.  The complexity catastrophe in the computer industry: interdependence and adaptability in organizational evolution , 1997 .

[159]  Anne Sigismund Huff,et al.  Review: Handbook for Organization Studies, editedby Stewart R. Clegg, Cynthia Hardy, and Walter R. Nord.Thousand Oaks, CA: Sage, 1996 , 1998 .

[160]  Robert E. Ulanowicz,et al.  A Phenomenology of Evolving Networks , 1998 .

[161]  Karen Page,et al.  Network Forms of Organization , 1998 .

[162]  Michael L. Tushman,et al.  The Coevolution of Community Networks and Technology: Lessons from the Flight Simulation Industry , 1998 .

[163]  Joel A. C. Baum Whole-Part Coevolutionary Competition in Organizations , 1999 .

[164]  M van Gils,et al.  Organizational analysis as deconstructive practice , 1999 .

[165]  Peter W. Roberts,et al.  Suborganizational Evolution in the U.S. Pharmaceutical Industry , 1999 .

[166]  Atul Nerkar,et al.  On the Complexity of Technological Evolution: Exploring Coevolution within and across Hierarchical Levels in Optical Disc Technology , 1999 .

[167]  Andrew H. Van de Ven,et al.  Evolution in a Nested Hierarchy: A Genealogy of Twin Cities Health Care Organizations, 1853–1995 , 1999 .

[168]  M. Porter What is strategy , 2000 .

[169]  Jan W. Rivkin Imitation of Complex Strategies , 2000 .

[170]  Gerhard Weiss,et al.  Computational Organization Theory , 2000 .

[171]  Vernon L. Smith,et al.  Rational Choice: The Contrast between Economics and Psychology , 1991, Journal of Political Economy.

[172]  Kathleen M. Carley Organizational Adaptation in Volatile Environments , 2001 .