Evolutionary mechanics: new engineering principles for the emergence of flexibility in a dynamic and uncertain world

Engineered systems are designed to deftly operate under predetermined conditions yet are notoriously fragile when unexpected perturbations arise. In contrast, biological systems operate in a highly flexible manner; learn quickly adequate responses to novel conditions, and evolve new routines and traits to remain competitive under persistent environmental change. A recent theory on the origins of biological flexibility has proposed that degeneracy—the existence of multi-functional components with partially overlapping functions—is a primary determinant of the robustness and adaptability found in evolved systems. While degeneracy’s contribution to biological flexibility is well documented, there has been little investigation of degeneracy design principles for achieving flexibility in systems engineering. Actually, the conditions that can lead to degeneracy are routinely eliminated in engineering design. With the planning of transportation vehicle fleets taken as a case study, this article reports evidence that degeneracy improves the robustness and adaptability of a simulated fleet towards unpredicted changes in task requirements without incurring costs to fleet efficiency. We find that degeneracy supports faster rates of design adaptation and ultimately leads to better fleet designs. In investigating the limitations of degeneracy as a design principle, we consider decision-making difficulties that arise from degeneracy’s influence on fleet complexity. While global decision-making becomes more challenging, we also find degeneracy accommodates rapid distributed decision-making leading to (near-optimal) robust system performance. Given the range of conditions where favorable short-term and long-term performance outcomes are observed, we propose that degeneracy may fundamentally alter the propensity for adaptation and is useful within different engineering and planning contexts.

[1]  Gwendolyn E. Campbell,et al.  Measuring the Impact of Advanced Technologies and Reorganization on Human Performance in a Combat Information Center , 2000 .

[2]  S. Winter Understanding dynamic capabilities , 2003 .

[3]  T. Ohta Near-neutrality in evolution of genes and gene regulation , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[4]  James M. Whitacre,et al.  Degeneracy: a link between evolvability, robustness and complexity in biological systems , 2009, Theoretical Biology and Medical Modelling.

[5]  J. M. Ottino,et al.  Engineering complex systems , 2004, Nature.

[6]  Leslie G. Valiant,et al.  Evolvability , 2009, JACM.

[7]  A. M. Grisogono,et al.  Adaptive Use of Networks to Generate an Adaptive Task Force , 2008 .

[8]  T. Jukes,et al.  The neutral theory of molecular evolution. , 2000, Genetics.

[9]  Stephan Alberth,et al.  Forecasting technology costs via the experience curve — Myth or magic? , 2008 .

[10]  D. Wilemon,et al.  A Survey of Major Approaches for Accelerating New Product Development , 1992 .

[11]  Jochen Fromm,et al.  On Engineering and Emergence , 2006, nlin/0601002.

[12]  James M. Whitacre Evolution-Inspired Approaches for Engineering Emergent Robustness in an Uncertain Dynamic World , 2010, ALIFE.

[13]  Xin Yao,et al.  The Role of Degenerate Robustness in the Evolvability of Multi-agent Systems in Dynamic Environments , 2010, PPSN.

[14]  M. Hitt,et al.  The new competitive landscape , 1995 .

[15]  Andrew Ilachinski Land Warfare and Complexity, Part II: An Assessment of the Applicability of Nonlinear Dynamics and Complex Systems Theory to the Study of Land Warfare , 1996 .

[16]  Karl J. Friston,et al.  Degeneracy and cognitive anatomy , 2002, Trends in Cognitive Sciences.

[17]  Barry W. Boehm,et al.  System of systems lead system integrators: Where Do they spend their time and what makes them more or less efficient? , 2008, Syst. Eng..

[18]  D. Teece Explicating dynamic capabilities: the nature and microfoundations of (sustainable) enterprise performance , 2007 .

[19]  Armin P. Schulz,et al.  Design for changeability (DfC): Principles to enable changes in systems throughout their entire lifecycle , 2005, Syst. Eng..

[20]  James M. Whitacre,et al.  Degenerate Neutrality Creates Evolvable Fitness Landscapes , 2009, GEM.

[21]  Mark S. Granovetter The Strength of Weak Ties , 1973, American Journal of Sociology.

[22]  Evandro Agazzi,et al.  What is Complexity , 2002 .

[23]  M Kimura,et al.  SOLUTION OF A PROCESS OF RANDOM GENETIC DRIFT WITH A CONTINUOUS MODEL. , 1955, Proceedings of the National Academy of Sciences of the United States of America.

[24]  M. Rosenau SPEEDING YOUR NEW PRODUCT TO MARKET , 1988 .

[25]  J. Stelling,et al.  Robustness of Cellular Functions , 2004, Cell.

[26]  Anne-Marie Grisogono,et al.  The Implications of Complex Adaptive Systems Theory for C2 , 2006 .

[27]  Alex Ryan,et al.  A Multidisciplinary Approach to Complex Systems Design , 2007 .

[28]  Julian Francis Miller,et al.  The Advantages of Landscape Neutrality in Digital Circuit Evolution , 2000, ICES.

[29]  Paul K. Davis Strategic Planning Amidst Massive Uncertainty in Complex Adaptive Systems: the Case of Defense Planning , 2006 .

[30]  G. Edelman,et al.  Degeneracy and complexity in biological systems , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[31]  Sarah A. Sheard,et al.  Principles of complex systems for systems engineering , 2007, Syst. Eng..

[32]  Richard W. Olshavsky,et al.  Shortening of the PLC—AN Empirical Test , 1981 .

[33]  C. Harmon,et al.  Experience Curves of Photovoltaic Technology , 2000 .

[34]  Ann Kerwin,et al.  None Too Solid , 1993 .

[35]  Patrick L. Griffin,et al.  Functional information and the emergence of biocomplexity , 2007, Proceedings of the National Academy of Sciences.

[36]  Jeffrey C. Mogul,et al.  Emergent (mis)behavior vs. complex software systems , 2006, EuroSys.

[37]  Paul K. Davis New paradigms and new challenges [modeling and simulation] , 2005, Proceedings of the Winter Simulation Conference, 2005..

[38]  Richard A. Watson,et al.  On the Utility of Redundant Encodings in Mutation-Based Evolutionary Search , 2002, PPSN.

[39]  M. Tyers,et al.  Stratus Not Altocumulus: A New View of the Yeast Protein Interaction Network , 2006, PLoS biology.

[40]  Sarah A. Sheard,et al.  Principles of complex systems for systems engineering , 2009 .

[41]  C. S. Holling Understanding the Complexity of Economic, Ecological, and Social Systems , 2001, Ecosystems.

[42]  Ricard V Solé,et al.  Distributed robustness in cellular networks: insights from synthetic evolved circuits , 2009, Journal of The Royal Society Interface.

[43]  Linda P. Beckerman Application of complex systems science to systems engineering , 2000 .

[44]  C. S. Holling Engineering Resilience versus Ecological Resilience , 1996 .

[45]  Axel Bender,et al.  Degeneracy: a design principle for achieving robustness and evolvability. , 2009, Journal of theoretical biology.

[46]  Murray Gell-Mann,et al.  What is complexity? Remarks on simplicity and complexity by the Nobel Prize-winning author of The Quark and the Jaguar , 1995, Complex..

[47]  Richard J. Schonberger,et al.  Commentary on the Organization Science Special Issue on Complexity , 1999 .

[48]  J. Anderies,et al.  From Metaphor to Measurement: Resilience of What to What? , 2001, Ecosystems.

[49]  Alexei Kurakin,et al.  Self‐organization versus Watchmaker: ambiguity of molecular recognition and design charts of cellular circuitry , 2007, Journal of molecular recognition : JMR.

[50]  Julian Francis Miller,et al.  Obtaining system robustness by mimicking natural mechanisms , 2009, 2009 IEEE Congress on Evolutionary Computation.

[51]  Péter Csermely,et al.  Weak links : stabilizers of complex systems from proteins to social networks , 2006 .

[52]  T. Smith,et al.  Neutrality and ruggedness in robot landscapes , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[53]  James M. Whitacre,et al.  Survival of the flexible: explaining the dominance of meta-heuristics within a rapidly evolving world , 2009, ArXiv.

[54]  Lan V. Zhang,et al.  Evidence for dynamically organized modularity in the yeast protein–protein interaction network , 2004, Nature.

[55]  Bruce Edmonds,et al.  Complexity and Scientific Modelling , 2000 .

[56]  M. Kuhl,et al.  NEW PARADIGMS AND NEW CHALLENGES , 2005 .

[57]  Gerald Jay Sussman,et al.  Building Robust Systems an essay , 2007 .

[58]  A. Kurakin Order without design , 2010, Theoretical Biology and Medical Modelling.

[59]  A. Wagner,et al.  Innovation and robustness in complex regulatory gene networks , 2007, Proceedings of the National Academy of Sciences.

[60]  B. E. White,et al.  2.1.3 Engineering Enterprises Using Complex-System Engineering , 2005 .

[61]  Wander Jager,et al.  Task dynamics in self-organising task groups: expertise, motivational, and performance differences of specialists and generalists , 2008, Autonomous Agents and Multi-Agent Systems.

[62]  L. Argote,et al.  Learning Curves in Manufacturing , 1990, Science.

[63]  M. Tyers,et al.  Still Stratus Not Altocumulus: Further Evidence against the Date/Party Hub Distinction , 2007, PLoS biology.

[64]  Daniel A. Levinthal Adaptation on rugged landscapes , 1997 .

[65]  R. Solé,et al.  Selection, Tinkering, and Emergence in Complex Networks - Crossing the Land of Tinkering , 2002 .

[66]  Jonathan Bell,et al.  Degeneracy-Driven Self-Structuring Dynamics in Selective Repertoires , 2009, Bulletin of mathematical biology.

[67]  A. Griffin Metrics for Measuring Product Development Cycle Time , 1993 .

[68]  Steven D. Gribble,et al.  Robustness in complex systems , 2001, Proceedings Eighth Workshop on Hot Topics in Operating Systems.

[69]  L. Hood,et al.  Reverse Engineering of Biological Complexity , 2007 .

[70]  S. Zahra,et al.  Entrepreneurship and Dynamic Capabilities: A Review, Model and Research Agenda , 2006 .

[71]  Timothy N. Carroll,et al.  The Coevolution of New Organizational Forms , 1999 .

[72]  R. Färe,et al.  Productivity Growth, Technical Progress, and Efficiency Change in Industrialized Countries , 1994 .

[73]  Stuart A. Kauffman,et al.  Requirements for evolvability in complex systems: orderly dynamics and frozen components , 1990 .

[74]  Daniel A. Levinthal,et al.  Bounded Rationality and the Search for Organizational Architecture: An Evolutionary Perspective on the Design of Organizations and Their Evolvability , 2004 .

[75]  Franz Rothlauf,et al.  Redundant Representations in Evolutionary Computation , 2003, Evolutionary Computation.

[76]  J. March Exploration and exploitation in organizational learning , 1991, STUDI ORGANIZZATIVI.

[77]  Yuri N. Levchuk,et al.  Normative Design of Organizations — Part II : Organizational Structure , 2001 .

[78]  Paul K. Davis,et al.  Enhancing Strategic Planning with Massive Scenario Generation: Theory and Experiments , 2007 .

[79]  John Doyle,et al.  Complexity and robustness , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[80]  C. Walter Kryder's law. , 2005, Scientific American.

[81]  J.K. DeRosa,et al.  A Research Agenda for the Engineering of Complex Systems , 2008, 2008 2nd Annual IEEE Systems Conference.

[82]  Philip John,et al.  Systems engineering in an age of complexity , 2004, IEEE Engineering Management Review.

[83]  Julian Francis Miller,et al.  Neutrality and the Evolvability of Boolean Function Landscape , 2001, EuroGP.

[84]  Cees Witteveen,et al.  Coordinating Self-interested Planning Agents , 2006, Autonomous Agents and Multi-Agent Systems.

[85]  G Tononi,et al.  Measures of degeneracy and redundancy in biological networks. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[86]  D. Braha,et al.  Complex Engineered Systems: A New Paradigm , 2006 .

[87]  C MogulJeffrey Emergent (mis)behavior vs. complex software systems , 2006 .

[88]  D. Finegold Book and Resource Reviews , 2005 .

[89]  Christoph Adami,et al.  Sequence complexity in Darwinian evolution , 2002, Complex..

[90]  R. Lempert,et al.  Shaping the Next One Hundred Years: New Methods for Quantitative Long-Term Policy Analysis , 2003 .

[91]  Murray Gell-Mann,et al.  What Is Complexity , 2002 .

[92]  A. Wagner Robustness and evolvability: a paradox resolved , 2008, Proceedings of the Royal Society B: Biological Sciences.

[93]  Regina Frei,et al.  Degeneracy and networked buffering: principles for supporting emergent evolvability in agile manufacturing systems , 2011, Natural Computing.

[94]  John Doyle,et al.  Contrasting Views of Complexity and Their Implications For Network-Centric Infrastructures , 2010, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[95]  P. Bak,et al.  Complexity, contingency, and criticality. , 1995, Proceedings of the National Academy of Sciences of the United States of America.

[96]  Krishna R. Pattipati,et al.  Normative design of organizations. II. Organizational structure , 2002, IEEE Trans. Syst. Man Cybern. Part A.

[97]  Jean-Baptiste Waldner,et al.  Nanocomputers and swarm intelligence , 2008 .

[98]  W. Banzhaf,et al.  Genetic programming using genotype-phenotype mapping from linear genomes into linear phenotypes , 1996 .

[99]  Christopher L. Magee,et al.  A functional approach for studying technological progress: Extension to energy technology , 2008 .

[100]  M. Kimura The Neutral Theory of Molecular Evolution: Introduction , 1983 .

[101]  Wolfgang Banzhaf,et al.  Genotype-Phenotype-Mapping and Neutral Variation - A Case Study in Genetic Programming , 1994, PPSN.

[102]  S. Levin,et al.  Resilience, Robustness, and Marine Ecosystem-based Management , 2008 .

[103]  Axel Bender,et al.  Networked buffering: a basic mechanism for distributed robustness in complex adaptive systems , 2009, Theoretical Biology and Medical Modelling.

[104]  P. Senge The fifth discipline : the art and practice of the learning organization/ Peter M. Senge , 1991 .

[105]  J. Crutchfield,et al.  The Evolutionary Unfolding of Complexity , 1999, adap-org/9903001.

[106]  D. McShea PERSPECTIVE METAZOAN COMPLEXITY AND EVOLUTION: IS THERE A TREND? , 1996, Evolution; international journal of organic evolution.

[107]  Basil Achilladelis,et al.  The dynamics of technological innovation: the case of the pharmaceutical industry , 2001 .

[108]  C. Crawford The Hidden Costs of Accelerated Product Development , 1992 .

[109]  A. Page Assessing New Product Development Practices and Performance: Establishing Crucial Norms , 1993 .

[110]  J. Hailman Wonderful Life: The Burgess Shale and the Nature of History, Stephen Jay Gould. W. W. Norton, New York (1989), 347, Price $19.95 (U.S.A.), $27.95 (Canada) , 1991 .

[111]  Kevin J. Dooley,et al.  A Complex Adaptive Systems Model of Organization Change , 1997 .

[112]  Gabriele Bammer,et al.  Uncertainty and Risk: Multidisciplinary Perspectives , 2008 .

[113]  Alexei Kurakin,et al.  Scale-free Flow of Life: On the Biology, Economics, and Physics of the Cell , 2009 .

[114]  James M. Whitacre Genetic and Environment-Induced Innovation - Complementary Pathways to Adaptive Change that are Facilitated by Degeneracy in Multi-Agent Systems , 2010, ALIFE.

[115]  Olof Görnerup,et al.  Objects that make objects: the population dynamics of structural complexity , 2004, Journal of The Royal Society Interface.

[116]  B. Baars,et al.  Neural Darwinism and consciousness , 2005, Consciousness and Cognition.