Emergent computation of complex systems: a comprehensive review

Emergent computation is proposed in the study of self-organisation, collective and cooperative behaviour and it has become an important approach to complex system research with further development of the complexity science. From the perspective of complexity study, this paper reviews and analyses the emergent computation of complex systems, which is intended to deepen the understanding of the mechanism for emergence phenomenon and grasp the development directions of complexity study. At first, the concept, models and research methods of emergent computation are introduced and stated. Furthermore, the layout design problems in complex engineering systems and the collective behaviour issues in complex social systems are chosen as representatives to expand the review. The generation mechanisms of emergent computation in engineering systems are expounded and the emergent computation models of collective behaviour which include synchronisation and public opinion propagation are discussed. Based on the review of research status, further analysis on the existed problems and shortcomings is made and some perspectives on the development trends of future research which relate to emergent computation of complex systems are provided.

[1]  Deyi Li,et al.  Emergent computation: Virtual reality from disordered clapping to ordered clapping , 2008, Science in China Series F: Information Sciences.

[2]  Christopher G. Langton,et al.  Studying artificial life with cellular automata , 1986 .

[3]  Josef Hofbauer,et al.  Evolutionary Games and Population Dynamics , 1998 .

[4]  Renbin Xiao,et al.  Synchronization of Kuramoto oscillators in small-world networks , 2014 .

[5]  Shiming Chen,et al.  On convergence efficiency of an improved Vicsek model , 2010, Proceedings of the 29th Chinese Control Conference.

[6]  Rainer Hegselmann,et al.  Opinion dynamics and bounded confidence: models, analysis and simulation , 2002, J. Artif. Soc. Soc. Simul..

[7]  Marco Dorigo,et al.  Ant algorithms and stigmergy , 2000, Future Gener. Comput. Syst..

[8]  J.M. Zurada,et al.  Emergence of communication in multi-agent systems using reinforcement learning , 2006, 2006 IEEE International Conference on Computational Cybernetics.

[9]  Tao Zhou,et al.  Predictive protocol of flocks with small-world connection pattern. , 2007, Physical review. E, Statistical, nonlinear, and soft matter physics.

[10]  I. Prigogine,et al.  Exploring Complexity: An Introduction , 1989 .

[11]  J. Crutchfield.  The calculi of emergence: computation, dynamics and induction , 1994 .

[12]  Johannes Bonnekoh.  MONTE CARLO SIMULATIONS OF THE ISING AND THE SZNAJD MODEL ON GROWING BARABÁSI–ALBERT NETWORKS , 2003 .

[13]  Franco Zambonelli,et al.  Self-Organizing Spatial Shapes in Mobile Particles: The TOTA Approach , 2004, Engineering Self-Organising Systems.

[14]  Vicsek,et al.  Novel type of phase transition in a system of self-driven particles. , 1995, Physical review letters.

[15]  Renbin Xiao,et al.  A Multi-Agent Simulation Approach To Rumor Spread In Virtual Commnunity Based On Social Network , 2011, Intell. Autom. Soft Comput..

[16]  Stephanie Forrest,et al.  Emergent computation: self-organizing, collective, and cooperative phenomena in natural and artificial computing networks , 1990 .

[17]  Helbing,et al.  Social force model for pedestrian dynamics. , 1995, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[18]  U. Fischbacher,et al.  The nature of human altruism , 2003, Nature.

[19]  A. O. Sousa,et al.  Outward-inward information flux in an opinion formation model on different topologies , 2006 .

[20]  M. Eigen,et al.  The Hypercycle: A principle of natural self-organization , 2009 .

[21]  Franco Zambonelli,et al.  Spray computers: frontiers of self-organization for pervasive computing , 2004, 13th IEEE International Workshops on Enabling Technologies: Infrastructure for Collaborative Enterprises.

[22]  Jacques Ferber,et al.  Multi-agent systems - an introduction to distributed artificial intelligence , 1999 .

[23]  Nobuyuki Matsui,et al.  Emergence of Flocking Behavior Based on Reinforcement Learning , 2006, KES.

[24]  Marie-Pierre Gleizes,et al.  Self-organization in multi-agent systems , 2005, The Knowledge Engineering Review.

[25]  H. Van Dyke Parunak,et al.  Synthetic Pheromone Mechanisms for Coordination of Unmanned Vehicles , 2002 .

[26]  W. Ashby,et al.  Principles of the self-organizing dynamic system. , 1947, The Journal of general psychology.

[27]  Matjaz Perc,et al.  Collective behavior and evolutionary games - An introduction , 2013, 1306.2296.

[28]  Susan Stepney,et al.  Emergent Properties Do Not Refine , 2005, Electron. Notes Theor. Comput. Sci..

[29]  Julianne D. Halley,et al.  Classification of emergence and its relation to self-organization , 2008 .

[30]  Katarzyna Sznajd-Weron,et al.  Opinion evolution in closed community , 2000, cond-mat/0101130.

[31]  Christian Bettstetter,et al.  Self-organization in communication networks: principles and design paradigms , 2005, IEEE Communications Magazine.

[32]  Marie-Pierre Gleizes,et al.  Self-Organisation and Emergence in MAS: An Overview , 2006, Informatica.

[33]  K. Sznajd-Weron,et al.  How effective is advertising in duopoly markets , 2002 .

[34]  S. Galam.  Rational group decision making: A random field Ising model at T = 0 , 1997, cond-mat/9702163.

[35]  Michael Wooldridge,et al.  Introduction to multiagent systems , 2001 .

[36]  Damian Schofield,et al.  Cooperation versus competition in a mass emergency evacuation: A new laboratory simulation and a new theoretical model , 2009, Behavior research methods.

[37]  Jan Lorenz.  Heterogeneous bounds of confidence: Meet, discuss and find consensus! , 2010 .

[38]  Mauricio Barahona,et al.  Synchronization in small-world systems. , 2002, Physical review letters.

[39]  Ying-Cheng Lai,et al.  Convergence to global consensus in opinion dynamics under a nonlinear voter model , 2010, 1008.0901.

[40]  G. Theraulaz,et al.  Response threshold reinforcements and division of labour in insect societies , 1998, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[41]  Tom De Wolf,et al.  Emergence as a paradigm to engineer distributed autonomic software , 2004 .

[42]  Nicholas R. Jennings,et al.  Intelligent agents: theory and practice , 1995, The Knowledge Engineering Review.

[43]  J. M. Smith,et al.  The Logic of Animal Conflict , 1973, Nature.

[44]  M. A. Niazi,et al.  An Intelligent Self-Organizing Power-Saving Architecture: An Agent-Based Approach , 2012, 2012 Fourth International Conference on Computational Intelligence, Modelling and Simulation.

[45]  Patrick R. McMullen,et al.  Swarm intelligence: power in numbers , 2002, CACM.

[46]  Chi-Wang Shu,et al.  Dynamic continuum pedestrian flow model with memory effect. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.

[47]  Jiang Guoping,et al.  Research of malware propagation in complex networks based on 1-D cellular automata , 2009 .

[48]  D. Campbell.  On the conflicts between biological and social evolution and between psychology and moral tradition. , 1976, Zygon.

[49]  H. Van Dyke Parunak,et al.  Self-Organizing MANET Management , 2003, Engineering Self-Organising Systems.

[50]  W. Hamilton,et al.  The Evolution of Cooperation , 1984 .

[51]  Renbin Xiao,et al.  An emergent computation approach to the problem of polygon layout with performance constraints , 2013 .

[52]  M. Olson,et al.  The Logic of Collective Action , 1965 .

[53]  Jürgen Kurths,et al.  Synchronization - A Universal Concept in Nonlinear Sciences , 2001, Cambridge Nonlinear Science Series.

[54]  R. Cressman.  Evolutionary Dynamics and Extensive Form Games , 2003 .

[55]  I. Couzin,et al.  Effective leadership and decision-making in animal groups on the move , 2005, Nature.

[56]  H. J. Herrmann,et al.  OPINION FORMATION ON A DETERMINISTIC PSEUDO-FRACTAL NETWORK , 2004 .

[57]  D. Zanette.  Dynamics of rumor propagation on small-world networks. , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.

[58]  Duncan J. Watts,et al.  Collective dynamics of ‘small-world’ networks , 1998, Nature.

[59]  Francis Heylighen,et al.  The Science of Self-Organization and Adaptivity , 1999 .

[60]  Albert,et al.  Emergence of scaling in random networks , 1999, Science.

[61]  Hermann de Meer,et al.  A Method to Derive Local Interaction Strategies for Improving Cooperation in Self-Organizing Systems , 2008, IWSOS.

[62]  Luca Maria Gambardella,et al.  AntHocNet: an adaptive nature-inspired algorithm for routing in mobile ad hoc networks , 2005, Eur. Trans. Telecommun..

[63]  E. Bonabeau,et al.  Three-dimensional architectures grown by simple 'stigmergic' agents. , 2000, Bio Systems.

[64]  Krapivsky,et al.  Exact results for kinetics of catalytic reactions. , 1996, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[65]  The Rodney King verdict and urban riots: A value-added theory perspective , 1993 .

[66]  J. Ehrenfeld,et al.  Organizing Self‐Organizing Systems , 2012 .

[67]  S. Hassas,et al.  On Self-Organising Mechanisms from Social, Business and Economic Domains , 2006 .

[68]  Ying Guo,et al.  Directed Self-assembly of 2-Dimensional Mesoblocks Using Top-Down/Bottom-Up Design , 2004, Engineering Self-Organising Systems.

[69]  Eduardo Camponogara,et al.  On the Convergence to and Location of Attractors of Uncertain, Dynamic Games , 2004, SBIA.

[70]  Katarzyna Sznajd-Weron,et al.  Dynamical model of Ising spins. , 2004, Physical review. E, Statistical, nonlinear, and soft matter physics.

[71]  Renbin Xiao,et al.  Research on structure emergence based on cellular automata , 2014, Int. J. Bio Inspired Comput..

[72]  James Gleick.  Chaos: Making a New Science , 1987 .

[73]  A. Mikhailov,et al.  Noise-induced breakdown of coherent collective motion in swarms. , 1999, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[74]  Maurizio Porfiri,et al.  Decline of minorities in stubborn societies , 2007 .

[75]  John von Neumann,et al.  Theory Of Self Reproducing Automata , 1967 .

[76]  Tom De Wolf,et al.  A catalogue of decentralised coordination mechanisms for designing self-organising emergent applications , 2006 .

[77]  Long Wang,et al.  Coordinated collective motion in a motile particle group with a leader , 2005 .

[78]  Stefania Bandini,et al.  Cellular automata: From a theoretical parallel computational model to its application to complex systems , 2001, Parallel Comput..

[79]  John H. Holland,et al.  Hidden Order: How Adaptation Builds Complexity , 1995 .

[80]  Renbin Xiao,et al.  Modeling and Simulation of Synchronous Threshold in Vent Collective Behavior , 2014 .

[81]  Susumu Shirayama,et al.  A study of the relationship between scale-freeness and evolution of cooperation , 2011, Int. J. Bio Inspired Comput..

[82]  K. Sznajd-Weron.  Sznajd model and its applications , 2005, physics/0503239.

[83]  Jurgen Kurths,et al.  Synchronization in complex networks , 2008, 0805.2976.

[84]  A. Colman.  Game Theory and its Applications: In the Social and Biological Sciences , 1995 .

[85]  Claudio J. Tessone,et al.  System size stochastic resonance in a model for opinion formation , 2004, cond-mat/0409620.

[86]  Sarit Kraus,et al.  Negotiation and Cooperation in Multi-Agent Environments , 1997, Artif. Intell..

[87]  T. Ferguson.  Game Theory and Decision Theory , 1967 .

[88]  Jevin D. West,et al.  Evidence for complex, collective dynamics and emergent, distributed computation in plants , 2004, Proc. Natl. Acad. Sci. USA.

[89]  Craig W. Reynolds.  Flocks, herds, and schools: a distributed behavioral model , 1987, SIGGRAPH.

[90]  Hendrik Van Brussel,et al.  Emergent Forecasting Using a Stigmergy Approach in Manufacturing Coordination and Control , 2004, Engineering Self-Organising Systems.

[91]  Francis Heylighen,et al.  Self-organization, Emergence and the Architecture of Complexity , 1989 .

[92]  T. Vicsek,et al.  Spontaneously ordered motion of self-propelled particles , 1997, cond-mat/0611741.

[93]  Jim Dowling,et al.  Using feedback in collaborative reinforcement learning to adaptively optimize MANET routing , 2005, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[94]  E. Fredkin.  Digital mechanics: an informational process based on reversible universal cellular automata , 1990 .

[95]  Chris Melhuish,et al.  Stigmergy, Self-Organization, and Sorting in Collective Robotics , 1999, Artificial Life.

[96]  M. Kuperman,et al.  Social games in a social network. , 2000, Physical review. E, Statistical, nonlinear, and soft matter physics.

[97]  Renaud Lambiotte,et al.  Opinion formation in laggard societies , 2008 .

[98]  Joel Guerrero,et al.  Biomimetic spiroid winglets for lift and drag control , 2012 .

[99]  A. Winfree.  Biological rhythms and the behavior of populations of coupled oscillators. , 1967, Journal of theoretical biology.

[100]  Jie Lin,et al.  Coordination of groups of mobile autonomous agents using nearest neighbor rules , 2003, IEEE Trans. Autom. Control..

[101]  Claudio Castellano,et al.  Incomplete ordering of the voter model on small-world networks , 2003 .

[102]  Wei Zeng,et al.  A Dual-System Variable-Grain Cooperative Coevolutionary Algorithm: Satellite-Module Layout Design , 2010, IEEE Transactions on Evolutionary Computation.

[103]  H. Van Dyke Parunak,et al.  Entropy and self-organization in multi-agent systems , 2001, AGENTS '01.

[104]  Stephanie Forrest,et al.  Dynamics, emergent computation, and evolution in cellular automata , 1999 .

[105]  J. Buck,et al.  Toward a Functional Interpretation of Synchronous Flashing by Fireflies , 1978, The American Naturalist.

[106]  Jin Shi.  Emergence-Oriented Research on Multi-Agent Systems and Its State of Arts , 2008 .

[107]  Random global coupling induces synchronization and nontrivial collective behavior in networks of chaotic maps , 2006, nlin/0612010.

[108]  M Mitchell,et al.  The evolution of emergent computation. , 1995, Proceedings of the National Academy of Sciences of the United States of America.

[109]  Donald M. Taylor,et al.  Responding to membership in a disadvantaged group : from acceptance to collective protest , 1990 .

[110]  D. Kendall,et al.  Epidemics and Rumours , 1964, Nature.

[111]  Takashi Nagatani,et al.  Delay effect on phase transitions in traffic dynamics , 1998 .

[112]  Jean-Pierre Mano,et al.  Bio-inspired Mechanisms for Artificial Self-organised Systems , 2006, Informatica.

[113]  Franco Zambonelli,et al.  Self-Organization in Multi Agent Systems: A Middleware Approach , 2003, Engineering Self-Organising Systems.

[114]  Grégoire Nicolis,et al.  Self-Organization in nonequilibrium systems , 1977 .

[115]  Sriram Ramaswamy,et al.  Hydrodynamic fluctuations and instabilities in ordered suspensions of self-propelled particles. , 2001, Physical review letters.

[116]  Mihaela Ulieru,et al.  The Holonic Enterprise and Theory Emergence: On emergent features of self-organization in distributed virtual agents , 2004, Cybern. Hum. Knowing.

[117]  S. Strogatz.  From Kuramoto to Crawford: exploring the onset of synchronization in populations of coupled oscillators , 2000 .

[118]  Munindar P. Singh.  Multiagent Systems - A Theoretical Framework for Intentions, Know-How, and Communications , 1994, Lecture Notes in Computer Science.

[119]  V. Isham,et al.  Stochastic epidemics and rumours on finite random networks , 2010 .

[120]  Yoshiki Kuramoto,et al.  Chemical Oscillations, Waves, and Turbulence , 1984, Springer Series in Synergetics.

[121]  Bernhard Bauer,et al.  Decentralized Real-Time Control of Water Distribution Networks Using Self-Organizing Multi-agent Systems , 2010, 2010 Fourth IEEE International Conference on Self-Adaptive and Self-Organizing Systems.

[122]  I. Prigogine.  Time, Structure, and Fluctuations , 1978, Science.

[123]  A. Pluchino,et al.  CHANGING OPINIONS IN A CHANGING WORLD: A NEW PERSPECTIVE IN SOCIOPHYSICS , 2004 .

[124]  S. Redner,et al.  Voter model on heterogeneous graphs. , 2004, Physical review letters.

[125]  Paul Hovda.  Quantifying Weak Emergence , 2008, Minds and Machines.

[126]  Luo Pi.  A Survey for Rumor Propagation Models , 2009 .

[127]  Mikhail Prokopenko,et al.  Defining and Detecting Emergence in Complex Networks , 2005, KES.

[128]  M. Nowak,et al.  Evolutionary games and spatial chaos , 1992, Nature.

[129]  Tamás Vicsek,et al.  Universal Patterns of Collective Motion from Minimal Models of Flocking , 2008, 2008 Second IEEE International Conference on Self-Adaptive and Self-Organizing Systems.

[130]  Yongsheng Ding,et al.  A bio-inspired emergent system for intelligent Web service composition and management , 2007, Knowl. Based Syst..

[131]  Liu De-hai,et al.  The Role of Communication in the Mass Unexpected Incident Management , 2005 .

[132]  T. Vicsek,et al.  Self-organizing processes: The sound of many hands clapping , 2000, Nature.

[133]  Stephanie Forrest,et al.  Analogies with immunology represent an important step toward the vision of robust, distributed protection for computers. , 1991 .

[134]  Wilfried Elmenreich,et al.  A Survey of Models and Design Methods for Self-organizing Networked Systems , 2009, IWSOS.

[135]  Jing Liu,et al.  A multiagent genetic algorithm for global numerical optimization , 2004, IEEE Trans. Syst. Man Cybern. Part B.

[136]  Yamir Moreno,et al.  Dynamics of rumor spreading in complex networks. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[137]  R. Jeanne,et al.  The organization of work in Polybia occidentalis: costs and benefits of specialization in a social wasp , 1986, Behavioral Ecology and Sociobiology.

[138]  Reza Olfati-Saber,et al.  Flocking for multi-agent dynamic systems: algorithms and theory , 2006, IEEE Transactions on Automatic Control.

[139]  Christian Müller-Schloer,et al.  Quantitative Emergence , 2006, 2006 IEEE Mountain Workshop on Adaptive and Learning Systems.

[140]  久保 亮五,et al.  H. Haken: Synergetics; An Introduction Non-equilibrium Phase Transitions and Self-Organization in Physics, Chemistry and Biology, Springer-Verlag, Berlin and Heidelberg, 1977, viii+325ページ, 251×17.5cm, 11,520円. , 1978 .

[141]  F. Slanina,et al.  Analytical results for the Sznajd model of opinion formation , 2003, cond-mat/0305102.

[142]  Stephen Wolfram,et al.  Cellular Automata And Complexity , 1994 .

[143]  D. Hofstadter,et al.  Godel, Escher, Bach: An Eternal Golden Braid , 1979 .

[144]  Guillaume Deffuant,et al.  Mixing beliefs among interacting agents , 2000, Adv. Complex Syst..

[145]  Ying Guo,et al.  A Self-Organizing Nano-Particle Simulator and Its Applications , 2008, 2008 NASA/ESA Conference on Adaptive Hardware and Systems.

[146]  Christian Jacob,et al.  Evolutionary exploration of dynamic swarm behaviour , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[147]  Tom De Wolf,et al.  Design Patterns for Decentralised Coordination in Self-organising Emergent Systems , 2006, ESOA.

[148]  Hendrik Van Brussel,et al.  Pheromone based emergent shop floor control system for flexible flow shops , 1999, Artif. Intell. Eng..

[149]  Tom De Wolf,et al.  Engineering self-organising emergent systems with simulation-based scientific analysis , 2005 .

[150]  James P. Crutchfield,et al.  Computational mechanics of cellular automata: an example , 1997 .

[151]  Felipe Cucker,et al.  Emergent Behavior in Flocks , 2007, IEEE Transactions on Automatic Control.

[152]  M. Mitchell Waldrop,et al.  Complexity : the emerging science and the edge of order and chaos , 1992 .