Entropy Methods in Guided Self-Organisation

Self-organisation occurs in natural phenomena when a spontaneous increase in order is produced by the interactions of elements of a complex system. Thermodynamically, this increase must be offset by production of entropy which, broadly speaking, can be understood as a decrease in order. Ideally, self-organisation can be used to guide the system towards a desired regime or state, while "exporting" the entropy to the system's exterior. Thus, Guided Self-Organisation (GSO) attempts to harness the order-inducing potential of self-organisation for specific purposes. Not surprisingly, general methods developed to study entropy can also be applied to guided self-organisation. This special issue covers abroad diversity of GSO approaches which can be classified in three categories: information theory, intelligent agents, and collective behavior. The proposals make another step towards a unifying theory of GSO which promises to impact numerous research fields.

[1]  T. Bossomaier,et al.  Information flow in a kinetic Ising model peaks in the disordered phase. , 2013, Physical review letters.

[2]  M. Prokopenko.  Guided self‐organization , 2009, HFSP journal.

[3]  Surya Girinatha Nurzaman,et al.  Guided Self-Organization in a Dynamic Embodied System Based on Attractor Selection Mechanism , 2014, Entropy.

[4]  Seth Lloyd,et al.  Information measures, effective complexity, and total information , 1996 .

[5]  J. Crutchfield.  The calculi of emergence: computation, dynamics and induction , 1994 .

[6]  Pawel Mackiewicz,et al.  Possible import routes of proteins into the cyanobacterial endosymbionts/plastids of Paulinella chromatophora , 2011, Theory in Biosciences.

[7]  Jason B. Scholz,et al.  Action-Amplitude Approach to Controlled Entropic Self-Organization , 2014, Entropy.

[8]  Carlos Gershenson,et al.  Self-organizing Traffic Lights , 2004, Complex Syst..

[9]  Mark E. J. Newman,et al.  The Structure and Function of Complex Networks , 2003, SIAM Rev..

[10]  Colin S. Reynolds,et al.  Complexity and emergent properties in aquatic ecosystems: predictability of ecosystem responses , 2012 .

[11]  Randall D. Beer,et al.  Nonnegative Decomposition of Multivariate Information , 2010, ArXiv.

[12]  Inman Harvey,et al.  Dynamical Analysis of Evolved Agents: A Primer , 2014 .

[13]  Chrystopher L. Nehaniv,et al.  Empowerment: a universal agent-centric measure of control , 2005, 2005 IEEE Congress on Evolutionary Computation.

[14]  Miroslaw Malek,et al.  The consensus problem in fault-tolerant computing , 1993, CSUR.

[15]  K. Kaneko,et al.  Adaptive Response of a Gene Network to Environmental Changes by Fitness-Induced Attractor Selection , 2006, PloS one.

[16]  Daniel Polani,et al.  How Information and Embodiment Shape Intelligent Information Processing , 2006, 50 Years of Artificial Intelligence.

[17]  Branko Ristic,et al.  Autonomous Search for a Diffusive Source in an UnknownStructured Environment , 2013, Entropy.

[18]  Claudius Gros,et al.  Complex and Adaptive Dynamical Systems: A Primer , 2008 .

[19]  W. Ramsey,et al.  The Cambridge Handbook of Artificial Intelligence , 2014 .

[20]  Christoph Salge,et al.  A Bivariate Measure of Redundant Information , 2012, Physical review. E, Statistical, nonlinear, and soft matter physics.

[21]  R. Beer.  The Cambridge Handbook of Artificial Intelligence: Dynamical systems and embedded cognition , 2014 .

[22]  Mark E. J. Newman,et al.  Structure and Dynamics of Networks , 2009 .

[23]  James P. Crutchfield,et al.  Computational Mechanics: Pattern and Prediction, Structure and Simplicity , 1999, ArXiv.

[24]  Miguel Angel Fuentes.  Complexity and the Emergence of Physical Properties , 2014, Entropy.

[25]  Philippe Capdepuy,et al.  Maximization of Potential Information Flow as a Universal Utility for Collective Behaviour , 2007, 2007 IEEE Symposium on Artificial Life.

[26]  Daniel Polani,et al.  Information and Self-Organization of Behavior , 2013, Adv. Complex Syst..

[27]  Daniel Polani,et al.  On the Cross-Disciplinary Nature of Guided Self-Organisation , 2014 .

[28]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[29]  Nando de Freitas,et al.  Rao-Blackwellised Particle Filtering for Dynamic Bayesian Networks , 2000, UAI.

[30]  Lucio Marcenaro,et al.  Randomized Binary Consensus with Faulty Agents , 2014, Entropy.

[31]  James P. Crutchfield,et al.  Intersection Information Based on Common Randomness , 2013, Entropy.

[32]  X. R. Wang,et al.  Relating Fisher information to order parameters. , 2011, Physical review. E, Statistical, nonlinear, and soft matter physics.

[33]  R. Der.  On the Role of Embodiment for Self-Organizing Robots: Behavior As Broken Symmetry , 2014 .

[34]  Mikhail Prokopenko,et al.  Guided Self-Organization: Inception , 2014 .

[35]  Carlos Gershenson,et al.  Information Measures of Complexity, Emergence, Self-organization, Homeostasis, and Autopoiesis , 2013, ArXiv.

[36]  Terry Bossomaier,et al.  Strategic Islands in Economic Games: Isolating Economies From Better Outcomes , 2014, Entropy.

[37]  Christoph Salge,et al.  Approximation of Empowerment in the continuous Domain , 2013, Adv. Complex Syst..

[38]  Ralf Der,et al.  Robot Learning by Guided Self-Organization , 2014 .

[39]  Giovanni Lo Iacono,et al.  A Comparison of Different Searching Strategies to Locate Sources of Odor in Turbulent Flows , 2010, Adapt. Behav..

[40]  Mikhail Prokopenko,et al.  Transfer Entropy and Transient Limits of Computation , 2014, Scientific Reports.

[41]  Olaf Sporns,et al.  Mapping Information Flow in Sensorimotor Networks , 2006, PLoS Comput. Biol..

[42]  Duncan J. Watts,et al.  The Structure and Dynamics of Networks: (Princeton Studies in Complexity) , 2006 .

[43]  C. Gershenson.  The Implications of Interactions for Science and Philosophy , 2011, 1105.2827.

[44]  Ralph Linsker,et al.  Self-organization in a perceptual network , 1988, Computer.

[45]  Albert Y. Zomaya,et al.  A framework for the local information dynamics of distributed computation in complex systems , 2008, ArXiv.

[46]  Ralf Der,et al.  The Playful Machine - Theoretical Foundation and Practical Realization of Self-Organizing Robots , 2012, Cognitive Systems Monographs.

[47]  Randall D. Beer,et al.  Dynamical Analysis of Evolved Agents : A Primer , 2009 .

[48]  H. Von Foerster,et al.  On Self-Organizing Systems and Their Environments , 2003 .

[49]  C. Shalizi,et al.  Causal architecture, complexity and self-organization in time series and cellular automata , 2001 .

[50]  Stefan Wolf,et al.  Zero-error information and applications in cryptography , 2004, Information Theory Workshop.

[51]  Christoph Salge,et al.  Changing the Environment Based on Empowerment as Intrinsic Motivation , 2014, Entropy.

[52]  Daniel Polani,et al.  Information: Currency of life? , 2009, HFSP journal.

[53]  Joseph T. Lizier,et al.  Towards a synergy-based approach to measuring information modification , 2013, 2013 IEEE Symposium on Artificial Life (ALife).

[54]  Carlos Gershenson,et al.  Guiding the self-organization of random Boolean networks , 2010, Theory in Biosciences.

[55]  C. Gros.  Generating Functionals for Guided Self-Organization , 2013, 1307.7872.

[56]  Peter Stone,et al.  Empowerment for continuous agent—environment systems , 2011, Adapt. Behav..

[57]  Ralf Der,et al.  Information-driven self-organization: the dynamical system approach to autonomous robot behavior , 2012, Theory in Biosciences.

[58]  Ralf Der,et al.  Guided self-organization: perception–action loops of embodied systems , 2011, Theory in Biosciences.

[59]  Albert Y. Zomaya,et al.  Assortativeness and information in scale-free networks , 2009 .

[60]  Ralf Der,et al.  Homeokinesis - A new principle to back up evolution with learning , 1999 .

[61]  Carlos Gershenson,et al.  Measuring the Complexity of Self-Organizing Traffic Lights , 2014, Entropy.

[62]  Mikhail Prokopenko,et al.  An information-theoretic primer on complexity, self-organization, and emergence , 2009, Complex..

[63]  Carlos Gershenson,et al.  Computing networks: A general framework to contrast neural and swarm cognitions , 2010, Paladyn J. Behav. Robotics.

[64]  Mikhail Prokopenko,et al.  On Thermodynamic Interpretation of Transfer Entropy , 2013, Entropy.

[65]  Daniel Polani,et al.  Effects of Anticipation in Individually Motivated Behaviour on Survival and Control in a Multi-Agent Scenario with Resource Constraints , 2014, Entropy.

[66]  Chrystopher L. Nehaniv,et al.  All Else Being Equal Be Empowered , 2005, ECAL.

[67]  Gavin E Crooks,et al.  Measuring thermodynamic length. , 2007, Physical review letters.

[68]  Albert Y. Zomaya,et al.  Coherent information structure in complex computation , 2012, Theory in Biosciences.

[69]  Carlos Gershenson,et al.  Self-organizing traffic lights at multiple-street intersections , 2011, Complex..

[70]  Christof Koch,et al.  Quantifying synergistic mutual information , 2012, ArXiv.