Detecting emergent processes in cellular automata with excess information

Many natural processes occur over characteristic spatial and temporal scales. This paper presents tools for (i) flexibly and scalably coarse-graining cellular automata and (ii) identifying which coarse-grainings express an automaton's dynamics well, and which express its dynamics badly. We apply the tools to investigate a range of examples in Conway's Game of Life and Hopfield networks and demonstrate that they capture some basic intuitions about emergent processes. Finally, we formalize the notion that a process is emergent if it is better expressed at a coarser granularity.

[1]  Giulio Tononi,et al.  Integrated Information in Discrete Dynamical Systems: Motivation and Theoretical Framework , 2008, PLoS Comput. Biol..

[2]  P. Anderson.  More is different. , 1972, Science.

[3]  J. Crutchfield.  The calculi of emergence: computation, dynamics and induction , 1994 .

[4]  Daniel Polani.  Emergence, Intrinsic Structure of Information, and Agenthood , 2010 .

[5]  Paul Miller,et al.  Natural stimuli evoke dynamic sequences of states in sensory cortical ensembles , 2007, Proceedings of the National Academy of Sciences.

[6]  J. Pearl.  Causality: Models, Reasoning and Inference , 2000 .

[7]  Karl J. Friston.  Transients, Metastability, and Neuronal Dynamics , 1997, NeuroImage.

[8]  Randall D. Beer,et al.  Autopoiesis and Cognition in the Game of Life , 2004, Artificial Life.

[9]  G. Tononi.  An information integration theory of consciousness , 2004, BMC Neuroscience.

[10]  Anil K. Seth,et al.  Measuring Autonomy and Emergence via Granger Causality , 2010, Artificial Life.

[11]  M. Bedau.  Emergent Models of Supple Dynamics in Life and Mind , 1997, Brain and Cognition.

[12]  Giulio Tononi,et al.  Qualia: The Geometry of Integrated Information , 2009, PLoS Comput. Biol..

[13]  E. Berlekamp,et al.  Winning Ways for Your Mathematical Plays , 1983 .

[14]  Naftali Tishby,et al.  Cortical activity flips among quasi-stationary states. , 1995, Proceedings of the National Academy of Sciences of the United States of America.

[15]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[16]  Elwyn R. Berlekamp,et al.  Winning Ways for Your Mathematical Plays, Volume 2 , 2003 .

[17]  C. Moore,et al.  What Is a Macrostate? Subjective Observations and Objective Dynamics , 2003, cond-mat/0303625.

[18]  Daniel J. Amit,et al.  Modeling brain function: the world of attractor neural networks, 1st Edition , 1989 .