Measuring Self-Organization via Observers

We introduce organization information, an information-theoretic characterization for the phenomenon of self-organization. This notion, which requires the specification of an observer, is discussed in the paradigmatic context of the Self-Organizing Map and its behaviour is compared to that of other information-theoretic measures. We show that it is sensitive to the presence and absence of “self-organization” (in the intuitive sense) in cases where conventional measures fail.

[1]  Thomas Villmann,et al.  Topology preservation in self-organizing feature maps: exact definition and measurement , 1997, IEEE Trans. Neural Networks.

[2]  Gottfried Jetschke,et al.  Mathematik der Selbstorganisation , 1989 .

[3]  J. Crutchfield.  The calculi of emergence: computation, dynamics and induction , 1994 .

[4]  I. Prigogine,et al.  Formative Processes. (Book Reviews: Self-Organization in Nonequilibrium Systems. From Dissipative Structures to Order through Fluctuations) , 1977 .

[5]  C. Adami,et al.  Introduction To Artificial Life , 1997, IEEE Trans. Evol. Comput..

[6]  C. Emmeche,et al.  On emergence and explanation , 1997 .

[7]  L. Reichl.  A modern course in statistical physics , 1980 .

[8]  D. Banabic,et al.  Recent advances and applications , 2004 .

[9]  W. Ashby,et al.  Principles of the self-organizing dynamic system. , 1947, The Journal of general psychology.

[10]  Teuvo Kohonen,et al.  Self-Organizing Maps , 2010 .

[11]  J. Schnakenberg,et al.  G. Nicolis und I. Prigogine: Self‐Organization in Nonequilibrium Systems. From Dissipative Structures to Order through Fluctuations. J. Wiley & Sons, New York, London, Sydney, Toronto 1977. 491 Seiten, Preis: £ 20.–, $ 34.– , 1978 .

[12]  Donald O. Walter,et al.  Self-Organizing Systems , 1987, Life Science Monographs.

[13]  G. Edelman,et al.  A measure for brain complexity: relating functional segregation and integration in the nervous system. , 1994, Proceedings of the National Academy of Sciences of the United States of America.

[14]  Daniel Polani,et al.  Order Parameters for Self-Organizing Maps , 1998 .

[15]  C. A. R. Hoare.  Computer Science and Technology and their application , 1976 .

[16]  D. Polani.  Measures for the organization of self-organizing maps , 2001 .

[17]  Martin Nilsson,et al.  Ansatz for Dynamical Hierarchies , 2002, Artificial Life.

[18]  W. Walter.  A Machine that Learns , 1951 .

[19]  Teuvo Kohonen,et al.  Self-Organization and Associative Memory , 1988 .

[20]  Terrence J. Sejnowski,et al.  A Unifying Objective Function for Topographic Mappings , 1997, Neural Computation.

[21]  Lakhmi C. Jain,et al.  Self-Organizing Neural Networks , 2002 .

[22]  Klaus Schulten,et al.  Self-organizing maps: ordering, convergence properties and energy functions , 1992, Biological Cybernetics.