A Package for Measuring Emergence, Self-organization, and Complexity Based on Shannon Entropy

We present Matlab/Octave functions to calculate measures of emergence, self-organization, and complexity of discrete and continuous data. The measures are based on Shannon's information and differential entropy, respectively. Examples from different datasets and probability distributions are used to illustrate the usage of the code.

[1]  Ricardo López-Ruiz,et al.  A Statistical Measure of Complexity , 1995, ArXiv.

[2]  Hadi Fanaee-T,et al.  Event labeling combining ensemble detectors and background knowledge , 2014, Progress in Artificial Intelligence.

[3]  Melanie Mitchell,et al.  Complexity - A Guided Tour , 2009 .

[4]  Carlos Gershenson,et al.  Complexity and information: Measuring emergence, self-organization, and homeostasis at multiple scales , 2012, Complex..

[5]  Hector Zenil,et al.  A Decomposition Method for Global Evaluation of Shannon Entropy and Local Estimations of Algorithmic Complexity , 2016, Entropy.

[6]  Carlos Gershenson,et al.  When Can We Call a System Self-Organizing? , 2003, ECAL.

[7]  Joseph T. Lizier,et al.  JIDT: An Information-Theoretic Toolkit for Studying the Dynamics of Complex Systems , 2014, Front. Robot. AI.

[8]  Mikhail Prokopenko,et al.  An information-theoretic primer on complexity, self-organization, and emergence , 2009 .

[9]  Juval Portugali,et al.  Information and Self-Organization , 2016, Entropy.

[10]  B. Pompe,et al.  Permutation entropy: a natural complexity measure for time series. , 2002, Physical review letters.

[11]  Hector Zenil,et al.  Algorithmic complexity for psychology: a user-friendly implementation of the coding theorem method , 2016, Behavior research methods.

[12]  Jean-Paul Delahaye,et al.  Calculating Kolmogorov Complexity from the Output Frequency Distributions of Small Turing Machines , 2012, PloS one.

[13]  L. Jost.  Entropy and diversity , 2006 .

[14]  Hector Zenil,et al.  Low Algorithmic Complexity Entropy-deceiving Graphs , 2016, Physical review. E.

[15]  Carlos Gershenson,et al.  Measuring the Complexity of Continuous Distributions , 2015, Entropy.

[16]  Carlos Gershenson,et al.  Information Measures of Complexity, Emergence, Self-organization, Homeostasis, and Autopoiesis , 2013, ArXiv.

[17]  Stuart A. Kauffman,et al.  ORIGINS OF ORDER , 2019, Origins of Order.