Grounding Occam's Razor in a Formal Theory of Simplicity

A formal theory of simplicity is introduced, in the context of a "combinational" computation model that views computation as comprising the iterated transformational and compositional activity of a population of agents upon each other. Conventional measures of simplicity in terms of algorithmic information etc. are shown to be special cases of a broader understanding of the core "symmetry" properties constituting what is defined here as a Compositional Simplicity Measure (CoSM). This theory of CoSMs is extended to a theory of CoSMOS (Combinational Simplicity Measure Operating Sets) which involve multiple simplicity measures utilized together. Given a vector of simplicity measures, an entity is associated not with an individual simplicity value but with a "simplicity bundles" of Pareto-optimal simplicity-value vectors. CoSMs and CoSMOS are then used as a foundation for a theory of pattern and multipattern, and a theory of hierarchy and heterarchy in systems of patterns. A formalization of the cognitive-systems notion of a "coherent dual network" interweaving hierarchy and heterarchy in a consistent way is presented. The high level end result of this investigation is to re-envision Occam's Razor as something like: When in doubt, prefer hypotheses whose simplicity bundles are Pareto optimal, partly because doing so both permits and benefits from the construction of coherent dual networks comprising coordinated and consistent multipattern hierarchies and heterarchies.

[1]  Eric B. Baum,et al.  What is thought? , 2003 .

[2]  Hugh G. Gauch,et al.  Scientific method in practice , 2002 .

[3]  Moshe Koppel,et al.  Complexity, Depth, and Sophistication , 1987, Complex Syst..

[4]  Ben Goertzel,et al.  The Evolving Mind , 1993 .

[5]  Rodney G. Downey,et al.  Algorithmic randomness , 2007, Scholarpedia.

[6]  L. Christophorou Science , 2018, Emerging Dynamics: Science, Energy, Society and Values.

[7]  Viktoras Veitas,et al.  Open ended intelligence: the individuation of intelligent agents , 2015, J. Exp. Theor. Artif. Intell..

[8]  Ray J. Solomonoff,et al.  A Formal Theory of Inductive Inference. Part II , 1964, Inf. Control..

[9]  W. H. Zurek,et al.  Algorithmic randomness, physical entropy, measurements, and the demon of choice , 1999 .

[10]  Louise Poissant Part I , 1996, Leonardo.

[11]  J. Schmidhuber,et al.  Frontier Search , 2009 .

[12]  Ray J. Solomonoff,et al.  A Formal Theory of Inductive Inference. Part I , 1964, Inf. Control..

[13]  G. Popkin The hidden pattern , 2017 .

[14]  Johan Wagemans,et al.  Depth , 2011, i-Perception.

[15]  Marcus Hutter,et al.  Algorithmic Information Theory , 1977, IBM J. Res. Dev..

[16]  M. Tribus,et al.  Probability theory: the logic of science , 2003 .

[17]  Zurek,et al.  Algorithmic randomness and physical entropy. , 1989, Physical review. A, General physics.

[18]  R. T. Cox,et al.  The Algebra of Probable Inference , 1962 .

[19]  J. Crotts Why Choose this Book? How we make decisions , 2008 .

[20]  Marcus Hutter,et al.  Universal Artificial Intellegence - Sequential Decisions Based on Algorithmic Probability , 2005, Texts in Theoretical Computer Science. An EATCS Series.

[21]  D J Rogers,et al.  A Computer Program for Classifying Plants. , 1960, Science.

[22]  Richard E. Korf,et al.  Frontier search , 2005, JACM.