Active Information in Metabiology

Metabiology is a fascinating intellectual romp in the surreal world of the mathematics of algorithmic information theory. In this world, halting oracles hunt for busy beaver numbers and busy beaver numbers unearth Chaitin’s number, knowledge of which in turn allows resolution of numerous unsolved mathematical problems, many of whose solutions would earn large cash bounties. All this, despite the fact that halting oracles can’t be implemented on a computer, a computer can never make a list of busy beaver numbers, and Chaitin’s number, always a positive real number less than one, is proven to be unknowable. The fun of metabiology is the application of these ideas to illustrate Darwinian evolution. When metabiology’s evolutionary process is stripped of the glitter of algorithmic information theory, however, what remains is a procedure similar to that used in other attempts to model Darwinian evolution, like the ev and AVIDA computer programs. Metabiology, like ev and AVIDA, succeeds because available sources of knowledge about the solution being sought can be mined. We show the mining of information from a halting oracle has striking similarities to mining information from a simple Hamming oracle. Unlike a halting oracle, however, Hamming oracles can be implemented on a computer. We demonstrate that for both oracles, information can be mined by search strategies that are analogous in some respects even though the methods differ; in both cases the search strategy used greatly influences the result. Because metabiology’s process relies on unknowable numbers and infinite resources, its reported relative performance measures can only be expressed asymptotically. That is, the results of metabiology are only proven to be true on the largest possible scale. In fact, simple simulations using bounded resources suggest the asymptote is not always approached quickly, indicating that metabiology results may only hold for scales larger than any practical system.

[1]  Corrado Böhm,et al.  Flow diagrams, turing machines and languages with only two formation rules , 1966, CACM.

[2]  Robert T. Pennock,et al.  The evolutionary origin of complex features , 2003, Nature.

[3]  Tom M. Mitchell,et al.  The Need for Biases in Learning Generalizations , 2007 .

[4]  David H. Wolpert,et al.  Remarks on a recent paper on the "no free lunch" theorems , 2001, IEEE Trans. Evol. Comput..

[5]  Gregory J. Chaitin,et al.  The Unknowable , 1999, Nabokov and Indeterminacy.

[6]  Cullen Schaffer,et al.  A Conservation Law for Generalization Performance , 1994, ICML.

[7]  Robert J. Marks,et al.  Evolutionary synthesis of nand logic: Dissecting a digital organism , 2009, 2009 IEEE International Conference on Systems, Man and Cybernetics.

[8]  Gregory J. Chaitin,et al.  Exploring RANDOMNESS , 2001, Discrete Mathematics and Theoretical Computer Science.

[9]  Jeffrey Shallit,et al.  Information theory, evolutionary computation, and Dembski’s “complex specified information” , 2009, Synthese.

[10]  Martin Davis,et al.  Review: Corrado Bohm, On a Family of Turing Machines and the Related Programming Language , 1966 .

[11]  William A. Dembski,et al.  Bernoulli's principle of insufficient reason and conservation of information in computer search , 2009, 2009 IEEE International Conference on Systems, Man and Cybernetics.

[12]  A. Turing On Computable Numbers, with an Application to the Entscheidungsproblem. , 1937 .

[13]  T. Rado On non-computable functions , 1962 .

[14]  Jeffrey Shallit,et al.  Proving Darwin: Making Biology Mathematical , 2012 .

[15]  T. D. Schneider,et al.  Evolution of biological information. , 2000, Nucleic acids research.

[16]  Robert J. Marks,et al.  A Vivisection of the ev Computer Organism: Identifying Sources of Active Information , 2010 .

[17]  Yu-Chi Ho,et al.  The no free lunch theorems: complexity and security , 2003, IEEE Trans. Autom. Control..

[18]  S. Lloyd Computational capacity of the universe. , 2001, Physical review letters.

[19]  G. Chaitin Meta Math!: The Quest for Omega , 2004, math/0404335.

[20]  Robert J. Marks,et al.  The Search for a Search: Measuring the Information Cost of Higher Level Search , 2010, J. Adv. Comput. Intell. Intell. Informatics.

[21]  Robert J. Marks,et al.  Efficient per query information extraction from a Hamming oracle , 2010, 2010 42nd Southeastern Symposium on System Theory (SSST).

[22]  David H. Wolpert,et al.  No free lunch theorems for optimization , 1997, IEEE Trans. Evol. Comput..

[23]  Robert J. Marks,et al.  Climbing the Steiner Tree--Sources of Active Information in a Genetic Algorithm for Solving the Euclidean Steiner Tree Problem , 2012 .

[24]  Gregory J. Chaitin Thinking about Gödel and Turing - Essays on Complexity, 1970 - 2007 , 2007 .

[25]  Gregory J. Chaitin Conversations with a mathematician - math, art, science and the limits of reason , 2002 .

[26]  Robert J. Marks,et al.  Conservation of Information in Search: Measuring the Cost of Success , 2009, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[27]  Gregory J. Chaitin The LIMITS of MATHEMATICS: A Course on Information Theory and the Limits of Formal Reasoning , 2012 .

[28]  Yu-Chi Ho,et al.  Simple Explanation of the No Free Lunch Theorem of Optimization , 2001 .