Very Simple Chaitin Machines for Concrete AIT

In 1975, Chaitin introduced his celebrated Omega number, the halting probability of a universal Chaitin machine, a universal Turing machine with a prefix-free domain. The Omega number's bits are algorithmically random-there is no reason the bits should be the way they are, if we define "reason" to be a computable explanation smaller than the data itself. Since that time, only two explicit universal Chaitin machines have been proposed, both by Chaitin himself. Concrete algorithmic information theory involves the study of particular universal Turing machines, about which one can state theorems with specific numerical bounds, rather than include terms like O(1). We present several new tiny Chaitin machines (those with a prefix-free domain) suitable for the study of concrete algorithmic information theory. One of the machines, which we call Keraia, is a binary encoding of lambda calculus based on a curried lambda operator. Source code is included in the appendices. We also give an algorithm for restricting the domain of blank-endmarker machines to a prefix-free domain over an alphabet that does not include the endmarker; this allows one to take many universal Turing machines and construct universal Chaitin machines from them.

[1]  Alonzo Church,et al.  A note on the Entscheidungsproblem , 1936, Journal of Symbolic Logic.

[2]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[3]  Cristian S. Calude,et al.  Computing a Glimpse of Randomness , 2002, Exp. Math..

[4]  A. Kolmogorov Three approaches to the quantitative definition of information , 1968 .

[5]  Ray J. Solomonoff,et al.  A Formal Theory of Inductive Inference. Part II , 1964, Inf. Control..

[6]  John Tromp Binary Lambda Calculus and Combinatory Logic , 2006, Kolmogorov Complexity and Applications.

[7]  A. Turing On Computable Numbers, with an Application to the Entscheidungsproblem. , 1937 .

[8]  Gregory J. Chaitin,et al.  A recent technical report , 1974, SIGA.

[9]  A. Church An Unsolvable Problem of Elementary Number Theory , 1936 .

[10]  Gregory J. Chaitin,et al.  On the Length of Programs for Computing Finite Binary Sequences , 1966, JACM.

[11]  de Ng Dick Bruijn,et al.  Lambda calculus notation with nameless dummies, a tool for automatic formula manipulation, with application to the Church-Rosser theorem , 1972 .

[12]  Cristian Claude,et al.  Information and Randomness: An Algorithmic Perspective , 1994 .

[13]  Marcus Hutter,et al.  Algorithmic Information Theory , 1977, IBM J. Res. Dev..

[14]  Gregory J. Chaitin,et al.  Algorithmic Information Theory , 1987, IBM J. Res. Dev..

[15]  Gregory J. Chaitin,et al.  Elegant Lisp Programs , 2003 .

[16]  Cristian S. Calude Information and Randomness: An Algorithmic Perspective , 1994 .

[17]  Gregory J. Chaitin An Invitation to Algorithmic Information Theory , 1996, DMTCS.