In a previous paper a theory of program size formally identical to information theory was developed. The entropy of an individual finite object was defined to be the size in bits of the smallest program for calculating it. It was shown that this is − log2 of the probability that the object is obtained by means of a program whose successive bits are chosen by flipping an unbiased coin. Here a theory of the entropy of recursively enumerable sets of objects is proposed which includes the previous theory as the special case of sets having a single element. The primary concept in the generalized theory is the probability that a computing machine enumerates a given set when its program is manufactured by coin flipping. The entropy of a set is defined to be − log2 of this probability.
[1]
G. Chaitin.
Randomness and Mathematical Proof
,
1975
.
[2]
G. Chaitin.
Program size, oracles, and the jump operation
,
1977
.
[3]
G. Chaitin.
A Theory of Program Size Formally Identical to Information Theory
,
1975,
JACM.
[4]
R. M. Solovay.
On Random R, E. Sets
,
1977
.
[5]
Gregory J. Chaitin.
Information-Theoretic Characterizations of Recursive Infinite Strings
,
1976,
Theor. Comput. Sci..
[6]
Jr. Hartley Rogers.
Theory of Recursive Functions and Effective Computability
,
1969
.