Logical depth and physical complexity

Some mathematical and natural objects (a random sequence, a sequence of zeros, a perfect crystal, a gas) are intuitively trivial, while others (e.g. the human body, the digits of π) contain internal evidence of a nontrivial causal history. We formalize this distinction by defining an object’s “logical depth” as the time required by a standard universal Turing machine to generate it from an input that is algorithmically random (i.e. Martin-Lof random). This definition of depth is shown to be reasonably machineindependent, as well as obeying a slow-growth law: deep objects cannot be quickly produced from shallow ones by any deterministic process, nor with much probability by a probabilistic process, but can be produced slowly. Next we apply depth to the physical problem of “self-organization,” inquiring in particular under what conditions (e.g. noise, irreversibility, spatial and other symmetries of the initial conditions and equations of motion) statistical-mechanical model systems can imitate computers well enough to undergo unbounded increase of depth in the limit of infinite space and time.

[1]  A. Turing On Computable Numbers, with an Application to the Entscheidungsproblem. , 1937 .

[2]  Wolfram,et al.  Undecidability and intractability in theoretical physics. , 1985, Physical review letters.

[3]  Gregory J. Chaitin,et al.  A recent technical report , 1974, SIGA.

[4]  Bennett,et al.  Role of irreversibility in stabilizing complex and nonergodic behavior in locally interacting discrete systems. , 1985, Physical review letters.

[5]  Juris Hartmanis,et al.  Generalized Kolmogorov complexity and the structure of feasible computations , 1983, 24th Annual Symposium on Foundations of Computer Science (sfcs 1983).

[6]  Manuel Blum,et al.  How to generate cryptographically strong sequences of pseudo random bits , 1982, 23rd Annual Symposium on Foundations of Computer Science (sfcs 1982).

[7]  Claus-Peter Schnorr,et al.  The process complexity and effective random tests. , 1972, STOC.

[8]  Ray J. Solomonoff,et al.  A Formal Theory of Inductive Inference. Part I , 1964, Inf. Control..

[9]  John Gill,et al.  Relative to a Random Oracle A, PA != NPA != co-NPA with Probability 1 , 1981, SIAM J. Comput..

[10]  Charles Radin Tiling, periodicity, and crystals , 1985 .

[11]  Gregory. J. Chaitin,et al.  Algorithmic information theory , 1987, Cambridge tracts in theoretical computer science.

[12]  Per Martin-Löf,et al.  The Definition of Random Sequences , 1966, Inf. Control..

[13]  Leonid A. Levin,et al.  Invariant Properties of Informational Bulks , 1977, MFCS.

[14]  J. Borges Labyrinths: Selected Stories and Other Writings , 1962 .

[15]  Silvio Micali,et al.  How to construct random functions , 1986, JACM.

[16]  Ray J. Solomonoff,et al.  A Formal Theory of Inductive Inference. Part II , 1964, Inf. Control..

[17]  Alan M. Turing,et al.  Computability and λ-definability , 1937, Journal of Symbolic Logic.

[18]  Péter Gács,et al.  Every Sequence Is Reducible to a Random One , 1986, Inf. Control..

[19]  N. Margolus Physics-like models of computation☆ , 1984 .

[20]  R. Robinson Undecidability and nonperiodicity for tilings of the plane , 1971 .

[21]  Jr. Hartley Rogers Theory of Recursive Functions and Effective Computability , 1969 .

[22]  Charles H. Bennett,et al.  On the nature and origin of complexity in discrete, homogeneous, locally-interacting systems , 1986 .

[23]  Jorge Nuno Silva,et al.  Mathematical Games , 1959, Nature.

[24]  Stuart A. Kurtz,et al.  On the random oracle hypothesis , 1982, STOC '82.

[25]  D. C. Cooper,et al.  Theory of Recursive Functions and Effective Computability , 1969, The Mathematical Gazette.

[26]  Dale Myers,et al.  Nonrecursive tilings of the plane. II , 1974, Journal of Symbolic Logic.

[27]  N. Balazs,et al.  Fundamental Problems in Statistical Mechanics , 1962 .

[28]  Stephen Wolfram,et al.  Theory and Applications of Cellular Automata , 1986 .

[29]  Claus-Peter Schnorr,et al.  Process complexity and effective random tests , 1973 .

[30]  Leonid A. Levin,et al.  Randomness Conservation Inequalities; Information and Independence in Mathematical Theories , 1984, Inf. Control..

[31]  Charles Radin,et al.  The unstable chemical structure of quasicrystalline alloys , 1986 .

[32]  Péter Gács,et al.  On the relation between descriptional complexity and algorithmic probability , 1981, 22nd Annual Symposium on Foundations of Computer Science (sfcs 1981).

[33]  L. Levin,et al.  THE COMPLEXITY OF FINITE OBJECTS AND THE DEVELOPMENT OF THE CONCEPTS OF INFORMATION AND RANDOMNESS BY MEANS OF THE THEORY OF ALGORITHMS , 1970 .

[34]  Andrew Chi-Chih Yao,et al.  Theory and Applications of Trapdoor Functions (Extended Abstract) , 1982, FOCS.

[35]  Leonid A. Levin,et al.  One-way functions and pseudorandom generators , 1985, STOC '85.

[36]  Jorge Luis Borges,et al.  Labyrinths; selected stories and other writings [translated from the Spanish] , 1972 .

[37]  A. Kolmogorov Three approaches to the quantitative definition of information , 1968 .

[38]  A. Turing The chemical basis of morphogenesis , 1952, Philosophical Transactions of the Royal Society of London. Series B, Biological Sciences.

[39]  J. Myhill,et al.  A recursive function, defined on a compact interval and having a continuous derivative that is not recursive. , 1971 .