Information-Theoretic Computational Complexity Invited Paper

This paper attempts to describe, in nontechnical language, some of the concepts and methods of one school of thought regarding computational complexity. It applies the viewpoint of information theory to computers. This will first lead us to a definition of the degree of randomness of individual binary strings, and then to an information-theoretic version of Godel's theorem on the limitations of the axiomatic method. Finally, we will examine in the light of these ideas the scientific method and von Neumann's views on the basic conceptual problems of biology.

[1]  John von Neumann,et al.  The Computer and the Brain , 1960 .

[2]  G. Schlesinger Method in the physical sciences , 1963 .

[3]  Jean,et al.  The Computer and the Brain , 1989, Annals of the History of Computing.

[4]  D. C. Cooper,et al.  Theory of Recursive Functions and Effective Computability , 1969, The Mathematical Gazette.

[5]  J. Ferreirós From Frege to Gödel. A Source Book in Mathematical Logic, 1879¿1931: By Jean van Heijenoort. Cambridge, MA (Harvard University Press). 1967; new paperback edn., 2002. 664 pages, 1 halftone. ISBN: 0-674-32449-8. $27.95 , 2004 .

[6]  John von Neumann,et al.  Theory Of Self Reproducing Automata , 1967 .

[7]  B. Chandrasekaran,et al.  Artificial Intelligence-A Case for Agnosticism , 1974, IEEE Trans. Syst. Man Cybern..

[8]  Gregory J. Chaitin,et al.  On the difficulty of computations , 1970, IEEE Trans. Inf. Theory.

[9]  Martin Davis,et al.  The Undecidable: Basic Papers on Undecidable Propositions, Unsolvable Problems and Computable Functions , 2004 .

[10]  Ray J. Solomonoff,et al.  A Formal Theory of Inductive Inference. Part II , 1964, Inf. Control..

[11]  Ray J. Solomonoff,et al.  A Formal Theory of Inductive Inference. Part I , 1964, Inf. Control..

[12]  M. Eigen Selforganization of matter and the evolution of biological macromolecules , 1971, Naturwissenschaften.

[13]  M. Kac Statistical Independence in Probability Analysis and Number Theory , 1959 .

[14]  Jr. Hartley Rogers Theory of Recursive Functions and Effective Computability , 1969 .

[15]  E. Rowland Theory of Games and Economic Behavior , 1946, Nature.

[16]  J. Heijenoort From Frege to Gödel: A Source Book in Mathematical Logic, 1879-1931 , 1967 .

[17]  P. Holgate,et al.  Statistical Independence in Probability, Analysis and Number Theory , 1962, Mathematical Gazette.

[18]  高橋 陽一郎 名著発掘 「Statistical Independence in Probability,Analysis and Number Theory--The Carus Mathematical Monographs,Number 12,The Mathematical Association of America」Marc Kac--Marc Kacの珠玉の1冊 , 2001 .

[19]  Andrei N. Kolmogorov,et al.  Logical basis for information theory and probability theory , 1968, IEEE Trans. Inf. Theory.

[20]  Gregory J. Chaitin,et al.  Information-Theoretic Limitations of Formal Systems , 1974, JACM.