Algorithmic randomness in empirical data

Abstract According to a traditional view, scientific laws and theories constitute algorithmic compressions of empirical data sets collected from observations and measurements. This article defends the thesis that, to the contrary, empirical data sets are algorithmically incompressible. The reason is that individual data points are determined partly by perturbations, or causal factors that cannot be reduced to any pattern. If empirical data sets are incompressible, then they exhibit maximal algorithmic complexity, maximal entropy and zero redundancy. They are therefore maximally efficient carriers of information about the world. Since, on algorithmic information theory, a string is algorithmically random just if it is incompressible, the thesis entails that empirical data sets consist of algorithmically random strings of digits. Rather than constituting compressions of empirical data, scientific laws and theories pick out patterns that data sets exhibit with a certain noise.

[1]  Leo Banet,et al.  Evolution of the Balmer Series , 1966 .

[2]  Ray J. Solomonoff,et al.  A Formal Theory of Inductive Inference. Part II , 1964, Inf. Control..

[3]  Grzegorz Rozenberg,et al.  Developments in Language Theory: At The Crossroads of Mathematics, Computer Science and Biology , 1994 .

[4]  H. Maxwell,et al.  Current Issues in the Philosophy of Science , 1961 .

[5]  James Prescott Joule,et al.  Mechanical Equivalent of Heat , 1871, Nature.

[6]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[7]  W. H. Zurek Complexity, Entropy and the Physics of Information , 1990 .

[8]  J. Woodward,et al.  Saving the phenomena , 1988 .

[9]  Thomas J. McCormack,et al.  The Science of Mechanics: a Critical and Historical Account of its Development , 2019, Nature.

[10]  Donald Ervin Knuth,et al.  The Art of Computer Programming, Volume II: Seminumerical Algorithms , 1970 .

[11]  Gregory J. Chaitin,et al.  Algorithmic Information Theory , 1987, IBM J. Res. Dev..

[12]  Cristian S. Calude Information and Randomness: An Algorithmic Perspective , 1994 .

[13]  M. Klein Book Review:The Aim and Structure of Physical Theory Pierre Duhem, P. P. Wiener , 1954 .

[14]  Ming Li,et al.  An Introduction to Kolmogorov Complexity and Its Applications , 2019, Texts in Computer Science.

[15]  Murray Gell-Mann,et al.  What Is Complexity , 2002 .

[16]  Paul H. Cootner The random character of stock market prices , 1968 .

[17]  John D. Barrow,et al.  Theories of Everything , 1991 .

[18]  William Feller,et al.  An Introduction to Probability Theory and Its Applications , 1951 .

[19]  Murray Gell-Mann,et al.  What is complexity? Remarks on simplicity and complexity by the Nobel Prize-winning author of The Quark and the Jaguar , 1995, Complex..

[20]  Bruce Glymou Data And Phenomena: A Distinction Reconsidered , 2000 .

[21]  Claude E. Shannon,et al.  The mathematical theory of communication , 1950 .

[22]  N. Cartwright How the laws of physics lie , 1984 .

[23]  G. Chaitin Randomness and Mathematical Proof , 1975 .

[24]  Andrei N. Kolmogorov,et al.  Logical basis for information theory and probability theory , 1968, IEEE Trans. Inf. Theory.

[25]  J. McAllister Phenomena and Patterns in Data Sets , 1997 .

[26]  A. Lo,et al.  A Non-Random Walk Down Wall Street , 1999 .

[27]  Jim Woodward,et al.  Data and phenomena , 1989, Synthese.

[28]  C. E. SHANNON,et al.  A mathematical theory of communication , 1948, MOCO.

[29]  A. H. Gordon Global Warming as a Manifestation of a Random Walk , 1991 .

[30]  J. Bye,et al.  Random walk expectancies for recent global climate, and in an enhanced Greenhouse warming , 1993 .

[31]  John B. Kidd,et al.  Models of Discovery , 1978 .

[32]  Cristian S. Calude,et al.  Algorithmically Coding the Universe , 1993, Developments in Language Theory.

[33]  Luigi G. Jacchia,et al.  Some thoughts about randomness , 1975 .

[34]  Theodore P. Hill The First Digit Phenomenon , 1998 .

[35]  Seth Lloyd,et al.  Information measures, effective complexity, and total information , 1996 .

[36]  Herbert A. Simon,et al.  Does Scientific Discovery Have a Logic , 1973 .