Uniform test of algorithmic randomness over a general space

The algorithmic theory of randomness is well developed when the underlying space is the set of finite or infinite sequences and the underlying probability distribution is the uniform distribution or a computable distribution. These restrictions seem artificial. Some progress has been made to extend the theory to arbitrary Bernoulli distributions (by Martin-Lof) and to arbitrary distributions (by Levin). We recall the main ideas and problems of Levin's theory, and report further progress in the same framework. The issues are the following: • Allow non-compact spaces (like the space of continuous functions, underlying the Brownian motion). • The uniform test (deficiency of randomness) dp(x) (depending both on the outcome x and the measure P) should be defined in a general and natural way. • See which of the old results survive: existence of universal tests, conservation of randomness, expression of tests in terms of description complexity, existence of a universal measure, expression of mutual information as "deficiency of independence". • The negative of the new randomness test is shown to be a generalization of complexity in continuous spaces; we show that the addition theorem survives.The paper's main contribution is introducing an appropriate framework for studying these questions and related ones (like statistics for a general family of distributions).

[1]  Klaus Weihrauch,et al.  Computable Analysis: An Introduction , 2014, Texts in Theoretical Computer Science. An EATCS Series.

[2]  R. Ho Algebraic Topology , 2022 .

[3]  Zurek,et al.  Algorithmic randomness and physical entropy. , 1989, Physical review. A, General physics.

[4]  Leon W. Cohen,et al.  Topology and measure , 1978 .

[5]  Ray J. Solomonoff,et al.  Complexity-based induction systems: Comparisons and convergence theorems , 1978, IEEE Trans. Inf. Theory.

[6]  Péter Gács,et al.  Exact Expressions for Some Randomness Tests , 1979, Math. Log. Q..

[7]  Vasco Brattka,et al.  Computability on subsets of metric spaces , 2003, Theor. Comput. Sci..

[8]  Claus-Peter Schnorr,et al.  Process complexity and effective random tests , 1973 .

[9]  Vasco Brattka,et al.  Computability over Topological Structures , 2003 .

[10]  K. Mainzer,et al.  Natural Numbers, Integers, and Rational Numbers , 1991 .

[11]  Klaus Weihrauch,et al.  Randomness Spaces , 1998, ICALP.

[12]  S. Barry Cooper,et al.  Computability And Models , 2003 .

[13]  D. A. Edwards On the existence of probability measures with given marginals , 1978 .

[14]  Ray J. Solomonoff,et al.  A Formal Theory of Inductive Inference. Part II , 1964, Inf. Control..

[15]  V. Vovk,et al.  On the Empirical Validity of the Bayesian Method , 1993 .

[16]  Péter Gács,et al.  On the relation between descriptional complexity and algorithmic probability , 1981, 22nd Annual Symposium on Foundations of Computer Science (sfcs 1981).

[17]  Gregory J. Chaitin,et al.  A recent technical report , 1974, SIGA.

[18]  L. Levin,et al.  THE COMPLEXITY OF FINITE OBJECTS AND THE DEVELOPMENT OF THE CONCEPTS OF INFORMATION AND RANDOMNESS BY MEANS OF THE THEORY OF ALGORITHMS , 1970 .

[19]  P. Gács The Boltzmann entropy and randomness tests , 1994, Proceedings Workshop on Physics and Computation. PhysComp '94.

[20]  Per Martin-Löf,et al.  The Definition of Random Sequences , 1966, Inf. Control..

[21]  D. Pollard A User's Guide to Measure Theoretic Probability by David Pollard , 2001 .

[22]  Max L. Warshauer,et al.  Lecture Notes in Mathematics , 2001 .

[23]  Flemming Topsøe,et al.  Topology and Measure , 1970 .

[24]  Ming Li,et al.  An Introduction to Kolmogorov Complexity and Its Applications , 2019, Texts in Computer Science.

[25]  Leonid A. Levin,et al.  Randomness Conservation Inequalities; Information and Independence in Mathematical Theories , 1984, Inf. Control..

[26]  Claus-Peter Schnorr,et al.  The process complexity and effective random tests. , 1972, STOC.