Higher-order dangers and precisely constructed taxa in models of randomness

Significance The validation and construction of individual, putatively “random” infinite sequences have been longstanding problems within mathematics. We address this topic via the study of binary normal numbers, which often have been viewed as models for randomness. We show that normality exhibits a rich, multifactorial taxonomy and is hardly a single monochromatic category. Furthermore, we present a toolkit of algorithmic techniques to explicitly construct normal sequences to achieve diverse yet precisely controlled specifications, many of which (e.g., bias) display unexpected and somewhat pathologic subordinate dynamics. Moreover, we construct a normal number that exhibits pairwise bias toward repeated values and, accordingly, deduce that the evaluation of higher-order block behavior, even beyond equidistribution, is imperative in proper evaluations of “randomness.” The certification, construction, and delineation of individual, infinite-length “random” sequences have been longstanding yet incompletely resolved problems. We address this topic via the study of normal numbers, which often have been viewed as reasonable proxies for randomness, given their limiting equidistribution of subblocks of all lengths. However, limitations arise within this perspective. First, we explicitly construct a normal number that satisfies the law of the iterated logarithm yet exhibits pairwise bias toward repeated values, rendering it inappropriate for any collection of random numbers. Accordingly, we deduce that the evaluation of higher-order block dynamics, even beyond limiting equidistribution and fluctuational typicality, is imperative in proper evaluation of sequential “randomness.” Second, we develop several criteria motivated by classical theorems for symmetric random walks, which lead to algorithms for generating normal numbers that satisfy a variety of attributes for the series of initial partial sums, including rates of sign changes, patterns of return times to 0, and the extent of fairness of the sequence. Such characteristics generally are unaddressed in most evaluations of randomness. More broadly, we can differentiate normal numbers both on the basis of multiple distinct qualitative attributes and quantitatively via a spectrum of rates within each attribute. Furthermore, we exhibit a toolkit of techniques to construct normal sequences that realize diverse a priori specifications, including profound biases. Overall, we elucidate the vast diversity within the category of normal sequences.

[1]  S. Pincus,et al.  A recipe for randomness. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[2]  S M Pincus,et al.  Approximate entropy as a measure of system complexity. , 1991, Proceedings of the National Academy of Sciences of the United States of America.

[3]  H. Fredricksen A Survey of Full Length Nonlinear Shift Register Cycle Algorithms , 1982 .

[4]  E. J. Routh Dynamics of a System of Rigid Bodies , 2016 .

[5]  Andrew Odlyzko,et al.  Long repetitive patterns in random sequences , 1980 .

[6]  S. Pincus,et al.  Randomness and degrees of irregularity. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[7]  S. S. Wilks,et al.  Probability, statistics and truth , 1939 .

[8]  Persi Diaconis,et al.  c ○ 2007 Society for Industrial and Applied Mathematics Dynamical Bias in the Coin Toss ∗ , 2022 .

[9]  S. Pincus,et al.  A zoo of computable binary normal sequences , 2012, Proceedings of the National Academy of Sciences.

[10]  Rodney G. Downey,et al.  Algorithmic Randomness and Complexity , 2010, Theory and Applications of Computability.

[11]  Per Martin-Löf,et al.  The Definition of Random Sequences , 1966, Inf. Control..

[12]  E. Engel A road to randomness in physical systems , 1992 .

[13]  A. Besicovitch The asymptotic distribution of the numerals in the decimal representation of the squares of the natural numbers , 1935 .

[14]  A. Kolmogoroff Grundbegriffe der Wahrscheinlichkeitsrechnung , 1933 .

[15]  F. Lemmermeyer Error-correcting Codes , 2005 .

[16]  J. Keller The Probability of Heads , 1986 .

[17]  Paul Erdös,et al.  Note on Normal Decimals , 1952, Canadian Journal of Mathematics.

[18]  M. Borel Les probabilités dénombrables et leurs applications arithmétiques , 1909 .

[19]  David H. Bailey,et al.  Random Generators and Normal Numbers , 2002, Exp. Math..

[20]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[21]  A. Church On the concept of a random sequence , 1940 .

[22]  R E Kalman,et al.  Not all (possibly) "random" sequences are created equal. , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[23]  R. G. Stoneham On absolute (j, ε)-normality in the rational fractions with applications to normal numbers , 1973 .

[24]  Feller William,et al.  An Introduction To Probability Theory And Its Applications , 1950 .

[25]  W. W. Peterson,et al.  Error-Correcting Codes. , 1962 .

[26]  A. N. Kolmogorov Combinatorial foundations of information theory and the calculus of probabilities , 1983 .