How Random is a Coin Toss? Bayesian Inference and the Symbolic Dynamics of Deterministic Chaos

Author(s): Strelioff, Christopher C; Crutchfield, James P | Abstract: Symbolic dynamics has proven to be an invaluable tool in analyzing the mechanisms that lead to unpredictability and random behavior in nonlinear dynamical systems. Surprisingly, a discrete partition of continuous state space can produce a coarse-grained description of the behavior that accurately describes the invariant properties of an underlying chaotic attractor. In particular, measures of the rate of information production--the topological and metric entropy rates--can be estimated from the outputs of Markov or generating partitions. Here we develop Bayesian inference for k-th order Markov chains as a method to finding generating partitions and estimating entropy rates from finite samples of discretized data produced by coarse-grained dynamical systems.

[1]  Richard A. Holmgren.  Symbolic Dynamics and Chaos , 1994 .

[2]  C. Finney,et al.  A review of symbolic analysis of experimental data , 2003 .

[3]  Inés Samengo.  Estimating probabilities from experimental frequencies. , 2002, Physical review. E, Statistical, nonlinear, and soft matter physics.

[4]  Gregory R. Grant,et al.  Bioinformatics - The Machine Learning Approach , 2000, Comput. Chem..

[5]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[6]  N. Packard,et al.  Symbolic dynamics of noisy chaos , 1983 .

[7]  B. Hao,et al.  Applied Symbolic Dynamics and Chaos , 1998 .

[8]  Robert B. Ash,et al.  Information Theory , 2020, The SAGE International Encyclopedia of Mass Media and Society.

[9]  L. Goddard.  Information Theory , 1962, Nature.

[10]  Lai,et al.  Validity of threshold-crossing analysis of symbolic dynamics from chaotic time series , 2000, Physical review letters.

[11]  N. Packard,et al.  Symbolic dynamics of one-dimensional maps: Entropies, finite precision, and noise , 1982 .

[12]  Yuhong Yang,et al.  Information Theory, Inference, and Learning Algorithms , 2005 .

[13]  David J. C. MacKay,et al.  Information Theory, Inference, and Learning Algorithms , 2004, IEEE Transactions on Information Theory.