Inferring the Dynamic, Quantifying Physical Complexity

Through its formalization of inductive inference, computational learning theory provides a foundation for the inverse problem of chaotic data analysis: inferring the deterministic equations of motion underlying observed random behavior in physical systems. Integrating the geometric and statistical techniques of dynamical systems with learning theory provides a framework for consistently, although not absolutely, distinguishing between deterministic chaos and extrinsic fluctuations at a given level of computational resources. Two approaches to the inverse problem, estimating symbolic equations of motion and reconstructing minimal automata from chaotic data series, are reviewed from this point of view. With an inferred model dynamic the dynamical entropies and dimensions can be estimated. More interestingly, its structural properties give a measure of the intrinsic computational complexity of the underlying process.

[1]  Jorma Rissanen,et al.  Universal coding, information, prediction, and estimation , 1984, IEEE Trans. Inf. Theory.

[2]  Charles H. Bennett,et al.  On the nature and origin of complexity in discrete, homogeneous, locally-interacting systems , 1986 .

[3]  James P. Crutchfield,et al.  Equations of Motion from a Data Series , 1987, Complex Syst..

[4]  Norman H. Packard Measurements of Chaos in the Presence of Noise. , 1982 .

[5]  E. Mark Gold,et al.  Language Identification in the Limit , 1967, Inf. Control..

[6]  Young,et al.  Inferring statistical complexity. , 1989, Physical review letters.

[7]  P. Grassberger Toward a quantitative theory of self-generated complexity , 1986 .

[8]  R. M. Wharton Approximate Language Identification , 1974, Inf. Control..

[9]  Huberman,et al.  Complexity and the relaxation of hierarchical structures. , 1986, Physical review letters.

[10]  S. Wolfram Computation theory of cellular automata , 1984 .

[11]  J. Rissanen,et al.  Modeling By Shortest Data Description* , 1978, Autom..

[12]  E. Mark Gold,et al.  Complexity of Automaton Identification from Given Data , 1978, Inf. Control..

[13]  S. Lloyd,et al.  Complexity as thermodynamic depth , 1988 .

[14]  Jerome A. Feldman,et al.  On the Synthesis of Finite-State Machines from Samples of Their Behavior , 1972, IEEE Transactions on Computers.

[15]  Robert Shaw,et al.  The Dripping Faucet As A Model Chaotic System , 1984 .

[16]  N. Packard,et al.  Symbolic dynamics of one-dimensional maps: Entropies, finite precision, and noise , 1982 .

[17]  N. Packard,et al.  Symbolic dynamics of noisy chaos , 1983 .

[18]  DANA ANGLUIN,et al.  On the Complexity of Minimum Inference of Regular Sets , 1978, Inf. Control..

[19]  James P. Crutchfield,et al.  Geometry from a Time Series , 1980 .