Statistical and Inductive Inference by Minimum Message Length (Information Science and Statistics)

Inductive Inference.- Information.- Strict Minimum Message Length (SMML).- Approximations to SMML.- MML: Quadratic Approximations to SMML.- MML Details in Some Interesting Cases.- Structural Models.- The Feathers on the Arrow of Time.- MML as a Descriptive Theory.- Related Work.

[1]  Andrew R. Barron,et al.  Minimum complexity density estimation , 1991, IEEE Trans. Inf. Theory.

[2]  J. Rissanen.  A UNIVERSAL PRIOR FOR INTEGERS AND ESTIMATION BY MINIMUM DESCRIPTION LENGTH , 1983 .

[3]  David L. Dowe,et al.  MML clustering of multi-state, Poisson, von Mises circular and Gaussian distributions , 2000, Stat. Comput..

[4]  Marcus Hutter.  New Error Bounds for Solomonoff Prediction , 2001, J. Comput. Syst. Sci..

[5]  C. S. Wallace,et al.  Resolving the Neyman-Scott problem by minimum message length , 1997 .

[6]  Ronald L. Rivest,et al.  Inferring Decision Trees Using the Minimum Description Length Principle , 1989, Inf. Comput..

[7]  David L. Dowe,et al.  MML Estimation of the Parameters of the Sherical Fisher Distribution , 1996, ALT.

[8]  C. S. Wallace,et al.  Estimation and Inference by Compact Coding , 1987 .

[9]  D M Boulton,et al.  The information content of a multistate distribution. , 1969, Journal of theoretical biology.

[10]  Grace W. Rumantir,et al.  Minimum Message Length Criterion for Second-Order Polynomial Model Selection Applied to Tropical Cyclone Intensity Forecasting , 2003, IDA.

[11]  H. Akaike,et al.  Information Theory and an Extension of the Maximum Likelihood Principle , 1973 .

[12]  Ray J. Solomonoff,et al.  A Formal Theory of Inductive Inference. Part II , 1964, Inf. Control..

[13]  Lloyd Allison,et al.  Univariate Polynomial Inference by Monte Carlo Message Length Approximation , 2002, ICML.

[14]  Chris S. Wallace,et al.  The Complexity of Strict Minimum Message Length Inference , 2002, Comput. J..

[15]  C. S. Wallace,et al.  An Information Measure for Classification , 1968, Comput. J..

[16]  Alberto Maria Segre,et al.  Programs for Machine Learning , 1994 .

[17]  Thomas C.M. Lee,et al.  Theory & Methods: Tree-based wavelet regression for correlated data using the minimum description length principle , 2000 .

[18]  P. Grünwald.  The Minimum Description Length Principle and Reasoning under Uncertainty , 1998 .

[19]  A. Kolmogorov.  Three approaches to the quantitative definition of information , 1968 .

[20]  Glen G. Langdon,et al.  Arithmetic Coding , 1979 .

[21]  N. Sloane,et al.  On the Voronoi Regions of Certain Lattices , 1984 .

[22]  C. S. Wallace,et al.  Coding Decision Trees , 1993, Machine Learning.

[23]  Dana Ron,et al.  An experimental and theoretical comparison of model selection methods , 1995, COLT '95.

[24]  Ming Li,et al.  An Introduction to Kolmogorov Complexity and Its Applications , 2019, Texts in Computer Science.

[25]  Kevin B. Korb,et al.  Finding Cutpoints in Noisy Binary Sequences - A Revised Empirical Evaluation , 1999, Australian Joint Conference on Artificial Intelligence.

[26]  Huw Price,et al.  Time's Arrow and Archimedes’ Point , 1997 .

[27]  Ray J. Solomonoff,et al.  Two Kinds of Probabilistic Induction , 1999, Comput. J..

[28]  D. Huffman.  A Method for the Construction of Minimum-Redundancy Codes , 1952 .

[29]  C. E. SHANNON,et al.  A mathematical theory of communication , 1948, MOCO.

[30]  Chris S. Wallace,et al.  A note on the comparison of polynomial selection methods , 1999, AISTATS.

[31]  K. Jöreskog.  Some contributions to maximum likelihood factor analysis , 1967 .

[32]  Jorma Rissanen,et al.  Hypothesis Selection and Testing by the MDL Principle , 1999, Comput. J..

[33]  Alexander Gammerman,et al.  Complexity Approximation Principle , 1999, Comput. J..

[34]  A. Thom,et al.  A Statistical Examination of the Megalithic Sites in Britain , 1955 .

[35]  C. S. Wallace,et al.  Bayesian Estimation of the Von Mises Concentration Parameter , 1996 .

[36]  Ian H. Witten,et al.  Arithmetic coding for data compression , 1987, CACM.

[37]  R. Bhansali,et al.  Some properties of the order of an autoregressive model selected by a generalization of Akaike∘s EPF criterion , 1977 .

[38]  M. Woodroofe.  On Model Selection and the ARC Sine Laws , 1982 .

[39]  D. Dowe,et al.  Model selection in linear regression using the MML criterion , 1994, DCC 1994.

[40]  Rudolf Carnap,et al.  The logical structure of the world & pseudoproblems in philosophy , 1967 .

[41]  C. S. Wallace,et al.  Learning Linear Causal Models by MML Sampling , 1999 .

[42]  Paul L. Zador,et al.  Asymptotic quantization error of continuous signals and the quantization dimension , 1982, IEEE Trans. Inf. Theory.

[43]  G. Schou.  Estimation of the concentration parameter in von Mises–Fisher distributions , 1978 .

[44]  A. Thom.  Megalithic Sites in Britain , 1967 .