On hypotheses testing for ergodic processes

We address three problems of statistical analysis of time series: goodness-of-fit (or identity) testing, process discrimination, and the change point problem. For each of the problems we construct a test that is asymptotically accurate for the case when the data is generated by stationary ergodic processes. All problems are solved in a similar way by using empirical estimates of the distributional distance between the processes.

[1]  B. Brodsky,et al.  Nonparametric Methods in Change Point Problems , 1993 .

[2]  Aarnout Brombacher,et al.  Probability... , 2009, Qual. Reliab. Eng. Int..

[3]  Imre Csiszár,et al.  Information Theory and Statistics: A Tutorial , 2004, Found. Trends Commun. Inf. Theory.

[4]  Jaakko Astola,et al.  Universal Codes as a Basis for Time Series Testing , 2006, ArXiv.

[5]  Andrew B. Nobel,et al.  Hypothesis testing for families of ergodic processes , 2006 .

[6]  John C. Kieffer,et al.  Strongly consistent code-based identification and order estimation for constrained finite-state model classes , 1993, IEEE Trans. Inf. Theory.

[7]  Paul C. Shields,et al.  The Interactions Between Ergodic Theory and Information Theory , 1998, IEEE Trans. Inf. Theory.

[8]  Michèle Basseville,et al.  Detection of abrupt changes: theory and application , 1993 .

[9]  Michèle Basseville,et al.  Detection of Abrupt Changes: Theory and Applications. , 1995 .

[10]  Benjamin Weiss,et al.  How Sampling Reveals a Process , 1990 .

[11]  Robert M. Gray,et al.  Probability, Random Processes, And Ergodic Properties , 1987 .

[12]  I. Good,et al.  Ergodic theory and information , 1966 .

[13]  R. Leipus,et al.  The change-point problem for dependent observations , 1996 .

[14]  Qiang Zhang,et al.  Optimal rate of convergence for nonparametric change-point estimators for nonstationary sequences , 2007, 0710.4217.

[15]  C. Fuh.  Asymptotic operating characteristics of an optimal change point detection in hidden Markov models , 2004, math/0503682.

[16]  I. Vajda,et al.  Information-theoretic methods in testing the goodness of fit , 2000, 2000 IEEE International Symposium on Information Theory (Cat. No.00CH37060).

[17]  Michael Gutman,et al.  Asymptotically optimal classification for multiple tests with empirically observed statistics , 1989, IEEE Trans. Inf. Theory.

[18]  Edward Carlstein,et al.  Nonparametric Change-Point Estimation for Data from an Ergodic Sequence , 1994 .

[19]  Jaakko Astola,et al.  Application of Kolmogorov complexity and universal codes to identity testing and nonparametric testing of serial independence for time series , 2005, Theor. Comput. Sci..

[20]  Jaakko Astola,et al.  Universal codes as a basis for nonparametric testing of serial independence for time series , 2006 .

[21]  M. Lavielle.  Detection of multiple changes in a sequence of dependent variables , 1999 .

[22]  Rakesh K. Bansal,et al.  An algorithm for detecting a change in a stochastic process , 1986, IEEE Trans. Inf. Theory.

[23]  Rudolf Ahlswede,et al.  Hypothesis testing with communication constraints , 1986, IEEE Trans. Inf. Theory.

[24]  I. Csiszár.  Information theoretic methods in probability and statistics , 1997, Proceedings of IEEE International Symposium on Information Theory.