Retrospective Mutiple Change-Point Estimation with Kernels

This contribution proposes an extension of the classic dynamic programming algorithm for detecting jumps in noisily observed piecewise-constant signals. The proposed algorithm operates (virtually) in a reproducing kernel Hilbert space through the use of an arbitrary kernel mapping. The resulting approach provides a computationally efficient an versatile tool for segmenting complex signals whose structure is not appropriately captured by standard parametric models.

[1]  Walter D. Fisher.  On Grouping for Maximum Homogeneity , 1958 .

[2]  R. Bellman.  On the approximation of curves by line segments using dynamic programming , 1961, CACM.

[3]  Richard A. Johnson,et al.  Applied Multivariate Statistical Analysis , 1983 .

[4]  John Haigh,et al.  Applied multivariate statistical analysis (2nd edition) , by R. A. Johnson and D. W. Wichern. Pp 607. £17·95. 1988. ISBN 0-13-041138-8 (Prentice-Hall) , 1988, The Mathematical Gazette.

[5]  J. Hartigan,et al.  Product Partition Models for Change Point Problems , 1992 .

[6]  S. Kay.  Fundamentals of statistical signal processing: estimation theory , 1993 .

[7]  Chung-Bow Lee.  Estimating the number of change points in a sequence of independent normal random variables , 1995 .

[8]  L. Horváth,et al.  Limit Theorems in Change-Point Analysis , 1997 .

[9]  C.-B. Lee,et al.  ESTIMATING THE NUMBER OF CHANGE POINTS , 1998 .

[10]  Alexander J. Smola,et al.  Learning with kernels , 1998 .

[11]  B. E. Brodsky,et al.  Non-Parametric Statistical Diagnosis , 2000 .

[12]  É. Moulines,et al.  Least‐squares Estimation of an Unknown Number of Shifts in a Time Series , 2000 .

[13]  B. E. Brodsky,et al.  Non-Parametric Statistical Diagnosis: Problems and Methods , 2000 .

[14]  D. Bosq.  Linear Processes in Function Spaces: Theory And Applications , 2000 .

[15]  Nello Cristianini,et al.  Kernel Methods for Pattern Analysis , 2004 .

[16]  Manuel Davy,et al.  An online kernel change detection algorithm , 2005, IEEE Transactions on Signal Processing.

[17]  Jeffrey D. Scargle,et al.  An algorithm for optimal partitioning of data on an interval , 2003, IEEE Signal Processing Letters.

[18]  Charles E. Heckler,et al.  Applied Multivariate Statistical Analysis , 2005, Technometrics.

[19]  Paul Fearnhead,et al.  Exact and efficient Bayesian inference for multiple changepoint problems , 2006, Stat. Comput..

[20]  Stéphane Canu,et al.  Estimation of Minimum Measure Sets in Reproducing Kernel Hilbert Spaces and Applications. , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[21]  Gaël Richard,et al.  On the Correlation of Automatic Audio and Visual Segmentations of Music Videos , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[22]  Kenji Fukumizu,et al.  Statistical Consistency of Kernel Canonical Correlation Analysis , 2007 .

[23]  V. Liebscher,et al.  Consistencies and rates of convergence of jump-penalized least squares estimators , 2009, 0902.4838.