Jeffrey's divergence between moving-average models that are real or complex, noise-free or disturbed by additive white noises

Time series models play a key-role in many applications from biomedical signal analysis to applied econometric. The purpose of this paper is to compare 1 st -order moving-average (MA) models by using dissimilarity measures such as the Jeffrey's divergence (JD), which is the symmetric version of the Kullback-Leibler divergence (KL). The MA models can be real or complex. They can also be disturbed by additive white noises or not. Analytical expressions are first proposed and analyzed. Then, the JD is used to compare more than two 1 st -order MA models in order to extract MA model subsets. In the latter case, we suggest analyzing the higher-order singular values of a tensor defined from the JDs between models over time to deduce the number of subsets and their cardinals. Simulation results illustrate the theoretical analysis. HighlightsAnalytical Jeffrey's Divergence expressions are provided for 1st-order MA models.Real or complex, noise-free or noisy 1st-order MA model cases are studied.Time evolution of the Jeffrey's Divergence depends on the 1st-order MA parameters.Comparative study with other dissimilarity measures (Rao distance, etc.) is done.Two methods are proposed to compare more than two 1st-order MA models.

[1]  Audrey Giremus,et al.  On Computing Jeffrey’s Divergence Between Time-Varying Autoregressive Models , 2015, IEEE Signal Processing Letters.

[2]  Alimorad Mahmoudi,et al.  Parameter estimation of autoregressive signals in presence of colored AR(1) noise as a quadratic eigenvalue problem , 2012, Signal Process..

[3]  Frederic Barbaresco,et al.  Riemannian median, geometry of covariance matrices and radar target detection , 2010, The 7th European Radar Conference.

[4]  Eric Grivel,et al.  Errors-in-variables identification of noisy moving average models , 2015, 2015 23rd European Signal Processing Conference (EUSIPCO).

[5]  Edsger W. Dijkstra,et al.  A note on two problems in connexion with graphs , 1959, Numerische Mathematik.

[6]  Frederic Barbaresco.  Geometric Radar Processing based on Fréchet distance: Information geometry versus Optimal Transport Theory , 2011, 2011 12th International Radar Symposium (IRS).

[7]  Carlos E. Davila.  A subspace approach to estimation of autoregressive parameters from noisy measurements , 1998, IEEE Trans. Signal Process..

[8]  J. H. Wilkinson.  Elementary proof of the Wielandt-Hoffman Theorem and of its generalization , 1970 .

[9]  Charles W. Therrien.  Eigenvalue Properties of Projection Operators and Their Application to the Subspace Method of Feature Extraction , 1975, IEEE Transactions on Computers.

[10]  Frank P. Ferrie,et al.  A Note on Metric Properties for Some Divergence Measures: The Gaussian Case , 2012, ACML.

[11]  Umberto Soverini,et al.  Speech Enhancement Combining Optimal Smoothing and Errors-In-Variables Identification of Noisy AR Processes , 2007, IEEE Transactions on Signal Processing.

[12]  F. Barbaresco,et al.  Radar detection using Siegel distance between autoregressive processes, application to HF and X-band radar , 2008, 2008 IEEE Radar Conference.

[13]  Wen-Chyuan Yueh.  Explicit Inverses Of Several Tridiagonal Matrices , 2006 .

[14]  Solomon Kullback,et al.  Information Theory and Statistics , 1970, The Mathematical Gazette.

[15]  Petre Stoica,et al.  On the parameterization of positive real sequences and MA parameter estimation , 2001, IEEE Trans. Signal Process..

[16]  J. Durbin.  EFFICIENT ESTIMATION OF PARAMETERS IN MOVING-AVERAGE MODELS , 1959 .

[17]  Jerry M. Mendel,et al.  Identification of nonminimum phase systems using higher order statistics , 1989, IEEE Trans. Acoust. Speech Signal Process..

[18]  C. Fonseca,et al.  Explicit inverses of some tridiagonal matrices , 2001 .

[19]  Frank P. Ferrie,et al.  Relaxed Exponential Kernels for Unsupervised Learning , 2011, DAGM-Symposium.

[20]  C. R. Rao,et al.  Information and the Accuracy Attainable in the Estimation of Statistical Parameters , 1992 .

[21]  Md. Jahangir Hossain,et al.  Parameter estimation of multichannel autoregressive processes in noise , 2003, Signal Process..

[22]  Petre Stoica,et al.  MA estimation in polynomial time , 2000, IEEE Trans. Signal Process..

[23]  Jerry M. Mendel,et al.  Tutorial on higher-order statistics (spectra) in signal processing and system theory: theoretical results and some applications , 1991, Proc. IEEE.

[24]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[25]  Wei Xing Zheng.  Fast identification of autoregressive signals from noisy observations , 2005, IEEE Trans. Circuits Syst. II Express Briefs.

[26]  Audrey Giremus,et al.  Jeffrey's divergence for state-space model comparison , 2015, Signal Process..

[27]  S. Kullback,et al.  Information Theory and Statistics , 1959 .

[28]  Lothar Reichel,et al.  Tridiagonal Toeplitz matrices: properties and novel applications , 2013, Numer. Linear Algebra Appl..

[29]  Audrey Giremus,et al.  Jeffreys divergence between state models: Application to target tracking using multiple models , 2013, 21st European Signal Processing Conference (EUSIPCO 2013).

[30]  Virginia L. Ballarin,et al.  Segmentation of brain magnetic resonance images through morphological operators and geodesic distance , 2005, Digit. Signal Process..

[31]  Joos Vandewalle,et al.  A Multilinear Singular Value Decomposition , 2000, SIAM J. Matrix Anal. Appl..

[32]  Jie Yang,et al.  Modified Kernel Functions by Geodesic Distance , 2004, EURASIP J. Adv. Signal Process..

[33]  Peter Colwell.  Blaschke Products: Bounded Analytic Functions , 1985 .

[34]  Enes Makalic,et al.  Fast Computation of the Kullback–Leibler Divergence and Exact Fisher Information for the First-Order Moving Average Model , 2010, IEEE Signal Processing Letters.

[35]  Philipp Birken,et al.  Numerical Linear Algebra , 2011, Encyclopedia of Parallel Computing.

[36]  É. Grivel,et al.  Classifying several state models using Jeffrey's divergence: Application to target tracking , 2014, 2014 International Radar Conference.