The Equivalency of Minimum Error Entropy Criterion and Minimum Dispersion Criterion for Symmetric Stable Signal Processing

<para> The minimum error entropy (MEE) criterion in information theoretic learning is an efficient way to deal with non-Gaussian signal processing. And the minimum dispersion (MD) criterion has been widely applied in stable signal processing. In this letter, we show that there exists an equivalence between the MD criterion and the MEE criterion where symmetric <formula formulatype="inline"><tex Notation="TeX">$\alpha$</tex> </formula>-stable <formula formulatype="inline"><tex Notation="TeX">$(S\alpha S)$</tex></formula> random variables are considered as the errors of the adaptive signal processing. As an application, we propose an algorithm with the MEE criterion for the time delay estimation (TDE) problem which was solved by the MD criterion. </para>

[1]  Deniz Erdogmus,et al.  Beyond second-order statistics for learning: A pairwise interaction model for entropy estimation , 2002, Natural Computing.

[2]  Chrysostomos L. Nikias,et al.  Joint estimation of time delay and frequency delay in impulsive noise using fractional lower order statistics , 1996, IEEE Trans. Signal Process..

[3]  Shiunn-Jang Chern,et al.  A new adaptive constrained LMS time delay estimation algorithm , 1998, Signal Process..

[4]  James S. Harris,et al.  Tables of integrals , 1998 .

[5]  Deniz Erdogmus,et al.  An error-entropy minimization algorithm for supervised training of nonlinear adaptive systems , 2002, IEEE Trans. Signal Process..

[6]  C. L. Nikias,et al.  Signal processing with alpha-stable distributions and applications , 1995 .

[7]  Alfréd Rényi,et al.  Probability Theory , 1970 .

[8]  Deniz Erdoğmuş,et al.  Blind source separation using Renyi's mutual information , 2001, IEEE Signal Processing Letters.

[9]  Deniz Erdogmus,et al.  An analysis of entropy estimators for blind source separation , 2006, Signal Process..

[10]  José Carlos Príncipe,et al.  A Reproducing Kernel Hilbert Space Framework for Information-Theoretic Learning , 2008, IEEE Transactions on Signal Processing.

[11]  Kyu-Hwa Jeong,et al.  Robust Adaptive Minimum Entropy Beamformer in Impulsive Noise , 2007, 2007 IEEE Workshop on Machine Learning for Signal Processing.

[12]  Deniz Erdogmus,et al.  Entropy minimization for supervised digital communications channel equalization , 2002, IEEE Trans. Signal Process..

[13]  Luc Pronzato,et al.  Minimum entropy estimation in semi parametric models , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[14]  D. F. Hays,et al.  Table of Integrals, Series, and Products , 1966 .

[15]  Deniz Erdogmus,et al.  Generalized information potential criterion for adaptive system training , 2002, IEEE Trans. Neural Networks.

[16]  E. Parzen.  On Estimation of a Probability Density Function and Mode , 1962 .

[17]  Deniz Erdogmus,et al.  Convergence properties and data efficiency of the minimum error entropy criterion in ADALINE training , 2003, IEEE Trans. Signal Process..