Analysis of a Novel Density Matching Criterion Within the ITL Framework for Blind Channel Equalization

In blind channel equalization, the use of criteria from the field of information theoretic learning (ITL) has already proved to be a promising alternative, since the use of the high-order statistics is mandatory in this task. In view of the several existent ITL propositions, we present in this work a detailed comparison of the main ITL criteria employed for blind channel equalization and also introduce a new ITL criterion based on the notion of distribution matching. The analyses of the ITL framework are held by means of comparison with elements of the classical filtering theory and among the studied ITL criteria themselves, allowing a new understanding of the existing ITL framework. The verified connections provide the basis for a comparative performance analysis in four practical scenarios, which encompasses discrete/continuous sources with statistical independence/dependence, and real/complex-valued modulations, including the presence of Gaussian and non-Gaussian noise. The results indicate the most suitable ITL criteria for a number of scenarios, some of which are favorable to our proposition.

[1]  Patrick Siarry,et al.  A survey on optimization metaheuristics , 2013, Inf. Sci..

[2]  김남용,et al.  A New Criterion of Information Theoretic Optimization and Application to Blind Channel Equalization , 2009 .

[3]  Weifeng Liu,et al.  A unifying criterion for instantaneous blind source separation based on correntropy , 2007, Signal Process..

[4]  José Carlos Príncipe,et al.  Fast algorithm for adaptive blind equalization using order-α Renyi's entropy , 2002, 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[5]  A. Benveniste,et al.  Robust identification of a nonminimum phase system: Blind adjustment of a linear equalizer in data communications , 1980 .

[6]  João Marcos Travassos Romano,et al.  An Analysis of Unsupervised Signal Processing Methods in the Context of Correlated Sources , 2009, ICA.

[7]  G. J. Foschini,et al.  Equalizing without altering or detecting data , 1985, AT&T Technical Journal.

[8]  C. E. SHANNON,et al.  A mathematical theory of communication , 1948, MOCO.

[9]  Ehud Weinstein,et al.  New criteria for blind deconvolution of nonminimum phase systems (channels) , 1990, IEEE Trans. Inf. Theory.

[10]  D. Godard,et al.  Self-Recovering Equalization and Carrier Tracking in Two-Dimensional Data Communication Systems , 1980, IEEE Trans. Commun..

[11]  Weifeng Liu,et al.  Correntropy: A Localized Similarity Measure , 2006, The 2006 IEEE International Joint Conference on Neural Network Proceedings.

[12]  E. Parzen.  On Estimation of a Probability Density Function and Mode , 1962 .

[13]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[14]  S. Haykin,et al.  Adaptive Filter Theory , 1986 .

[15]  José Carlos Príncipe,et al.  Generalized correlation function: definition, properties, and application to blind equalization , 2006, IEEE Transactions on Signal Processing.

[16]  Ricardo Suyama,et al.  Unsupervised Signal Processing: Channel Equalization and Source Separation , 2010 .

[17]  José Carlos Príncipe,et al.  Adaptive blind equalization through quadratic pdf matching , 2002, 2002 11th European Signal Processing Conference.

[18]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[19]  Jose C. Principe,et al.  Information Theoretic Learning - Renyi's Entropy and Kernel Perspectives , 2010, Information Theoretic Learning.

[20]  Deniz Erdogmus,et al.  Matched pdf-based blind equalization , 2003, 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03)..

[21]  José Carlos Príncipe,et al.  Correntropy as a novel measure for nonlinearity tests , 2009, Signal Process..

[22]  Claude E. Shannon,et al.  The mathematical theory of communication , 1950 .

[23]  Deniz Erdogmus,et al.  Stochastic blind equalization based on PDF fitting using Parzen estimator , 2005, IEEE Transactions on Signal Processing.

[24]  Deniz Erdoğmuş.  INFORMATION THEORETIC LEARNING: RENYI'S ENTROPY AND ITS APPLICATIONS TO ADAPTIVE SYSTEM TRAINING , 2002 .

[25]  Levy Boccato,et al.  Multivariate PDF matching via kernel density estimation , 2014, 2014 IEEE Symposium on Computational Intelligence for Multimedia, Signal and Vision Processing (CIMSIVP).