Additive non-Gaussian noise channel estimation by using minimum error entropy criterion

Channel estimation is an important component of wireless communications. This paper deals with the comparison between Mean Square Error (MSE) based neural networks and Minimum Error Entropy (MEE) based neural networks in additive non-Gaussian noise channel estimation. This essay analyzes MEE and MSE algorithms in several channel models utilizing neural networks. The aim of this study is first to compare the performance of an MSE-based conjugate gradient backpropagation (BP) algorithm with MEE-based BP method. The trained neural networks can be applied as an equalizer in the receiver. Moreover, to make a complete comparison between methods, we compare them in both low and high SNR regimes. The numerical results illustrate that MEE-based back propagation algorithm is more capable than the MSE-based algorithm for channel estimation. In fact, with additive non-Gaussian noise the performance of the MSE can be approximately as same as the MEE results in high SNR regime, but the MEE outperforms MSE-based method obviously in low SNR regime with non-Gaussian noise.

[1]  Badong Chen,et al.  A switch kernel width method of correntropy for channel estimation , 2015, 2015 International Joint Conference on Neural Networks (IJCNN).

[2]  Yupeng Jia.  Channel Estimation and Optimal Resource Allocation of Relay Assisted Communication Systems , 2012 .

[3]  Cebrail Çiflikli,et al.  Artificial Neural Network Channel Estimation Based on Levenberg-Marquardt for OFDM Systems , 2009, Wirel. Pers. Commun..

[4]  Deniz Erdogmus,et al.  Generalized information potential criterion for adaptive system training , 2002, IEEE Trans. Neural Networks.

[5]  Yu Zhang,et al.  Convergence of a Fixed-Point Minimum Error Entropy Algorithm , 2015, Entropy.

[6]  Frank Rosenblatt,et al.  PRINCIPLES OF NEURODYNAMICS. PERCEPTRONS AND THE THEORY OF BRAIN MECHANISMS , 1963 .

[7]  Torbjörn Ekman.  Prediction of Mobile Radio Channels : Modeling and Design , 2002 .

[8]  Sinem Coleri Ergen,et al.  Channel estimation techniques based on pilot arrangement in OFDM systems , 2002, IEEE Trans. Broadcast..

[9]  J. Príncipe,et al.  A family of minimum renyi's error entropy algorithm for information processing , 2007 .

[10]  Gilberto Zamora,et al.  Dissertation for the degree of Doctor of Philosophy , 2002 .

[11]  M. Hestenes,et al.  Methods of conjugate gradients for solving linear systems , 1952 .

[12]  Deniz Erdogmus,et al.  Adaptive blind deconvolution of linear channels using Renyi's entropy with Parzen window estimation , 2004, IEEE Transactions on Signal Processing.

[13]  C. M. Reeves,et al.  Function minimization by conjugate gradients , 1964, Comput. J..

[14]  Edwin B. Stear,et al.  Entropy analysis of estimating systems , 1970, IEEE Trans. Inf. Theory.

[15]  Boris Polyak.  The conjugate gradient method in extreme problems , 2015 .

[16]  Boris Polyak.  The conjugate gradient method in extremal problems , 1969 .

[17]  张玲,et al.  MIMO Channel Estimation and Equalization Using Three-Layer Neural Networks with Feedback , 2007 .

[18]  S. Siu,et al.  Decision feedback equalisation using neural network structures and performance comparison with standard architecture , 1990 .

[19]  I.M. Qureshi,et al.  Blind equalization and estimation of channel using artificial neural networks , 2004, 8th International Multitopic Conference, 2004. Proceedings of INMIC 2004..

[20]  Kiran Parmar,et al.  Adaptive Filter Analysis for System Identification Using Various Adaptive Algorithms , 2012 .

[21]  Martin Fodslette Møller,et al.  A scaled conjugate gradient algorithm for fast supervised learning , 1993, Neural Networks.

[22]  Ganapati Panda,et al.  Nonlinear channel equalization for QAM signal constellation using artificial neural networks , 1999, IEEE Trans. Syst. Man Cybern. Part B.

[24]  Z. J. Shi,et al.  New Inexact Line Search Method for Unconstrained Optimization , 2005 .

[25]  Deniz Erdogmus,et al.  Beyond second-order statistics for learning: A pairwise interaction model for entropy estimation , 2002, Natural Computing.

[26]  Laurene V. Fausett,et al.  Fundamentals Of Neural Networks , 1994 .

[27]  C. Cowan,et al.  Adaptive Filters and Equalisers , 1988 .

[28]  Lennart Ljung,et al.  System Identification: Theory for the User , 1987 .

[29]  Jun Sun,et al.  Neural Network Channel Estimation Based on Least Mean Error Algorithm in the OFDM Systems , 2006, ISNN.

[30]  Romis de Faissol Attux,et al.  Analysis of a Novel Density Matching Criterion Within the ITL Framework for Blind Channel Equalization , 2018, Circuits Syst. Signal Process..

[31]  Deniz Erdoğmuş.  INFORMATION THEORETIC LEARNING: RENYI'S ENTROPY AND ITS APPLICATIONS TO ADAPTIVE SYSTEM TRAINING , 2002 .

[32]  Deniz Erdogmus,et al.  Entropy minimization for supervised digital communications channel equalization , 2002, IEEE Trans. Signal Process..

[33]  P. Eykhoff.  System Identification Parameter and State Estimation , 1974 .

[34]  M. Ergen,et al.  A study of channel estimation in OFDM systems , 2002, Proceedings IEEE 56th Vehicular Technology Conference.

[35]  Sergio Verdu,et al.  The exponential distribution in information theory , 1996 .

[36]  Deniz Erdogmus,et al.  An error-entropy minimization algorithm for supervised training of nonlinear adaptive systems , 2002, IEEE Trans. Signal Process..

[37]  Doreen Meier,et al.  Fundamentals Of Neural Networks Architectures Algorithms And Applications , 2016 .