A Survey of Kurtosis Optimization Schemes for MISO Source Separation and Equalization

Blind source separation and equalization aim at recovering a set of unknown source signals from their linearly distorted mixtures observed at a sensor array output, with little or no prior knowledge about the sources or the distorting channel. This fundamental signal processing problem arises in a broad range of applications such as multiuser digital communications, biomedical data analysis, and seismic exploration. Put forward over three decades ago, the normalized fourth-order cumulant, also known as kurtosis, has arguably become one of the most popular blind source separation and equalization criteria. Using multiple-input single-output (MISO) filter structures for single source extraction combined with suitable deflation procedures, the kurtosis contrast yields separation algorithms free of spurious extrema in ideal system conditions. The lack of closed-form solutions, however, calls for numerical optimization schemes. The present chapter reviews some of the iterative algorithms most widely used for MISO source separation and equalization based on kurtosis. These include gradient and Newton search methods, algorithms with optimal step-size selection, as well as techniques based on reference signals. Their main features are briefly summarized and their performance is illustrated by some numerical experiments in digital communications and biomedical signal processing.

[1]  J. Millet-Roig,et al.  Atrial activity extraction based on blind source separation as an alternative to QRST cancellation for atrial fibrillation analysis , 2000, Computers in Cardiology 2000. Vol.27 (Cat. 00CH37163).

[2]  Eric Moreau,et al.  High order contrasts for self-adaptive source separation criteria for complex source separation , 1996 .

[3]  Pierre Comon,et al.  Semi-blind constant modulus equalization with optimal step size , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[4]  Asoke K. Nandi,et al.  Noninvasive fetal electrocardiogram extraction: blind separation versus adaptive noise cancellation , 2001, IEEE Transactions on Biomedical Engineering.

[5]  P. Comon,et al.  Chapter 3 – Contrasts , 2010 .

[6]  Pierre Comon,et al.  How fast is FastICA? , 2006, 2006 14th European Signal Processing Conference.

[7]  Zhi Ding,et al.  Stationary points of a kurtosis maximization algorithm for blind signal separation and antenna beamforming , 2000, IEEE Trans. Signal Process..

[8]  Constantinos B. Papadias,et al.  Globally convergent blind source separation based on a multiuser kurtosis maximization criterion , 2000, IEEE Trans. Signal Process..

[9]  Marc Castella,et al.  A General Algebraic Algorithm for Blind Extraction of One Source in a MIMO Convolutive Mixture , 2010, IEEE Transactions on Signal Processing.

[10]  Jean-François Cardoso,et al.  Equivariant adaptive source separation , 1996, IEEE Trans. Signal Process..

[11]  Pierre Comon,et al.  Comparative Speed Analysis of FastICA , 2007, ICA.

[12]  L. Lathauwer,et al.  Fetal electrocardiogram extraction by source subspace separation , 1995 .

[13]  Joos Vandewalle,et al.  Fetal electrocardiogram extraction by blind source subspace separation , 2000, IEEE Transactions on Biomedical Engineering.

[14]  Pierre Comon,et al.  Robust Independent Component Analysis by Iterative Maximization of the Kurtosis Contrast With Algebraic Optimal Step Size , 2010, IEEE Transactions on Neural Networks.

[15]  Tülay Adali,et al.  On Extending the Complex FastICA Algorithm to Noncircular Sources , 2008, IEEE Transactions on Signal Processing.

[16]  Pierre Comon,et al.  Independent component analysis, A new concept? , 1994, Signal Process..

[17]  M. Kendall,et al.  Kendall's advanced theory of statistics , 1995 .

[18]  José Millet-Roig,et al.  Atrial activity extraction for atrial fibrillation analysis using blind source separation , 2004, IEEE Transactions on Biomedical Engineering.

[19]  Nadège Thirion-Moreau,et al.  Generalized criteria for blind multivariate signal equalization , 2002, IEEE Signal Processing Letters.

[20]  Philippe Loubaton,et al.  Separation of a class of convolutive mixtures: a contrast function approach , 2001, Signal Process..

[21]  Nathalie Delfosse,et al.  Adaptive blind separation of independent sources: A deflation approach , 1995, Signal Process..

[22]  Pierre Comon,et al.  Semi-blind methods for communications , 2010 .

[23]  Aapo Hyvärinen,et al.  A Fast Fixed-Point Algorithm for Independent Component Analysis , 1997, Neural Computation.

[24]  Pierre Comon,et al.  Optimal Step-Size Constant Modulus Algorithm , 2008, IEEE Transactions on Communications.

[25]  Y. Sato,et al.  A Method of Self-Recovering Equalization for Multilevel Amplitude-Modulation Systems , 1975, IEEE Trans. Commun..

[26]  Jean-Christophe Pesquet,et al.  Chapter 8 - Convolutive mixtures , 2010 .

[27]  Jean-Christophe Pesquet,et al.  Convolutive Blind Signal Separation Based on Asymmetrical Contrast Functions , 2007, IEEE Transactions on Signal Processing.

[28]  Pascal Bianchi,et al.  A blind source separation framework for detecting CPM sources mixed by a convolutive MIMO filter , 2006, Signal Process..

[29]  Marc Castella,et al.  Reference Based Contrast Functions in a Semi-blind Context , 2009, ICA.

[30]  A. Hyvärinen,et al.  One-unit contrast functions for independent component analysis: a statistical analysis , 1997 .

[31]  Scott C. Douglas,et al.  Fixed-Point Algorithms for the Blind Separation of Arbitrary Complex-Valued Non-Gaussian Signal Mixtures , 2007, EURASIP J. Adv. Signal Process..

[32]  Amine Nait-Ali Advanced Biosignal Processing , 2009 .

[33]  Jean-Christophe Pesquet,et al.  Quadratic Higher Order Criteria for Iterative Blind Separation of a MIMO Convolutive Mixture of Sources , 2007, IEEE Transactions on Signal Processing.

[34]  Eric Moreau,et al.  Criteria for complex sources separation , 1996, 1996 8th European Signal Processing Conference (EUSIPCO 1996).

[35]  Erkki Oja,et al.  Performance analysis of the FastICA algorithm and Crame/spl acute/r-rao bounds for linear independent component analysis , 2006, IEEE Transactions on Signal Processing.

[36]  Friedberg Ck Computers in cardiology. , 1970 .

[37]  P. Loubaton,et al.  Blind deconvolution of multivariate signals: A deflation approach , 1993, Proceedings of ICC '93 - IEEE International Conference on Communications.

[38]  Aapo Hyvärinen,et al.  A Fast Fixed-Point Algorithm for Independent Component Analysis of Complex Valued Signals , 2000, Int. J. Neural Syst..

[39]  Pierre Comon,et al.  Handbook of Blind Source Separation: Independent Component Analysis and Applications , 2010 .

[40]  Vicente Zarzoso,et al.  Extraction of ECG Characteristics Using Source Separation Techniques: Exploiting Statistical Independence and Beyond , 2009 .

[41]  Marc Castella,et al.  Generalized Identifiability Conditions for Blind Convolutive MIMO Separation , 2009, IEEE Transactions on Signal Processing.

[42]  Jean-Christophe Pesquet,et al.  Cumulant-based independence measures for linear mixtures , 2001, IEEE Trans. Inf. Theory.

[43]  José Millet-Roig,et al.  Spatiotemporal blind source separation approach to atrial activity estimation in atrial tachyarrhythmias , 2005, IEEE Transactions on Biomedical Engineering.

[44]  P. Comon Contrasts, independent component analysis, and blind deconvolution , 2004 .

[45]  Marc Castella,et al.  A new optimization method for reference-based quadratic contrast functions in a deflation scenario , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[46]  Sergio Bermejo,et al.  Finite sample effects of the fast ICA algorithm , 2007, Neurocomputing.

[47]  Ehud Weinstein,et al.  New criteria for blind deconvolution of nonminimum phase systems (channels) , 1990, IEEE Trans. Inf. Theory.

[48]  D. Donoho ON MINIMUM ENTROPY DECONVOLUTION , 1981 .

[49]  Phillip A. Regalia A finite-interval constant modulus algorithm , 2002, 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[50]  D. Godard,et al.  Self-Recovering Equalization and Carrier Tracking in Two-Dimensional Data Communication Systems , 1980, IEEE Trans. Commun..

[51]  R. Wiggins Minimum entropy deconvolution , 1978 .

[52]  Marc Castella,et al.  New Kurtosis Optimization Schemes for MISO Equalization , 2012, IEEE Transactions on Signal Processing.

[53]  Pierre Comon,et al.  Blind channel equalization with algebraic optimal step size , 2005, 2005 13th European Signal Processing Conference.

[54]  Shun-ichi Amari,et al.  Adaptive blind signal processing-neural network approaches , 1998, Proc. IEEE.

[55]  Pierre Comon,et al.  Improved contrast dedicated to blind separation in communications , 1997, 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[56]  William H. Press,et al.  Numerical recipes in C , 2002 .

[57]  Pierre Comon,et al.  Automated Extraction of Atrial Fibrillation Activity from the Surface ECG Using Independent Component Analysis in the Frequency Domain , 2009 .

[58]  Eric Moreau,et al.  A one stage self-adaptive algorithm for source separation , 1994, Proceedings of ICASSP '94. IEEE International Conference on Acoustics, Speech and Signal Processing.

[59]  Eric Moreau,et al.  Nonsymmetrical contrasts for sources separation , 1999, IEEE Trans. Signal Process..

[60]  Ibon Saratxaga,et al.  Detection of synthetic speech for the problem of imposture , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[61]  Eric Moulines,et al.  A blind source separation technique using second-order statistics , 1997, IEEE Trans. Signal Process..

[62]  Jitendra K. Tugnait,et al.  Identification and deconvolution of multichannel linear non-Gaussian processes using higher order statistics and inverse filter criteria , 1997, IEEE Trans. Signal Process..

[63]  Hualiang Li,et al.  A Class of Complex ICA Algorithms Based on the Kurtosis Cost Function , 2008, IEEE Transactions on Neural Networks.

[64]  Tapani Ristaniemi,et al.  Advanced ICA-based receivers for block fading DS-CDMA channels , 2002, Signal Process..

[65]  J. Treichler,et al.  A new approach to multipath correction of constant modulus signals , 1983 .

[66]  Sergio Bermejo,et al.  Finite sample effects in higher order statistics contrast functions for sequential blind source separation , 2005, IEEE Signal Processing Letters.

[67]  Tülay Adali,et al.  Complex ICA by Negentropy Maximization , 2008, IEEE Transactions on Neural Networks.

[68]  B. Widrow,et al.  Adaptive noise cancelling: Principles and applications , 1975 .

[69]  David Gesbert,et al.  From theory to practice: an overview of MIMO space-time coded wireless systems , 2003, IEEE J. Sel. Areas Commun..

[70]  J. Pesquet,et al.  Generalized contrasts for multichannel blind deconvolution of linear systems , 1997, IEEE Signal Processing Letters.

[71]  Aapo Hyvärinen,et al.  Fast and robust fixed-point algorithms for independent component analysis , 1999, IEEE Trans. Neural Networks.

[72]  Shun-ichi Amari,et al.  Natural Gradient Works Efficiently in Learning , 1998, Neural Computation.

[73]  P. Comon,et al.  Blind and semi-blind equalization based on the constant power criterion , 2005, IEEE Transactions on Signal Processing.