A Minimum-Range Approach to Blind Extraction of Bounded Sources

In spite of the numerous approaches that have been derived for solving the independent component analysis (ICA) problem, it is still interesting to develop new methods when, among other reasons, specific a priori knowledge may help to further improve the separation performances. In this paper, the minimum-range approach to blind extraction of bounded source is investigated. The relationship with other existing well-known criteria is established. It is proved that the minimum-range approach is a contrast, and that the criterion is discriminant in the sense that it is free of spurious maxima. The practical issues are also discussed, and a range measure estimation is proposed based on the order statistics. An algorithm for contrast maximization over the group of special orthogonal matrices is proposed. Simulation results illustrate the performances of the algorithm when using the proposed range estimation criterion

[1]  S. Haykin.  Unsupervised adaptive filtering, vol. 1: Blind source separation , 2000 .

[2]  Yolanda Blanco Archilla,et al.  An Overview of BSS Techniques Based on Order Statistics: Formulation and Implementation Issues , 2004, ICA.

[3]  Rachid Deriche,et al.  Regularizing Flows for Constrained Matrix-Valued Images , 2004, Journal of Mathematical Imaging and Vision.

[4]  Alberto Prieto,et al.  A neural learning algorithm for blind separation of sources based on geometric properties , 1998, Signal Process..

[5]  Jani Even.  Contributions à la séparation de sources à l'aide de statistiques d'ordre , 2003 .

[6]  J. Cardoso,et al.  Blind beamforming for non-gaussian signals , 1993 .

[7]  Iván Durán-Díaz,et al.  The Minimum Support Criterion for Blind Signal Extraction: A Limiting Case of the Strengthened Young's Inequality , 2004, ICA.

[8]  Michel Verleysen,et al.  On the entropy minimization of a linear mixture of variables for source separation , 2005, Signal Process..

[9]  Juan José Murillo-Fuentes,et al.  A sinusoidal contrast function for the blind separation of statistically independent sources , 2004, IEEE Transactions on Signal Processing.

[10]  Michel Verleysen,et al.  Minimum Support ICA Using Order Statistics. Part I: Quasi-range Based Support Estimation , 2006, ICA.

[11]  Mark D. Plumbley.  Lie Group Methods for Optimization with Orthogonality Constraints , 2004, ICA.

[12]  Terrence J. Sejnowski,et al.  An Information-Maximization Approach to Blind Separation and Blind Deconvolution , 1995, Neural Computation.

[13]  M. Verleysen,et al.  A Least Absolute Bound Approach to ICA - Application to the MLSP 2006 Competition , 2006, 2006 16th IEEE Signal Processing Society Workshop on Machine Learning for Signal Processing.

[14]  Michel Verleysen,et al.  Filtering-Free Blind Separation of Correlated Images , 2005, IWANN.

[15]  L. Devroye,et al.  Detection of Abnormal Behavior Via Nonparametric Estimation of the Support , 1980 .

[16]  Jesus Santana Blanco.  Hybrid self-learning fuzzy PD+I control of unknown linear and nonlinear systems , 2004, Proceedings of the Fifth Mexican International Conference in Computer Science, 2004. ENC 2004..

[17]  Fabian J. Theis,et al.  Robust overcomplete matrix recovery for sparse sources using a generalized Hough transform , 2004, ESANN.

[18]  Nathalie Delfosse,et al.  Adaptive blind separation of independent sources: A deflation approach , 1995, Signal Process..

[19]  Terrence J. Sejnowski,et al.  Independent Component Analysis Using an Extended Infomax Algorithm for Mixed Subgaussian and Supergaussian Sources , 1999, Neural Computation.

[20]  Erkki Oja,et al.  Efficient Variant of Algorithm FastICA for Independent Component Analysis Attaining the CramÉr-Rao Lower Bound , 2006, IEEE Transactions on Neural Networks.

[21]  Michel Verleysen,et al.  SWM : a class of convex contrasts for source separation , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[22]  Pierre Comon,et al.  Independent component analysis, A new concept? , 1994, Signal Process..

[23]  Terrence J. Sejnowski,et al.  Independent Component Analysis Using an Extended Infomax Algorithm for Mixed Sub-Gaussian and Super-Gaussian Sources , 1999, Neural Comput..

[24]  Andrzej Cichocki,et al.  Adaptive blind signal and image processing , 2002 .

[25]  John W. Fisher,et al.  ICA Using Spacings Estimates of Entropy , 2003, J. Mach. Learn. Res..

[26]  Simone G. O. Fiori,et al.  A Theory for Learning by Weight Flow on Stiefel-Grassman Manifold , 2001, Neural Computation.

[27]  Fabian J. Theis,et al.  Linear Geometric ICA: Fundamentals and Algorithms , 2003, Neural Computation.

[28]  Dinh-Tuan Pham,et al.  Local minima of information-theoretic criteria in blind source separation , 2005, IEEE Signal Processing Letters.

[29]  Mark D. Plumbley.  Algorithms for nonnegative independent component analysis , 2003, IEEE Trans. Neural Networks.

[30]  Johnson Chu.  SOME USES OF QUASI-RANGES' , 1957 .

[31]  D. Chakrabarti,et al.  A fast fixed - point algorithm for independent component analysis , 1997 .

[32]  Michel Verleysen,et al.  Zero-Entropy Minimization for Blind Extraction of Bounded Sources (BEBS) , 2006, ICA.

[33]  Aapo Hyvärinen,et al.  A Fast Fixed-Point Algorithm for Independent Component Analysis , 1997, Neural Computation.

[34]  Erwin Lutwak,et al.  Information-theoretic inequalities for contoured probability distributions , 2002, IEEE Trans. Inf. Theory.

[35]  Dinh-Tuan Pham,et al.  Blind separation of instantaneous mixture of sources based on order statistics , 2000, IEEE Trans. Signal Process..

[36]  Wei Lu,et al.  Approach and applications of constrained ICA , 2005, IEEE Transactions on Neural Networks.

[37]  Vwani P. Roychowdhury,et al.  Independent component analysis based on nonparametric density estimation , 2004, IEEE Transactions on Neural Networks.

[38]  Deniz Erdogmus,et al.  Information Theoretic Learning , 2005, Encyclopedia of Artificial Intelligence.

[39]  Michel Verleysen,et al.  A simple ICA algorithm for non-differentiable contrasts , 2005, 2005 13th European Signal Processing Conference.

[40]  Alper T. Erdogan,et al.  A simple geometric blind source separation method for bounded magnitude sources , 2006, IEEE Transactions on Signal Processing.

[41]  Luís B. Almeida,et al.  MISEP -- Linear and Nonlinear ICA Based on Mutual Information , 2003, J. Mach. Learn. Res..

[42]  Michel Verleysen,et al.  Mixing and Non-Mixing Local Minima of the Entropy Contrast for Blind Source Separation , 2006, IEEE Transactions on Information Theory.

[43]  Deniz Erdoğmuş,et al.  Blind source separation using Renyi's mutual information , 2001, IEEE Signal Processing Letters.