An Adaptive Method for Subband Decomposition ICA

Subband decomposition ICA (SDICA), an extension of ICA, assumes that each source is represented as the sum of some independent subcomponents and dependent subcomponents, which have different frequency bands. In this article, we first investigate the feasibility of separating the SDICA mixture in an adaptive manner. Second, we develop an adaptive method for SDICA, namely band-selective ICA (BS-ICA), which finds the mixing matrix and the estimate of the source independent subcomponents. This method is based on the minimization of the mutual information between outputs. Some practical issues are discussed. For better applicability, a scheme to avoid the high-dimensional score function difference is given. Third, we investigate one form of the overcomplete ICA problems with sources having specific frequency characteristics, which BS-ICA can also be used to solve. Experimental results illustrate the success of the proposed method for solving both SDICA and the over-complete ICA problems.

[1]  Erkki Oja,et al.  Independent Component Analysis for Parallel Financial Time Series , 1998, International Conference on Neural Information Processing.

[2]  Scott Rickard,et al.  BLIND SOURCE SEPARATION BASED ON SPACE-TIME-FREQUENCY DIVERSITY , 2003 .

[3]  David J. Field,et al.  Sparse coding with an overcomplete basis set: A strategy employed by V1? , 1997, Vision Research.

[4]  Ruey-Wen Liu,et al.  General approach to blind source separation , 1996, IEEE Trans. Signal Process..

[5]  Jean-François Cardoso,et al.  Multidimensional independent component analysis , 1998, Proceedings of the 1998 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP '98 (Cat. No.98CH36181).

[6]  R N Vigário,et al.  Extraction of ocular artefacts from EEG using independent component analysis. , 1997, Electroencephalography and clinical neurophysiology.

[7]  J. Ord,et al.  Characterization Problems in Mathematical Statistics , 1975 .

[8]  Moeness G. Amin,et al.  Blind source separation based on time-frequency signal representations , 1998, IEEE Trans. Signal Process..

[9]  Andrzej Cichocki,et al.  Adaptive Blind Signal and Image Processing - Learning Algorithms and Applications , 2002 .

[10]  Christian Jutten,et al.  Entropy Optimization - Application to Blind Source Separation , 1997, ICANN.

[11]  Shun-ichi Amari,et al.  Natural Gradient Learning for Over- and Under-Complete Bases in ICA , 1999, Neural Computation.

[12]  Erkki Oja,et al.  Independent Component Analysis for Identification of Artifacts in Magnetoencephalographic Recordings , 1997, NIPS.

[13]  Aapo Hyvärinen,et al.  Emergence of Phase- and Shift-Invariant Features by Decomposition of Natural Images into Independent Feature Subspaces , 2000, Neural Computation.

[14]  J. Cardoso,et al.  Blind beamforming for non-gaussian signals , 1993 .

[15]  A. C. Aitken,et al.  Random variables and probability distributions , 1938 .

[16]  Erkki Oja,et al.  Independent Component Analysis , 2001 .

[17]  Pando G. Georgiev,et al.  Blind Source Separation Algorithms with Matrix Constraints , 2003, IEICE Trans. Fundam. Electron. Commun. Comput. Sci..

[18]  Andrzej Cichocki,et al.  Blind signal extraction of signals with specified frequency band , 2002, Proceedings of the 12th IEEE Workshop on Neural Networks for Signal Processing.

[19]  Tzyy-Ping Jung,et al.  Independent Component Analysis of Electroencephalographic Data , 1995, NIPS.

[20]  Aapo Hyvärinen,et al.  Estimating Overcomplete Independent Component Bases for Image Windows , 2002, Journal of Mathematical Imaging and Vision.

[21]  Simon Haykin,et al.  Image Denoising by Sparse Code Shrinkage , 2001 .

[22]  Toshihisa Tanaka,et al.  Subband decomposition independent component analysis and new performance criteria , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[23]  Jean-François Cardoso,et al.  Equivariant adaptive source separation , 1996, IEEE Trans. Signal Process..

[24]  Hui Luo,et al.  Direct blind separation of independent non-Gaussian signals with dynamic channels , 1998, 1998 Fifth IEEE International Workshop on Cellular Neural Networks and their Applications. Proceedings (Cat. No.98TH8359).

[25]  Aapo Hyvärinen,et al.  Independent Component Analysis for Time-dependent Stochastic Processes , 1998 .

[26]  Terrence J. Sejnowski,et al.  An Information-Maximization Approach to Blind Separation and Blind Deconvolution , 1995, Neural Computation.

[27]  Andrzej Cichocki,et al.  Second-order statistics based blind source separation using a bank of subband filters , 2003, Digit. Signal Process..

[28]  Christian Jutten,et al.  Blind Source Separation by Adaptive Estimation of Score Function Difference , 2004, ICA.

[29]  Kari Torkkola,et al.  Blind separation of convolved sources based on information maximization , 1996, Neural Networks for Signal Processing VI. Proceedings of the 1996 IEEE Signal Processing Society Workshop.

[30]  Xianda Zhang,et al.  Adaptive Blind Separation with an Unknown Number of Sources , 2004, Neural Computation.

[31]  D. Pham.  FAST ALGORITHM FOR ESTIMATING MUTUAL INFORMATION, ENTROPIES AND SCORE FUNCTIONS , 2003 .

[32]  Pierre Comon,et al.  Independent component analysis, A new concept? , 1994, Signal Process..

[33]  Jacek M. Zurada,et al.  Blind Signal Separation and Extraction: Recent Trends, Future Perspectives, and Applications , 2004, ICAISC.

[34]  Ivica Kopriva,et al.  Approach to blind image deconvolution by multiscale subband decomposition and independent component analysis. , 2007, Journal of the Optical Society of America. A, Optics, image science, and vision.

[35]  Christian Jutten,et al.  Separating Convolutive Mixtures by Mutual Information Minimization , 2001, IWANN.

[36]  J. Cardoso.  Infomax and maximum likelihood for blind source separation , 1997, IEEE Signal Processing Letters.

[37]  D. Chakrabarti,et al.  A fast fixed - point algorithm for independent component analysis , 1997 .

[38]  Özgür Yõlmaz,et al.  Blind Separation of Speech Mixtures via , 2004 .

[39]  Michael I. Jordan,et al.  Beyond Independent Components: Trees and Clusters , 2003, J. Mach. Learn. Res..

[40]  Calyampudi R. Rao,et al.  Characterization Problems in Mathematical Statistics , 1976 .

[41]  Terrence J. Sejnowski,et al.  Learning Overcomplete Representations , 2000, Neural Computation.

[42]  David J. Field,et al.  Emergence of simple-cell receptive field properties by learning a sparse code for natural images , 1996, Nature.

[43]  Christian Jutten,et al.  BLIND SEPARATING CONVOLUTIVE POST NON-LINEAR MIXTURES , 2001 .

[44]  Andrzej Cichocki,et al.  A New Learning Algorithm for Blind Signal Separation , 1995, NIPS.

[45]  Christian Jutten,et al.  A minimization-projection (MP) approach for blind separating convolutive mixtures , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[46]  Erkki Oja,et al.  A fast algorithm for estimating overcomplete ICA bases for image windows , 1999, IJCNN'99. International Joint Conference on Neural Networks. Proceedings (Cat. No.99CH36339).

[47]  Andrzej Cichocki,et al.  SOURCE SEPARATION OF TEMPORALLY CORRELATED SOURCE USING BANK OF BAND PASS FILTERS , 2001 .