A generalized canonical correlation analysis based method for blind source separation from related data sets

In this paper, we consider an extension of independent component analysis (ICA) and blind source separation (BSS) techniques to several related data sets. The goal is to separate mutually dependent and independent components or source signals from these data sets. This problem is important in practice, because such data sets are common in real-world applications. We propose a new method which first uses a generalization of standard canonical correlation analysis (CCA) for detecting subspaces of independent and dependent components. Any ICA or BSS method can after this be used for final separation of these components. The proposed method performs well for synthetic data sets for which the assumed data model holds, and provides interesting and meaningful results for real-world functional magnetic resonance imaging (fMRI) data. The method is straightforward to implement and computationally not too demanding. The proposed method improves clearly the separation results of several well-known ICA and BSS methods compared with the situation in which generalized CCA is not used.

[1]  Juha Karhunen,et al.  Finding dependent and independent components from two related data sets , 2011, The 2011 International Joint Conference on Neural Networks.

[2]  Colin Fyfe,et al.  Exploratory Correlation Analysis , 2002, ESANN.

[3]  Aapo Hyvärinen,et al.  Blind source separation by nonstationarity of variance: a cumulant-based approach , 2001, IEEE Trans. Neural Networks.

[4]  Vince D. Calhoun,et al.  Canonical Correlation Analysis for Data Fusion and Group Inferences , 2010, IEEE Signal Processing Magazine.

[5]  Aapo Hyvärinen,et al.  Fast and robust fixed-point algorithms for independent component analysis , 1999, IEEE Trans. Neural Networks.

[6]  A. Hyvarinen Blind source separation by nonstationarity of variance: a cumulant-based approach. , 2001, IEEE transactions on neural networks.

[7]  Jack C. Lee Multivariate Analysis (2nd Ed.) , 1982 .

[8]  Aapo Hyvärinen,et al.  Extracting Coactivated Features from Multiple Data Sets , 2011, ICANN.

[9]  Terrence J. Sejnowski,et al.  Slow Feature Analysis: Unsupervised Learning of Invariances , 2002, Neural Computation.

[10]  J. Kettenring,et al.  Canonical Analysis of Several Sets of Variables , 2022 .

[11]  Tülay Adali,et al.  Nonorthogonal Independent Vector Analysis Using Multivariate Gaussian Model , 2010, LVA/ICA.

[12]  E. Oja,et al.  Independent Component Analysis , 2013 .

[13]  Andrzej Cichocki,et al.  Adaptive Blind Signal and Image Processing - Learning Algorithms and Applications , 2002 .

[14]  Juha Karhunen,et al.  Extending ICA for finding jointly dependent components from two related data sets , 2007, Neurocomputing.

[15]  Samuel Kaski,et al.  Dependencies between stimuli and spatially independent fMRI sources: Towards brain correlates of natural stimuli , 2009, NeuroImage.

[16]  Andrzej Cichocki,et al.  Adaptive blind signal and image processing , 2002 .

[17]  Jean-Francois Cardoso,et al.  THE THREE EASY ROUTES TO INDEPENDENT COMPONENT ANALYSIS; CONTRASTS AND GEOMETRY , 2001 .

[18]  Aapo Hyvärinen,et al.  A unifying model for blind separation of independent sources , 2005, Signal Process..

[19]  Arie Yeredor,et al.  Second-order methods based on color , 2010 .

[20]  E. Smith Methods of Multivariate Analysis , 1997 .

[21]  Pierre Comon,et al.  Handbook of Blind Source Separation: Independent Component Analysis and Applications , 2010 .

[22]  Michael I. Jordan,et al.  A Probabilistic Interpretation of Canonical Correlation Analysis , 2005 .

[23]  Vince D. Calhoun,et al.  Joint Blind Source Separation by Multiset Canonical Correlation Analysis , 2009, IEEE Transactions on Signal Processing.

[24]  Marc M. Van Hulle,et al.  Constrained Subspace ICA Based on Mutual Information Optimization Directly , 2008, Neural Computation.

[25]  Samuel Kaski,et al.  Fast dependent components for fMRI analysis , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[26]  Jean-François Cardoso,et al.  Multidimensional independent component analysis , 1998, Proceedings of the 1998 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP '98 (Cat. No.98CH36181).

[27]  Samuel Kaski,et al.  Bayesian exponential family projections for coupled data sources , 2010, UAI.

[28]  Connie M. Borror,et al.  Methods of Multivariate Analysis, 2nd Ed. , 2004 .

[29]  Jarkko Ylipaavalniemi,et al.  Analyzing consistency of independent components: An fMRI illustration , 2008, NeuroImage.

[30]  J. Cardoso,et al.  Blind beamforming for non-gaussian signals , 1993 .

[31]  Ignacio Santamaría,et al.  A learning algorithm for adaptive canonical correlation analysis of several data sets , 2007, Neural Networks.

[32]  Dinh-Tuan Pham,et al.  Blind separation of instantaneous mixtures of nonstationary sources , 2001, IEEE Trans. Signal Process..