Analyse en composantes indépendantes et réseaux bayésiens

We present a generalization of independent component analysis (ICA), where instead of looking for a linear transform that makes the data components independent, we look for a transform that makes the data components well fit by a tree-structured graphical model. This tree-dependent component analysis (TCA) provides a tractable and flexible approach to weakening the assumption of independence in ICA. In particular, TCA allows the underlying graph to have multiple connected components, and thus the method is able to find “clusters” of components such that components are dependent within a cluster and independent between clusters. Our framework applies equally well for temporally independent non-Gaussian sources and for stationary Gaussian sources.

[1]  Michael I. Jordan,et al.  Kernel independent component analysis , 2003, 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03)..

[2]  Michael I. Jordan,et al.  FINDING CLUSTERS IN INDEPENDENT COMPONENT ANALYSIS , 2003 .

[3]  A. Willsky Multiresolution Markov models for signal and image processing , 2002, Proc. IEEE.

[4]  Michael I. Jordan,et al.  Tree-dependent Component Analysis , 2002, UAI.

[5]  Dinh-Tuan Pham,et al.  Mutual information approach to blind separation of stationary sources , 2002, IEEE Trans. Inf. Theory.

[6]  Aapo Hyvärinen,et al.  Emergence of Phase- and Shift-Invariant Features by Decomposition of Natural Images into Independent Feature Subspaces , 2000, Neural Computation.

[7]  Joos Vandewalle,et al.  Fetal electrocardiogram extraction by blind source subspace separation , 2000, IEEE Transactions on Biomedical Engineering.

[8]  Ali Mansour,et al.  Blind Separation of Sources , 1999 .

[9]  Shotaro Akaho,et al.  MICA: multimodal independent component analysis , 1999, IJCNN'99. International Joint Conference on Neural Networks. Proceedings (Cat. No.99CH36339).

[10]  Jean-Franois Cardoso High-Order Contrasts for Independent Component Analysis , 1999, Neural Computation.

[11]  Jean-François Cardoso,et al.  Multidimensional independent component analysis , 1998, Proceedings of the 1998 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP '98 (Cat. No.98CH36181).

[12]  Michael I. Jordan Graphical Models , 1998 .

[13]  Alexander J. Smola,et al.  Learning with kernels , 1998 .

[14]  John N. Tsitsiklis,et al.  Introduction to linear optimization , 1997, Athena scientific optimization and computation series.

[15]  D. Brillinger Remarks Concerning Graphical Models for Time Series and Point Processes , 1996 .

[16]  R. K. Shyamasundar,et al.  Introduction to algorithms , 1996 .

[17]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[18]  P. Comon Independent Component Analysis , 1992 .

[19]  P. J. Green,et al.  Density Estimation for Statistics and Data Analysis , 1987 .

[20]  C. N. Liu,et al.  Approximating discrete probability distributions with dependence trees , 1968, IEEE Trans. Inf. Theory.