A General Framework for Manifold Alignment

Manifold alignment has been found to be useful in many fields of machine learning and data mining. In this paper we summarize our work in this area and introduce a general framework for manifold alignment. This framework generates a family of approaches to align manifolds by simultaneously matching the corresponding instances and preserving the local geometry of each given manifold. Some approaches like semi-supervised alignment and manifold projections can be obtained as special cases. Our framework can also solve multiple manifold alignment problems and be adapted to handle the situation when no correspondence information is available. The approaches are described and evaluated both theoretically and experimentally, providing results showing useful knowledge transfer from one domain to another. Novel applications of our methods including identification of topics shared by multiple document collections, and biological structure alignment are discussed in the paper.

[1]  David Haussler,et al.  Convolution kernels on discrete structures , 1999 .

[2]  Sridhar Mahadevan,et al.  Manifold alignment using Procrustes analysis , 2008, ICML '08.

[3]  Ronald R. Coifman,et al.  Data Fusion and Multicue Data Matching by Diffusion Maps , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Fei Wang,et al.  Semi-definite Manifold Alignment , 2007, ECML.

[5]  Mikhail Belkin,et al.  Laplacian Eigenmaps for Dimensionality Reduction and Data Representation , 2003, Neural Computation.

[6]  T. N. Bhat,et al.  The Protein Data Bank , 2000, Nucleic Acids Res..

[7]  Michael I. Jordan,et al.  Latent Dirichlet Allocation , 2001, J. Mach. Learn. Res..

[8]  L. Hogben Handbook of Linear Algebra , 2006 .

[9]  R. Coifman,et al.  Diffusion Wavelets , 2004 .

[10]  Daniel D. Lee,et al.  Semisupervised alignment of manifolds , 2005, AISTATS.

[11]  Fernando Diaz,et al.  Pseudo-Aligned Multilingual Corpora , 2007, IJCAI.

[12]  Xiaofei He,et al.  Locality Preserving Projections , 2003, NIPS.

[13]  Arthur D. Szlam,et al.  Diffusion wavelet packets , 2006 .

[14]  T. Landauer,et al.  Indexing by Latent Semantic Analysis , 1990 .