A Curvature-based Manifold Learning Algorithm

Manifold learning aims to find a low dimensional parameterization for data sets which lie on nonlinear manifolds in a high-dimensional space. Applications of manifold learning include face recognition, image retrieval, machine learning, classification, visualization, and so on. By studying the existing manifold learning algorithms and geometric properties of local tangent space of a manifold, we propose an adaptive curvature-based manifold learning algorithm (CBML). With the algorithm, noises and the samples that do not belong to the neighborhood can be detected by computing the deflection between centralized samples and its local tangent space. It can not only be used to select adaptive neighborhood, but also take full advantage of information of neighbors. The algorithm can also be applied to manifold learning with local high curvature. Experiments show that the proposed algorithm in this paper is effective.

[1]  Christopher J. C. Burges,et al.  Dimension Reduction: A Guided Tour , 2010, Found. Trends Mach. Learn..

[2]  J. Tenenbaum,et al.  A global geometric framework for nonlinear dimensionality reduction. , 2000, Science.

[3]  Bernhard Schölkopf,et al.  Nonlinear Component Analysis as a Kernel Eigenvalue Problem , 1998, Neural Computation.

[4]  James C. Bezdek,et al.  On cluster validity for the fuzzy c-means model , 1995, IEEE Trans. Fuzzy Syst..

[5]  John W. Sammon,et al.  A Nonlinear Mapping for Data Structure Analysis , 1969, IEEE Transactions on Computers.

[6]  Alexander M. Bronstein,et al.  Multigrid multidimensional scaling , 2006, Numer. Linear Algebra Appl..

[7]  Hong Zhang,et al.  Comparison of clonogenic assay with premature chromosome condensation assay in prediction of human cell radiosensitivity. , 2006, World journal of gastroenterology.

[8]  Edsger W. Dijkstra,et al.  A note on two problems in connexion with graphs , 1959, Numerische Mathematik.

[9]  Uri M. Ascher,et al.  Computer methods for ordinary differential equations and differential-algebraic equations , 1998 .

[10]  Karl Pearson F.R.S. LIII. On lines and planes of closest fit to systems of points in space , 1901 .

[11]  Charles E. Heckler,et al.  Applied Multivariate Statistical Analysis , 2005, Technometrics.

[12]  Wen-Jian Li,et al.  Comparative study on radiosensitivity of various tumor cells and human normal liver cells. , 2005, World journal of gastroenterology.

[13]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[14]  Charl P. Botha,et al.  Piece wise Laplacian‐based Projection for Interactive Data Exploration and Organization , 2011, Comput. Graph. Forum.

[15]  Wei Wei,et al.  Radiobiological response of human hepatoma and normal liver cells exposed to carbon ions generated by Heavy Ion Research Facility in Lanzhou , 2006 .

[16]  L. Wenjian,et al.  Survival and initial chromatid breakage in normal and tumour cells exposed in vitro to gamma rays and carbon ions at the HIRFL. , 2006, The British journal of radiology.

[17]  W. Härdle,et al.  Applied Multivariate Statistical Analysis , 2003 .

[18]  Joseph L. Zinnes,et al.  Theory and Methods of Scaling. , 1958 .

[19]  Heng Tao Shen,et al.  Principal Component Analysis , 2009, Encyclopedia of Biometrics.

[20]  Joshua B. Tenenbaum,et al.  Global Versus Local Methods in Nonlinear Dimensionality Reduction , 2002, NIPS.

[21]  Anthony J. Kearsley,et al.  The Solution of the Metric STRESS and SSTRESS Problems in Multidimensional Scaling Using Newton's Method , 1995 .

[22]  Gary L. Miller,et al.  Approaching Optimality for Solving SDD Linear Systems , 2010, 2010 IEEE 51st Annual Symposium on Foundations of Computer Science.

[23]  Michel Verleysen,et al.  Unsupervised dimensionality reduction: Overview and recent advances , 2010, The 2010 International Joint Conference on Neural Networks (IJCNN).

[24]  Kilian Q. Weinberger,et al.  Spectral Methods for Dimensionality Reduction , 2006, Semi-Supervised Learning.

[25]  Yehuda Koren,et al.  Ieee Transactions on Visualization and Computer Graphics Robust Linear Dimensionality Reduction , 2022 .

[26]  Marc Olano,et al.  Glimmer: Multilevel MDS on the GPU , 2009, IEEE Transactions on Visualization and Computer Graphics.

[27]  B. Manly Multivariate Statistical Methods : A Primer , 1986 .

[28]  Jon Louis Bentley,et al.  An Algorithm for Finding Best Matches in Logarithmic Expected Time , 1977, TOMS.

[29]  Rosane Minghim,et al.  On Improved Projection Techniques to Support Visual Exploration of Multi-Dimensional Data Sets , 2003, Inf. Vis..