Geometric Manifold Learning

We present algorithms for analyzing massive and high dimensional data sets motivated by theorems from geometry and topology. Optimization criteria for computing data projections are discussed and skew radial basis functions (sRBFs) for constructing nonlinear mappings with sharp transitions are demonstrated. Examples related to modeling dynamical systems, including hurricane intensity and financial time series prediction, are presented. The article represents an overview of the authors' and collaborators' work in manifold learning.

[1]  Arta A. Jamshidi,et al.  Examples of Compactly Supported Functions for Radial Basis Approximations , 2006, MLMTA.

[2]  Kenneth Falconer,et al.  Fractal Geometry: Mathematical Foundations and Applications , 1990 .

[3]  Jooyoung Park,et al.  Approximation and Radial-Basis-Function Networks , 1993, Neural Computation.

[4]  Jooyoung Park,et al.  Universal Approximation Using Radial-Basis-Function Networks , 1991, Neural Computation.

[5]  H. Akaike.  A new look at the statistical model identification , 1974 .

[6]  Holger Wendland,et al.  Scattered Data Approximation: Conditionally positive definite functions , 2004 .

[7]  D. Broomhead,et al.  Dimensionality Reduction Using Secant-Based Projection Methods: The Induced Dynamics in Projected Systems , 2005 .

[8]  M. Kramer.  Nonlinear principal component analysis using autoassociative neural networks , 1991 .

[9]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[10]  James P. Crutchfield,et al.  Geometry from a Time Series , 1980 .

[11]  Michael Kirby,et al.  Geometric Analysis for the Characterization of Nonstationary Time Series , 2003 .

[12]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[13]  G. P. King,et al.  Topological dimension and local coordinates from time series data , 1987 .

[14]  J. D. Farmer,et al.  Nonlinear modeling of chaotic time series: Theory and applications , 1990 .

[15]  R. Schaback,et al.  Characterization and construction of radial basis functions , 2001 .

[16]  David S. Broomhead,et al.  Multivariable Functional Interpolation and Adaptive Networks , 1988, Complex Syst..

[17]  R. N. Desmarais,et al.  Interpolation using surface splines. , 1972 .

[18]  Alan McLachlan.  An improved novelty criterion for resource allocating networks , 1997 .

[19]  David S. Broomhead,et al.  The Whitney Reduction Network: A Method for Computing Autoassociative Graphs , 2001, Neural Computation.

[20]  Mikhail Belkin,et al.  Laplacian Eigenmaps for Dimensionality Reduction and Data Representation , 2003, Neural Computation.

[21]  Arta A. Jamshidi,et al.  Towards a Black Box Algorithm for Nonlinear Function Approximation over High-Dimensional Domains , 2007, SIAM J. Sci. Comput..

[22]  D. Donoho,et al.  Hessian eigenmaps: Locally linear embedding techniques for high-dimensional data , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[23]  D. Broomhead,et al.  Embedding theorems for non-uniformly sampled dynamical systems , 2007 .

[24]  R. L. Hardy.  Multiquadric equations of topography and other irregular surfaces , 1971 .

[25]  David S. Broomhead,et al.  A New Approach to Dimensionality Reduction: Theory and Algorithms , 2000, SIAM J. Appl. Math..

[26]  D. Broomhead,et al.  Radial Basis Functions, Multi-Variable Functional Interpolation and Adaptive Networks , 1988 .

[27]  Lianfen Qian,et al.  Regularized Radial Basis Function Networks: Theory and Applications , 2002, Technometrics.

[28]  S. Hyakin,et al.  Neural Networks: A Comprehensive Foundation , 1994 .

[29]  Arta A. Jamshidi.  Modeling Spatio-Temporal Systems with Skew Radial Basis Functions : Theory , Algorithms and Applications , 2008 .

[30]  Bruce A. Draper,et al.  Principal Angles Separate Subject Illumination Spaces in YDB and CMU-PIE , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  Martin D. Buhmann,et al.  Radial Basis Functions , 2021, Encyclopedia of Mathematical Geosciences.

[32]  Joerg Blasius,et al.  Geometric Data Analysis , 2000 .

[33]  J. Tenenbaum,et al.  A global geometric framework for nonlinear dimensionality reduction. , 2000, Science.

[34]  M. J. D. Powell,et al.  Radial basis functions for multivariable interpolation: a review , 1987 .

[35]  D. Barden,et al.  An introduction to differential manifolds , 2003 .

[36]  F. Takens.  Detecting strange attractors in turbulence , 1981 .

[37]  Gunnar E. Carlsson,et al.  Topology and data , 2009 .

[38]  Matthew Brand,et al.  Charting a Manifold , 2002, NIPS.

[39]  Geoffrey E. Hinton,et al.  Global Coordination of Local Linear Models , 2001, NIPS.

[40]  Arta A. Jamshidi,et al.  Skew-Radial Basis Function Expansions for Empirical Modeling , 2009, SIAM J. Sci. Comput..

[41]  Arta A. Jamshidi,et al.  Modeling Multivariate Time Series on Manifolds with Skew Radial Basis Functions , 2011, Neural Computation.