Nonlinear Projection Using Geodesic Distances and the Neural Gas Network

A nonlinear projection method that uses geodesic distances and the neural gas network is proposed. First, the neural gas algorithm is used to obtain codebook vectors, and a connectivity graph is concurrently created by using competitive Hebbian rule. A procedure is added to tear or break non-contractible cycles in the connectivity graph, in order to project efficiently 'circular' manifolds such as cylinder or torus. In the second step, the nonlinear projection is created by applying an adaptation rule for codebook positions in the projection space. The mapping quality obtained with the proposed method outperforms CDA and Isotop, in terms of the trustworthiness, continuity, and topology preservation measures.

[1]  Michel Verleysen,et al.  A robust non-linear projection method , 2000, ESANN.

[2]  Yeuvo Jphonen,et al.  Self-Organizing Maps , 1995 .

[3]  Michel Verleysen,et al.  Nonlinear projection with curvilinear distances: Isomap versus curvilinear distance analysis , 2004, Neurocomputing.

[4]  Michel Verleysen,et al.  Nonlinear Projection with the Isotop Method , 2002, ICANN.

[5]  Jarkko Venna,et al.  Local Multidimensional Scaling with Controlled Tradeoff Between Trustworthiness and Continuity , 2005 .

[6]  R. Prim.  Shortest connection networks and some generalizations , 1957 .

[7]  Michel Verleysen,et al.  Nonlinear dimensionality reduction of data manifolds with essential loops , 2005, Neurocomputing.

[8]  Thomas Martinetz,et al.  Topology representing networks , 1994, Neural Networks.

[9]  Teuvo Kohonen,et al.  Self-Organizing Maps , 2010 .

[10]  Thomas Martinetz,et al.  'Neural-gas' network for vector quantization and its application to time-series prediction , 1993, IEEE Trans. Neural Networks.

[11]  Andreas König,et al.  Interactive visualization and analysis of hierarchical neural projections for data mining , 2000, IEEE Trans. Neural Networks Learn. Syst..

[12]  Jarkko Venna,et al.  Trustworthiness and metrics in visualizing similarity of gene expression , 2003, BMC Bioinformatics.

[13]  Hyun Seung Yang,et al.  Non-uniform image compression using a biologically motivated selective attention model , 2005, Neurocomputing.

[14]  Pablo A. Estévez,et al.  Online data visualization using the neural gas network , 2006, Neural Networks.

[15]  Edsger W. Dijkstra,et al.  A note on two problems in connexion with graphs , 1959, Numerische Mathematik.

[16]  Amaury Lendasse,et al.  A robust nonlinear projection method , 2000 .

[17]  Pablo A. Estévez,et al.  Geodesic Nonlinear Mapping Using the Neural Gas Network , 2006, The 2006 IEEE International Joint Conference on Neural Network Proceedings.

[18]  Jeanny Hérault,et al.  Curvilinear component analysis: a self-organizing neural network for nonlinear mapping of data sets , 1997, IEEE Trans. Neural Networks.