An efficient MDS-based topographic mapping algorithm

Here, an multidimensional scaling-based (MDS-based) topographic mapping algorithm is proposed, named the stochastic MDS network. Because this network utilizes not local but global information over all the units, it can find more optimal results than previous models. In addition, by using a stochastic gradient algorithm, the mapping formation in this network is carried out as efficiently as in SOM-like models based on only the local information. Some simple numerical experiments verified the validity and efficiency of this network. It was also applied to the formation of large-scale topographic mappings, and could form various interesting mappings.

[1]  Jorma Laaksonen,et al.  SOM_PAK: The Self-Organizing Map Program Package , 1996 .

[2]  I. Batalin,et al.  A Generalized Canonical Formalism and Quantization of Reducible Gauge Theories , 1983 .

[3]  N. Swindale.  The development of topography in the visual cortex: a review of models. , 1996, Network.

[4]  Kazunori Yamaguchi,et al.  Global Mapping Analysis: Stochastic Approximation for Multidimensional Scaling , 2001, Int. J. Neural Syst..

[5]  Teuvo Kohonen,et al.  Self-organized formation of topologically correct feature maps , 2004, Biological Cybernetics.

[6]  Terence D. Sanger,et al.  Optimal unsupervised learning in a single-layer linear feedforward neural network , 1989, Neural Networks.

[7]  E. Oja,et al.  On stochastic approximation of the eigenvectors and eigenvalues of the expectation of a random matrix , 1985 .

[8]  Trevor F. Cox,et al.  Metric multidimensional scaling , 2000 .

[9]  Yeuvo Jphonen,et al.  Self-Organizing Maps , 1995 .

[10]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[11]  Thomas Martinetz,et al.  'Neural-gas' network for vector quantization and its application to time-series prediction , 1993, IEEE Trans. Neural Networks.

[12]  Teuvo Kohonen,et al.  Self-Organizing Maps , 2010 .

[13]  Klaus Schulten,et al.  Models of Orientation and Ocular Dominance Columns in the Visual Cortex: A Critical Comparison , 1995, Neural Computation.

[14]  R. Jackson.  Inequalities , 2007, Algebra for Parents.

[15]  Terrence J. Sejnowski,et al.  A Unifying Objective Function for Topographic Mappings , 1997, Neural Computation.

[16]  T. Kohonen.  Self-organized formation of topographically correct feature maps , 1982 .

[17]  Samuel Kaski,et al.  Self organization of a massive document collection , 2000, IEEE Trans. Neural Networks Learn. Syst..

[18]  Forrest W. Young,et al.  Nonmetric individual differences multidimensional scaling: An alternating least squares method with optimal scaling features , 1977 .