An SOM-Based Algorithm for Optimization with Dynamic Weight Updating

The self-organizing map (SOM), as a kind of unsupervised neural network, has been used for both static data management and dynamic data analysis. To further exploit its search abilities, in this paper we propose an SOM-based algorithm (SOMS) for optimization problems involving both static and dynamic functions. Furthermore, a new SOM weight updating rule is proposed to enhance the learning efficiency; this may dynamically adjust the neighborhood function for the SOM in learning system parameters. As a demonstration, the proposed SOMS is applied to function optimization and also dynamic trajectory prediction, and its performance compared with that of the genetic algorithm (GA) due to the similar ways both methods conduct searches.

[1]  Kuu-Young Young,et al.  An intelligent radar predictor for high-speed moving-target tracking , 2002, 2002 IEEE Region 10 Conference on Computers, Communications, Control and Power Engineering. TENCOM '02. Proceedings..

[2]  Reza Safabakhsh,et al.  TASOM: a new time adaptive self-organizing map , 2003, IEEE Trans. Syst. Man Cybern. Part B.

[3]  Kwong-Sak Leung,et al.  An efficient self-organizing map designed by genetic algorithms for the traveling salesman problem , 2003, IEEE Trans. Syst. Man Cybern. Part B.

[4]  Timo Honkela,et al.  WEBSOM - Self-organizing maps of document collections , 1998, Neurocomputing.

[5]  Hojjat Adeli,et al.  A probabilistic neural network for earthquake magnitude prediction , 2009, Neural Networks.

[6]  Tommy W. S. Chow,et al.  PRSOM: a new visualization method by hybridizing multidimensional scaling and self-organizing map , 2005, IEEE Transactions on Neural Networks.

[7]  Jürgen Schmidhuber,et al.  Self-organizing nets for optimization , 2004, IEEE Transactions on Neural Networks.

[8]  Mu-Chun Su,et al.  Fast self-organizing feature map algorithm , 2000, IEEE Trans. Neural Networks Learn. Syst..

[9]  Erkki Oja,et al.  PicSOM-self-organizing image retrieval with MPEG-7 content descriptors , 2002, IEEE Trans. Neural Networks.

[10]  Tat-Seng Chua,et al.  Evaluating keyword selection methods for WEBSOM text archives , 2004, IEEE Transactions on Knowledge and Data Engineering.

[11]  D. Sbarbaro,et al.  A nonlinear controller based on self-organizing maps , 1995, 1995 IEEE International Conference on Systems, Man and Cybernetics. Intelligent Systems for the 21st Century.

[12]  Hujun Yin,et al.  ViSOM - a novel method for multivariate data projection and structure visualization , 2002, IEEE Trans. Neural Networks.

[13]  Jorma Laaksonen,et al.  Variants of self-organizing maps , 1990, International 1989 Joint Conference on Neural Networks.

[14]  Goldberg,et al.  Genetic algorithms , 1993, Robust Control Systems with Genetic Algorithms.

[15]  Chip-Hong Chang,et al.  Self-organizing topological tree for online vector quantization and data clustering , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[16]  Mu-Chun Su,et al.  SOM-based optimization , 2004, 2004 IEEE International Joint Conference on Neural Networks (IEEE Cat. No.04CH37541).

[17]  Klaus Schulten,et al.  Implementation of self-organizing neural networks for visuo-motor control of an industrial robot , 1993, IEEE Trans. Neural Networks.

[18]  Ah Chung Tsoi,et al.  A supervised self-organizing map for structures , 2004, 2004 IEEE International Joint Conference on Neural Networks (IEEE Cat. No.04CH37541).

[19]  Aluizio F. R. Araújo,et al.  Identification and control of dynamical systems using the self-organizing map , 2004, IEEE Transactions on Neural Networks.

[20]  Giuliano Grossi,et al.  Adaptiveness in Monotone Pseudo-Boolean Optimization and Stochastic Neural Computation , 2009, Int. J. Neural Syst..

[21]  Sung-Bae Cho,et al.  Fusion of structure adaptive self-organizing maps using fuzzy integral , 2003, Proceedings of the International Joint Conference on Neural Networks, 2003..

[22]  Stephen Grossberg,et al.  The ART of adaptive pattern recognition by a self-organizing neural network , 1988, Computer.

[23]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[24]  Teuvo Kohonen,et al.  Self-Organizing Maps , 2010 .

[25]  J. Príncipe,et al.  Local dynamic modeling with self-organizing maps and applications to nonlinear system identification and control , 1998, Proc. IEEE.

[26]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .