A study of parallel neural networks

A parallel self-organizing map (parallel-SOM) is proposed to modify a self-organizing map for parallel computing environments. In this model, the conventional repeated learning procedure is modified to learn just once. The once learning manner is more similar to human learning and memorizing activities. During training, every connection between neurons of input and output layers is considered as an independent processor. In this way, all elements of every matrix are calculated simultaneously. This synchronization feature improves the weight updating sequence significantly. In the paper, parallel-SOM is implemented in a conventional computing environment (one processor), without the once learning and parallel weight updating features to show the correction of the algorithm. As an application parallel-SOM is used for the classification of meteorological radar images.

[1]  Joel L. Davis,et al.  An Introduction to Neural and Electronic Networks , 1995 .

[2]  Nilton C. da Silva,et al.  Implementation of parallel self-organizing map for the classification of images , 1999, Defense, Security, and Sensing.

[3]  H. Ritter,et al.  Convergence properties of Kohonen's topology conserving maps: fluctuations, stability, and dimension selection , 1988, Biological Cybernetics.

[4]  Judith E. Dayhoff,et al.  Neural Network Architectures: An Introduction , 1989 .

[5]  Stan Openshaw,et al.  A parallel Kohonen algorithm for the classification of large spatial datasets , 1996 .

[6]  Christoph Dürr,et al.  A Quantum Algorithm for Finding the Minimum , 1996, ArXiv.

[7]  Erich Schikuta,et al.  Data parallel simulation of self-organizing maps on hypercube architectures. , 1997 .

[8]  Li Weigang.  A Study of Parallel Self-Organizing Map , 1998 .

[9]  J. Dayho.  Neural Network Architectures: an Introduction , 1990 .

[10]  Lov K. Grover.  A fast quantum mechanical algorithm for database search , 1996, STOC '96.

[11]  Lov K. Grover.  A framework for fast quantum mechanical algorithms , 1997, STOC '98.

[12]  Teuvo Kohonen,et al.  The self-organizing map , 1990 .

[13]  Tony R. Martinez,et al.  Quantum associative memory , 2000, Inf. Sci..

[14]  Chia-Jiu Wang,et al.  Parallelizing the self-organizing feature map on multiprocessor systems , 1991, Parallel Comput..

[15]  Christoph von der Malsburg,et al.  Network self-organization , 1990 .

[16]  Teuvo Kohonen,et al.  Self-organized formation of topologically correct feature maps , 2004, Biological Cybernetics.

[17]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .