A Study of Parallel Self-Organizing Map

A Parallel Self-Organizing Map (Parallel-SOM) is proposed to modify Kohonen's SOM in parallel computing environment. In this model, two separate layers of neurons are connected together. The number of neurons in both layers and connections between them is the product of the number of all elements of input signals and the number of possible classification of the data. With this structure the conventional repeated learning procedure is modified to learn just once. The once learning manner is more similar to human learning and memorizing activities. During training, weight updating is managed through a sequence of operations among some transformation and operation matrices. Every connection between neurons of input/output layers is considered as a independent processor. In this way, all elements of the Euclidean distance matrix and weight matrix are calculated simultaneously. The minimum distance of every line of distance matrix can be found by Grover's search algorithm. This synchronization feature improves the weight updating sequence significantly. With a typical classification example, the convergence result demonstrates efficient performance of Parallel-SOM. Theoretic analysis and proofs also show some important properties of proposed model. Especially, the paper proves that Parallel-SOM has the same convergence property as Kohonen's SOM, but the complexity of former is reduced obviously.

[1]  Christoph Dürr,et al.  A Quantum Algorithm for Finding the Minimum , 1996, ArXiv.

[2]  J. A. Jones,et al.  Implementation of a quantum algorithm on a nuclear magnetic resonance quantum computer , 1998, quant-ph/9801027.

[3]  Judith E. Dayhoff,et al.  Neural Network Architectures: An Introduction , 1989 .

[4]  Peter W. Shor,et al.  Polynomial-Time Algorithms for Prime Factorization and Discrete Logarithms on a Quantum Computer , 1995, SIAM Rev..

[5]  Teuvo Kohonen,et al.  The self-organizing map , 1990, Neurocomputing.

[6]  T. Martinez,et al.  Quantum associative memory with exponential capacity , 1998, 1998 IEEE International Joint Conference on Neural Networks Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98CH36227).

[7]  R. Feynman Simulating physics with computers , 1999 .

[8]  S. Sorooshian,et al.  Precipitation Estimation from Remotely Sensed Information Using Artificial Neural Networks , 1997 .

[9]  Umesh V. Vazirani,et al.  Quantum complexity theory , 1993, STOC.

[10]  Quantum Physics and Computers , 1996, quant-ph/9612014.

[11]  Tony R. Martinez,et al.  Quantum associative memory , 2000, Inf. Sci..

[12]  Ajit Narayanan,et al.  Quantum-inspired Neural Networks , 1995 .

[13]  Christoph von der Malsburg,et al.  Network self-organization , 1990 .

[14]  Ellis Horowitz,et al.  Fundamentals of Computer Algorithms , 1978 .

[15]  Mitja Perus,et al.  Neuro-Quantum Parallelism in Brain-Mind and Computers , 1996, Informatica.

[16]  D. Deutsch Quantum theory, the Church–Turing principle and the universal quantum computer , 1985, Proceedings of the Royal Society of London. A. Mathematical and Physical Sciences.

[17]  Gilles Brassard,et al.  Strengths and Weaknesses of Quantum Computing , 1997, SIAM J. Comput..

[18]  Lov K. Grover A framework for fast quantum mechanical algorithms , 1997, STOC '98.

[19]  Erich Schikuta,et al.  Data parallel simulation of self-organizing maps on hypercube architectures. , 1997 .

[20]  Peter W. Shor,et al.  Algorithms for Quantum Computation: Discrete Log and Factoring (Extended Abstract) , 1994, FOCS 1994.

[21]  P. Benioff Quantum mechanical hamiltonian models of turing machines , 1982 .

[22]  J. A. Jones,et al.  Implementation of a quantum algorithm on a nuclear magnetic resonance quantum computer , 1998, quant-ph/9801027.

[23]  S. Hyakin,et al.  Neural Networks: A Comprehensive Foundation , 1994 .

[24]  Stephen Grossberg,et al.  Birth of a learning law , 1998 .

[25]  Joel L. Davis,et al.  An Introduction to Neural and Electronic Networks , 1995 .

[26]  N. Gershenfeld,et al.  Experimental Implementation of Fast Quantum Searching , 1998 .

[27]  Markus Grassl,et al.  Generalized Grover Search Algorithm for Arbitrary Initial Amplitude Distribution , 1998, QCQC.

[28]  Tony R. Martinez,et al.  A Quantum Associative Memory Based on Grover's Algorithm , 1999, ICANNGA.

[29]  Chia-Jiu Wang,et al.  Parallelizing the self-organizing feature map on multiprocessor systems , 1991, Parallel Comput..

[30]  J. Dayho Neural Network Architectures: an Introduction , 1990 .

[31]  Lov K. Grover A fast quantum mechanical algorithm for database search , 1996, STOC '96.

[32]  D. Deutsch Quantum computational networks , 1989, Proceedings of the Royal Society of London. A. Mathematical and Physical Sciences.

[33]  Shun-ichi Amari,et al.  Mathematical foundations of neurocomputing , 1990, Proc. IEEE.

[34]  Peter W. Shor,et al.  Algorithms for quantum computation: discrete logarithms and factoring , 1994, Proceedings 35th Annual Symposium on Foundations of Computer Science.

[35]  Gilles Brassard,et al.  Tight bounds on quantum searching , 1996, quant-ph/9605034.

[36]  Stan Openshaw,et al.  A parallel Kohonen algorithm for the classification of large spatial datasets , 1996 .

[37]  Elizabeth C. Behrman,et al.  A Quantum Dot Neural Network , 1996 .