Parallel Realizations of the SAMANN Algorithm

Sammon's mapping is a well-known procedure for mapping data from a higher-dimensional space onto a lower-dimensional one. But the original algorithm has a disadvantage. It lacks generalization, which means that new points cannot be added to the obtained map without recalculating it. The SAMANN neural network, that realizes Sammon's algorithm, provides a generalization capability of projecting new data. A drawback of using SAMANN is that the training process is extremely slow. One of the ways of speeding up the neural network training process is to use parallel computing. In this paper, we proposed some parallel realizations of the SAMANN.

[1]  Anil K. Jain,et al.  Algorithms for Clustering Data , 1988 .

[2]  R. Fisher THE USE OF MULTIPLE MEASUREMENTS IN TAXONOMIC PROBLEMS , 1936 .

[3]  P. Groenen,et al.  Modern Multidimensional Scaling: Theory and Applications , 1999 .

[4]  Robert P. W. Duin,et al.  STATISTICAL PATTERN RECOGNITION , 2005 .

[5]  Ronald H. Perrott,et al.  Parallel programming , 1988, International computer science series.

[6]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[7]  John W. Sammon,et al.  A Nonlinear Mapping for Data Structure Analysis , 1969, IEEE Transactions on Computers.

[8]  Anil K. Jain,et al.  Statistical Pattern Recognition: A Review , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Anil K. Jain,et al.  Artificial neural networks for feature extraction and multivariate data projection , 1995, IEEE Trans. Neural Networks.

[10]  Anil K. Jain,et al.  Artificial neural network for nonlinear projection of multivariate data , 1992, [Proceedings 1992] IJCNN International Joint Conference on Neural Networks.

[11]  P. Groenen,et al.  Modern multidimensional scaling , 1996 .

[12]  L. Ridgway Scott,et al.  Scientific Parallel Computing , 2005 .

[13]  Robert P. W. Duin,et al.  Sammon's mapping using neural networks: A comparison , 1997, Pattern Recognit. Lett..

[14]  Gintautas Dzemyda,et al.  Optimization of the Local Search in the Training for SAMANN Neural Network , 2006, J. Glob. Optim..

[15]  Terrence J. Sejnowski,et al.  Analysis of hidden units in a layered network trained to classify sonar targets , 1988, Neural Networks.