Explicit Magnification Control of Self-Organizing Maps for “Forbidden” Data

In this paper, we examine the scope of validity of the explicit self-organizing map (SOM) magnification control scheme of Bauer (1996) on data for which the theory does not guarantee success, namely data that are n-dimensional, nges2, and whose components in the different dimensions are not statistically independent. The Bauer algorithm is very attractive for the possibility of faithful representation of the probability density function (pdf) of a data manifold, or for discovery of rare events, among other properties. Since theoretically unsupported data of higher dimensionality and higher complexity would benefit most from the power of explicit magnification control, we conduct systematic simulations on "forbidden" data. For the unsupported n=2 cases that we investigate, the simulations show that even though the magnification exponent alphaachieved achieved by magnification control is not the same as the desired alphadesired, alphaachieved systematically follows alphadesired with a slowly increasing positive offset. We show that for simple synthetic higher dimensional data information, theoretically optimum pdf matching (alphaachieved=1) can be achieved, and that negative magnification has the desired effect of improving the detectability of rare classes. In addition, we further study theoretically unsupported cases with real data

[1]  Thomas Martinetz,et al.  'Neural-gas' network for vector quantization and its application to time-series prediction , 1993, IEEE Trans. Neural Networks.

[2]  Thomas Villmann,et al.  Magnification Control in Self-Organizing Maps and Neural Gas , 2006, Neural Computation.

[3]  Stanley C. Ahalt,et al.  Competitive learning algorithms for vector quantization , 1990, Neural Networks.

[4]  Erzsébet Merényi,et al.  Forbidden magnification? II , 2004, ESANN.

[5]  Jouko Lampinen,et al.  On the generative probability density model in the self-organizing map , 2002, Neurocomputing.

[6]  Thomas Villmann,et al.  Neural maps in remote sensing image analysis , 2003, Neural Networks.

[7]  David W. Scott,et al.  Multivariate Density Estimation: Theory, Practice, and Visualization , 1992, Wiley Series in Probability and Statistics.

[8]  K. Schulten,et al.  On the stationary state of Kohonen's self-organizing sensory mapping , 2004, Biological Cybernetics.

[9]  Duane DeSieno,et al.  Adding a conscience to competitive learning , 1988, IEEE 1988 International Conference on Neural Networks.

[10]  Ralf Der,et al.  Controlling the Magnification Factor of Self-Organizing Feature Maps , 1996, Neural Computation.

[11]  Dominik R. Dersch,et al.  Asymptotic level density in topological feature maps , 1995, IEEE Trans. Neural Networks.

[12]  Teuvo Kohonen,et al.  Self-organization and associative memory: 3rd edition , 1989 .

[13]  Timo Kostiainen,et al.  Generative probability density model in the self-organizing map , 2001 .

[14]  D. W. Scott,et al.  Multivariate Density Estimation, Theory, Practice and Visualization , 1992 .

[15]  Teuvo Kohonen,et al.  Self-Organizing Maps , 2010 .

[16]  Thomas Villmann,et al.  Topology preservation in self-organizing feature maps: exact definition and measurement , 1997, IEEE Trans. Neural Networks.

[17]  Abha Jain.  Issues related to data mining with self organizing maps , 2004 .

[18]  Helge Ritter.  Asymptotic level density for a class of vector quantization processes , 1991, IEEE Trans. Neural Networks.

[19]  Teuvo Kohonen,et al.  Comparison of SOM Point Densities Based on Different Criteria , 1999, Neural Computation.

[20]  T. Heskes.  Energy functions for self-organizing maps , 1999 .

[21]  Erzsébet Merényi,et al.  Applications of SOM magnification to data mining , 2004 .

[22]  Erzsébet Merényi,et al.  Forbidden Magnification? I , 2004, ESANN.

[23]  Klaus Pawelzik,et al.  Quantifying the neighborhood preservation of self-organizing feature maps , 1992, IEEE Trans. Neural Networks.

[24]  Thomas Villmann,et al.  Growing a hypercubical output space in a self-organizing feature map , 1997, IEEE Trans. Neural Networks.

[25]  Paul L. Zador,et al.  Asymptotic quantization error of continuous signals and the quantization dimension , 1982, IEEE Trans. Inf. Theory.