Funtional vector quantization by neural maps

We propose the utilization of Sobolev-norms in unsupervised and supervised vector quantization for clustering and classification of functional data. Sobolev-norms differ from the usual Minkowski-norm by the incorporation of derivatives such that the functional shape is taken into account. This leads to a more appropriate modelling of functional data. As we figure out, the Sobolev-norm can easily plugged into prototype based adaptive vector quantization algorithms to process functional data adequately. We show for an example application in remote sensing data analysis that this methodology may lead to improved performance of the algorithms.

[1]  T. Villmann.  Sobolev Metrics for Learning of Functional Data-Mathematical and Theoretical Aspects Report 03 / 2007 , 2007 .

[2]  David A. Landgrebe,et al.  Signal Theory Methods in Multispectral Remote Sensing , 2003 .

[3]  M. Verleysen,et al.  Generalisation of the LP norm for time series and its application to Self-Organizing Maps , 2005 .

[4]  Thomas Villmann,et al.  Functional Principal Component Learning Using Oja's Method and Sobolev Norms , 2009, WSOM.

[5]  Leonid Kantorovich,et al.  Funktionalanalysis in normierten Räumen , 1978 .

[6]  Atsushi Sato,et al.  Generalized Learning Vector Quantization , 1995, NIPS.

[7]  Thomas Villmann,et al.  Relevance LVQ versus SVM , 2004, ICAISC.

[8]  Fabrice Rossi,et al.  Clustering functional data with the SOM algorithm , 2004, ESANN.

[9]  Hans-Georg Müller,et al.  Functional Data Analysis , 2016 .

[10]  B. Silverman,et al.  Smoothed functional principal components analysis by choice of norm , 1996 .

[11]  Thomas Villmann,et al.  On the Generalization Ability of GRLVQ Networks , 2005, Neural Processing Letters.

[12]  S. V. Fomin,et al.  Reelle Funktionen und Funktionalanalysis , 1975 .

[13]  Thomas Martinetz,et al.  'Neural-gas' network for vector quantization and its application to time-series prediction , 1993, IEEE Trans. Neural Networks.

[14]  Thomas Villmann,et al.  Neural maps in remote sensing image analysis , 2003, Neural Networks.

[15]  Thomas Villmann,et al.  Fuzzy classification by fuzzy labeled neural gas , 2006, Neural Networks.

[16]  Teuvo Kohonen,et al.  Self-Organizing Maps , 2010 .