Analysis of Robust Soft Learning Vector Quantization and an application to Facial Expression Recognition

Learning Vector Quantization (LVQ) is a popular method for multiclass classification. Several variants of LVQ have been developed recently, of which Robust Soft Learning Vector Quantization (RSLVQ) is a promising one. Although LVQ methods have an intuitive design with clear updating rules, their dynamics are not yet well understood. In simulations within a controlled environment RSLVQ performed very close to optimal. This controlled environment enabled us to perform a mathematical analysis as a first step in obtaining a better theoretical understanding of the learning dynamics. In this talk I will discuss the theoretical analysis and its results. Moreover, I will focus on the practical application of RSLVQ to a real world dataset containing extracted features from facial expression data.

[1]  Teuvo Kohonen,et al.  Self-Organizing Maps , 2010 .

[2]  Teuvo Kohonen,et al.  Improved versions of learning vector quantization , 1990, 1990 IJCNN International Joint Conference on Neural Networks.

[3]  Teuvo Kohonen,et al.  Learning vector quantization , 1998 .

[4]  Klaus Obermayer,et al.  Soft Learning Vector Quantization , 2003, Neural Computation.

[5]  Klaus Obermayer,et al.  Soft nearest prototype classification , 2003, IEEE Trans. Neural Networks.

[6]  Michael Biehl,et al.  Dynamics and Generalization Ability of LVQ Algorithms , 2007, J. Mach. Learn. Res..

[7]  Michael Biehl,et al.  Dynamical analysis of LVQ type learning rules , 2005 .

[8]  Takeo Kanade,et al.  Comprehensive database for facial expression analysis , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[9]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[10]  Caifeng Shan,et al.  Local features based facial expression recognition with face registration errors , 2008, 2008 8th IEEE International Conference on Automatic Face & Gesture Recognition.

[11]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Atsushi Sato,et al.  Generalized Learning Vector Quantization , 1995, NIPS.