Facial Expression Recognition using KCCA with Combining Correlation Kernels and Kansei Information

Kernel canonical correlation analysis (kCCA) with combining correlation kernels of multiple-orders and Kansei information is applied to facial expression recognition. Any explicit feature extraction is done and spatial correlation features of image data are implicitly incorporated in the correlation kernels. Further, Kansei information is included as the second feature in kCCA. Classification experiments with JAFFE database show that, although the use of Kansei information in itself gives lower classification performance than class indicators optimal for classification tasks, combining Kansei information with them makes the classification performance higher than the only use of the indicators.

[1]  Matti Pietikäinen,et al.  A Coarse-to-Fine Classification Scheme for Facial Expression Recognition , 2004, ICIAR.

[2]  Shu Liao,et al.  Facial Expression Recognition using Advanced Local Binary Patterns, Tsallis Entropies and Global Appearance Features , 2006, 2006 International Conference on Image Processing.

[3]  Jean-Philippe Thiran,et al.  Higher order autocorrelations for pattern classification , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[4]  Beat Fasel,et al.  Automati Fa ial Expression Analysis: A Survey , 1999 .

[5]  Toshikazu Kato,et al.  Learning of personal visual impression for image database systems , 1993, Proceedings of 2nd International Conference on Document Analysis and Recognition (ICDAR '93).

[6]  Horst Bischof,et al.  Appearance models based on kernel canonical correlation analysis , 2003, Pattern Recognit..

[7]  Jiri Matas,et al.  On Combining Classifiers , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Shotaro Akaho,et al.  A kernel method for canonical correlation analysis , 2006, ArXiv.

[9]  Pedro E. López-de-Teruel,et al.  Nonlinear kernel-based statistical pattern analysis , 2001, IEEE Trans. Neural Networks.

[10]  Michael J. Lyons,et al.  Automatic Classification of Single Facial Images , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Y. Horikawa,et al.  Modification of correlation kernels in SVM, KPCA and KCCA in texture classification , 2005, Proceedings. 2005 IEEE International Joint Conference on Neural Networks, 2005..

[12]  Yo Horikawa,et al.  Comparison of Combining Methods of Correlation Kernels in kPCA and kCCA for Texture Classification with Kansei Information , 2007, SCIA.

[13]  W. Zheng,et al.  Facial expression recognition using kernel canonical correlation analysis (KCCA) , 2006, IEEE Transactions on Neural Networks.

[14]  C. Chibelushi,et al.  Facial Expression Recognition : A Brief Tutorial Overview , 2022 .

[15]  Yo Horikawa,et al.  Use of Autocorrelation Kernels in Kernel Canonical Correlation Analysis for Texture Classification , 2004, ICONIP.

[16]  Nobuyuki Otsu,et al.  Facial expression recognition using Fisher weight maps , 2004, Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings..

[17]  Malte Kuss,et al.  The Geometry Of Kernel Canonical Correlation Analysis , 2003 .

[18]  Gunnar Rätsch,et al.  An introduction to kernel-based learning algorithms , 2001, IEEE Trans. Neural Networks.

[19]  Bernhard Schölkopf,et al.  Nonlinear Component Analysis as a Kernel Eigenvalue Problem , 1998, Neural Computation.

[20]  Maja Pantic,et al.  Automatic Analysis of Facial Expressions: The State of the Art , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  Michael I. Jordan,et al.  Kernel independent component analysis , 2003 .

[22]  Y. Horikawa Comparison of support vector machines with autocorrelation kernels for invariant texture classification , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[23]  John A. McLaughlin,et al.  Nth-Order Autocorrelations in Pattern Recognition , 1968, Inf. Control..

[24]  Jean-Philippe Thiran,et al.  Pattern recognition using higher-order local autocorrelation coefficients , 2004, Pattern Recognit. Lett..

[25]  Colin Fyfe,et al.  Kernel and Nonlinear Canonical Correlation Analysis , 2000, IJCNN.