Fuzzy neural networks(FNN)-based approach for personalized facial expression recognition with novel feature selection method

Facial expression recognition is very important in many human-robot/human-computer interaction systems. Although so many researches are done, it is hard to find a practical applications in the real world due to its underestimate about individual differences among people. Thus, as a solution for such problem, we introduce a 'personalized' facial expression recognition system. Many previous works on facial expression recognition focus on the well-known six universal facial expressions (happy, sad, fear, angry, surprise and disgust) under usage of unified (or non-separated) classification approach. However, for ordinary people, it is a very difficult task to make such facial expressions without much effort and training. Instead of universal facial expressions, many people show 'personalized' or 'individualized' facial expressions typically. Thus, for dealing with such personalities, we propose a method to construct a personalized classifier based on novel feature selection method. Specifically, feature selection is done by histogram-based approach in the frame of fuzzy neural networks(FNN). Besides, we also use an integrated approach for facial expression recognition. Actual experiments/simulations show that the proposed method is effective not only in view of facial expression recognition but also in view of pattern classifier itself.

[1]  Carl F. R. Weiman,et al.  Tracking Algorithms Using Log-Polar Mapped Image Coordinates , 1990, Other Conferences.

[2]  Takeo Kanade,et al.  Recognizing Action Units for Facial Expression Analysis , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Michael J. Lyons,et al.  Coding facial expressions with Gabor wavelets , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[4]  Karin Klabunde,et al.  Service Management For Personalized Services , 1994, Workshop on Intelligent Network.

[5]  T. Kanade,et al.  Color information for region segmentation , 1980 .

[6]  Zhengyou Zhang,et al.  Comparison between geometry-based and Gabor-wavelets-based facial expression recognition using multi-layer perceptron , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[7]  Jukka Saarinen,et al.  Feature selection method using neural network , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[8]  Chung-Lin Huang,et al.  Facial Expression Recognition Using Model-Based Feature Extraction and Action Parameters Classification , 1997, J. Vis. Commun. Image Represent..

[9]  Chin-Teng Lin,et al.  A neural fuzzy control system with structure and parameter learning , 1995 .

[10]  Jun-Hyeong Do,et al.  Soft Computing Based Emotion/Intention Reading for Service Robot , 2002, AFSS.

[11]  Nikhil R. Pal,et al.  Designing Rule-Based Classifiers with On-Line Feature Selection: A Neuro-fuzzy Approach , 2002, AFSS.

[12]  P PentlandAlex,et al.  Coding, Analysis, Interpretation, and Recognition of Facial Expressions , 1997 .

[13]  Alex Pentland,et al.  Coding, Analysis, Interpretation, and Recognition of Facial Expressions , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Z. Zenn Bien,et al.  Classification of Arrhythmia Based on Discrete Wavelet Transform and Rough Set Theory , 2001 .

[15]  Zeungnam Bien,et al.  Fuzzy observer approach to automatic recognition of happiness using facial wrinkle features , 1999, FUZZ-IEEE'99. 1999 IEEE International Fuzzy Systems. Conference Proceedings (Cat. No.99CH36315).

[16]  Brian Scassellati,et al.  A Context-Dependent Attention System for a Social Robot , 1999, IJCAI.

[17]  Maja Pantic,et al.  Automatic Analysis of Facial Expressions: The State of the Art , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Z. Zenn Bien,et al.  Feature Set Extraction Algorithm based on Soft Computing Techniques and Its Application to EMG Pattern Classification , 2002, Fuzzy Optim. Decis. Mak..

[19]  Spyros G. Tzafestas,et al.  Neural fuzzy control systems with structure and parameter learning , 1996, J. Intell. Robotic Syst..

[20]  Donald Geman,et al.  Coarse-to-Fine Visual Selection , 1999 .

[21]  Jongmin Yoon,et al.  Performance comparison of several feature selection methods based on node pruning in handwritten character recognition , 1997, Proceedings of the Fourth International Conference on Document Analysis and Recognition.

[22]  Z. Zenn Bien,et al.  Effective intention reading technique as a means of human-robot interaction for human centered systems , 2001, 10th IEEE International Conference on Fuzzy Systems. (Cat. No.01CH37297).

[23]  Marian Stewart Bartlett,et al.  Classifying Facial Actions , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  김대진,et al.  Image-based personalized facial expression recognition system using fuzzy neural networks = 퍼지 신경망을 이용한 영상 기반 개인화 얼굴 표정 인식 시스템 , 2004 .