Fuzzy case-based reasoning for facial expression recognition

Fuzzy logic (FL) and case-based reasoning (CBR) are two well-known techniques for the implementation of intelligent classification systems. Each technique has its own advantages and drawbacks. FL, for example, provides an intuitive user interface, simplifies the process of knowledge representation, and minimizes the system's computational complexity in terms of time and memory usage. On the other hand, FL has problems in knowledge elicitation which render it difficult to adopt for intelligent system implementation. CBR avoids these problems by making use of past input-output data to decide the system output for the present input. The accuracy of CBR system grows as the number of cases increase. However, more cases can mean added computational complexity in terms of space and time. In this paper we make the proposition that a hybrid system comprising a blend of FL and CBR can lead to a solution where the two approaches cover each other's weaknesses and benefit from each other's strengths. We support our claim by taking the problem of facial expression recognition from an input image. The facial expression recognition system presented in this paper uses a case base populated with fuzzy rules for recognizing each expression. Experimental results demonstrate that the system inherits the strengths of both methods.

[1]  Yutaka Hata,et al.  Computer-Aided Diagnosis of Intracranial Aneurysms in MRA Images with Case-Based Reasoning , 2006, IEICE Trans. Inf. Syst..

[2]  Michela Bertolotto,et al.  Capturing and Reusing Case-Based Context for Image Retrieval , 2005, IJCAI.

[3]  P. Ekman.  Facial expression and emotion. , 1993, The American psychologist.

[4]  Fumio Hara,et al.  Recognition of Mixed Facial Expressions by Neural Network. , 1993 .

[5]  A. Murat Tekalp,et al.  Face and 2-D mesh animation in MPEG-4 , 2000, Signal Process. Image Commun..

[6]  Paul Wintz,et al.  Digital image processing (2nd ed.) , 1987 .

[7]  Jonathan E. Hunter,et al.  Human motion segmentation and object recognition using fuzzy rules , 2005, ROMAN 2005. IEEE International Workshop on Robot and Human Interactive Communication, 2005..

[8]  Muid Mufti,et al.  Intelligent Expression Blending for Performance Driven Facial Animation , 2007, IEEE Transactions on Consumer Electronics.

[9]  A. Katoh,et al.  Classification of facial expressions using self-organizing maps , 1998, Proceedings of the 20th Annual International Conference of the IEEE Engineering in Medicine and Biology Society. Vol.20 Biomedical Engineering Towards the Year 2000 and Beyond (Cat. No.98CH36286).

[10]  Barry Smyth,et al.  Advances in Case-Based Reasoning , 1996, Lecture Notes in Computer Science.

[11]  Tom Fawcett,et al.  ROC Graphs: Notes and Practical Considerations for Researchers , 2007 .

[12]  Gwen Littlewort,et al.  Recognizing facial expression: machine learning and application to spontaneous behavior , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[13]  P. Gader,et al.  Advances in fuzzy integration for pattern recognition , 1994, CVPR 1994.

[14]  Muhammad Zubair Shafiq,et al.  CBR: Fuzzified case retrieval approach for facial expression recognition , 2007, Artificial Intelligence and Applications.

[15]  Agnar Aamodt,et al.  A Two Layer Case-Based Reasoning Architecture for Medical Image Understanding , 1996, EWCBR.

[16]  D. Rutter,et al.  The Role of Visual Communication in Social Exchange , 1976 .

[17]  Maja Pantic,et al.  Automatic Analysis of Facial Expressions: The State of the Art , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  T. Takagi,et al.  Recognition of facial expressions using conceptual fuzzy sets , 1993, [Proceedings 1993] Second IEEE International Conference on Fuzzy Systems.

[19]  Gerold Porenta,et al.  Feasibility analysis of a case-based reasoning system for automated detection of coronary heart disease from myocardial scintigrams , 1997, Artif. Intell. Medicine.

[20]  Alessandro Neri,et al.  A Case-Based Approach to Image Recognition , 2000, EWCBR.

[21]  Marinette Revenu,et al.  CBR for the Reuse of Image Processing Knowledge: A Recursive Retrieval/ Adaptation , 1999, ICCBR.

[22]  P. Ekman,et al.  Strong evidence for universals in facial expressions: a reply to Russell's mistaken critique. , 1994, Psychological bulletin.

[23]  Jacek Jarmulak,et al.  Case-Based Classification of Ultrasonic B-Scans: Case-Base Organisation and Case Retrieval , 1998, EWCBR.

[24]  Yangsheng Wang,et al.  Real-time facial expression recognition in the interactive game based on embedded hidden Markov model , 2004 .

[25]  Michael M. Richter,et al.  Image processing in case-based reasoning , 2005, Knowl. Eng. Rev..

[26]  David Leake,et al.  Case-Based Reasoning: Experiences, Lessons and Future Directions , 1996 .

[27]  Michela Bertolotto,et al.  A Case-Based Approach to Managing Geo-spatial Imagery Tasks , 2004, ECCBR.

[28]  Z. Zenn Bien,et al.  Fuzzy neural networks(FNN)-based approach for personalized facial expression recognition with novel feature selection method , 2003, The 12th IEEE International Conference on Fuzzy Systems, 2003. FUZZ '03..

[29]  A. Anderson,et al.  The Effects of Visibility on Dialogue and Performance in a Cooperative Problem Solving Task , 1994 .

[30]  M. Zubair Shafiq,et al.  A 'Personalized' Facial Expression Recognition System using Case Based Reasoning , 2006, 2006 International Conference on Emerging Technologies.

[31]  Piero P. Bonissone,et al.  Similarity Measures for Case-Based Reasoning Systems , 1992, IPMU.

[32]  Muhammad Zubair Shafiq,et al.  Facial Expression Recognition System using Case Based Reasoning , 2006, 2006 International Conference on Advances in Space Technologies.

[33]  Fumio Hara,et al.  The recognition of basic facial expressions by neural network , 1991, [Proceedings] 1991 IEEE International Joint Conference on Neural Networks.

[34]  Rosina O. Weber.  Fuzzy set theory and uncertainty in case-based reasoning , 2006 .

[35]  Lisa M. Brown,et al.  Real World Real-time Automatic Recognition of Facial Expressions , 2003 .

[36]  Carlo Drioli,et al.  Emotions and voice quality: experiments with sinusoidal modeling , 2003 .

[37]  P. Perona,et al.  Automatic Extraction of Facial Action Codes , 2001 .

[38]  Piero P. Bonissone,et al.  Fuzzy case-based reasoning for residential property valuation , 1998 .

[39]  Muid Mufti,et al.  Fuzzy Rule Based Facial Expression Recognition , 2006, 2006 International Conference on Computational Inteligence for Modelling Control and Automation and International Conference on Intelligent Agents Web Technologies and International Commerce (CIMCA'06).

[40]  Luc Lamontagne,et al.  Case-Based Reasoning Research and Development , 1997, Lecture Notes in Computer Science.

[41]  R.N. Dave.  Boundary detection through fuzzy clustering , 1992, [1992 Proceedings] IEEE International Conference on Fuzzy Systems.

[42]  Diane J. Schiano,et al.  Face to interface: facial affect in (hu)man and machine , 2000, CHI.

[43]  Robert T. Macura,et al.  MacRad: Radiology Image Resource with a Case-Based Retrieval System , 1995, ICCBR.

[44]  Nadia Magnenat-Thalmann,et al.  MULTIMODAL ANIMATION SYSTEM BASED ON THE MPEG-4 STANDARD , 1999 .

[45]  Simon C. K. Shiu,et al.  Soft case-based reasoning , 2005, Knowl. Eng. Rev..

[46]  Yangsheng Wang,et al.  Real-time facial expression recognition in the interactive game based on embedded hidden Markov model , 2004, Proceedings. International Conference on Computer Graphics, Imaging and Visualization, 2004. CGIV 2004..

[47]  Agnar Aamodt,et al.  Case-Based Reasoning: Foundational Issues, Methodological Variations, and System Approaches , 1994, AI Commun..

[48]  E. Morales,et al.  Automatic Feature Construction and a Simple Rule Induction Algorithm for Skin Detection , 2002 .

[49]  James A. Russell,et al.  Anger and Disgust: Discrete or Overlapping Categories? , 2004 .