Lattice Computing Extension of the FAM Neural Classifier for Human Facial Expression Recognition

This paper proposes a fundamentally novel extension, namely, flrFAM, of the fuzzy ARTMAP (FAM) neural classifier for incremental real-time learning and generalization based on fuzzy lattice reasoning techniques. FAM is enhanced first by a parameter optimization training (sub)phase, and then by a capacity to process partially ordered (non)numeric data including information granules. The interest here focuses on intervals' numbers (INs) data, where an IN represents a distribution of data samples. We describe the proposed flrFAM classifier as a fuzzy neural network that can induce descriptive as well as flexible (i.e., tunable) decision-making knowledge (rules) from the data. We demonstrate the capacity of the flrFAM classifier for human facial expression recognition on benchmark datasets. The novel feature extraction as well as knowledge-representation is based on orthogonal moments. The reported experimental results compare well with the results by alternative classifiers from the literature. The far-reaching potential of fuzzy lattice reasoning in human-machine interaction applications is discussed.

[1]  Athanasios Kehagias.  Some remarks on the lattice of fuzzy intervals , 2011, Inf. Sci..

[2]  Manuel Graña,et al.  A brief review of lattice computing , 2008, 2008 IEEE International Conference on Fuzzy Systems (IEEE World Congress on Computational Intelligence).

[3]  Alex Pentland,et al.  Machine Understanding of Human Behavior , 2007 .

[4]  Khashayar Khorasani,et al.  Facial expression recognition using constructive feedforward neural networks , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[5]  George A. Papakostas,et al.  FUZZY LATTICE REASONING (FLR) CLASSIFIER FOR HUMAN FACIAL EXPRESSION RECOGNITION , 2012 .

[6]  George A. Papakostas,et al.  Novel moment invariants for improved classification performance in computer vision applications , 2010, Pattern Recognit..

[7]  Vassilis G. Kaburlasos,et al.  Binary Image 2D Shape Learning and Recognition Based on Lattice-Computing (LC) Techniques , 2011, Journal of Mathematical Imaging and Vision.

[8]  Skyler T. Hawk,et al.  Presentation and validation of the Radboud Faces Database , 2010 .

[9]  Vassilis G. Kaburlasos.  FINs: lattice theoretic tools for improving prediction of sugar production from populations of measurements , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[10]  Stephen Grossberg,et al.  Fuzzy ART: Fast stable learning and categorization of analog patterns by an adaptive resonance system , 1991, Neural Networks.

[11]  Vassilis G. Kaburlasos,et al.  Granular self-organizing map (grSOM) for structure identification , 2006, Neural Networks.

[12]  Thomas S. Huang,et al.  Facial expression recognition: A clustering-based approach , 2003, Pattern Recognit. Lett..

[13]  Hamed Shah-Hosseini,et al.  A novel fuzzy facial expression recognition system based on facial feature extraction from color face images , 2012, Eng. Appl. Artif. Intell..

[14]  Patrick Shen-Pei Wang,et al.  Performance Comparisons of Facial Expression Recognition in Jaffe Database , 2008, Int. J. Pattern Recognit. Artif. Intell..

[15]  Zahir M. Hussain,et al.  Higher order orthogonal moments for invariant facial expression recognition , 2010, Digit. Signal Process..

[16]  Vassilios Petridis,et al.  Fuzzy Lattice Neurocomputing (FLN) models , 2000, Neural Networks.

[17]  Stephen Grossberg,et al.  A fuzzy ARTMAP nonparametric probability estimator for nonstationary pattern recognition problems , 1995, IEEE Trans. Neural Networks.

[18]  Tom Fawcett,et al.  An introduction to ROC analysis , 2006, Pattern Recognit. Lett..

[19]  Vassilis G. Kaburlasos,et al.  Special issue: Information engineering applications based on lattices , 2011, Inf. Sci..

[20]  Vassilis G. Kaburlasos,et al.  Piecewise-linear approximation of non-linear models based on probabilistically/possibilistically interpreted intervals' numbers (INs) , 2010, Inf. Sci..

[21]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[22]  Xin Yao,et al.  DDD: A New Ensemble Approach for Dealing with Concept Drift , 2012, IEEE Transactions on Knowledge and Data Engineering.

[23]  Y. V. Venkatesh,et al.  Facial expression recognition using radial encoding of local Gabor features and classifier synthesis , 2012, Pattern Recognit..

[24]  Robi Polikar,et al.  Incremental Learning of Concept Drift in Nonstationary Environments , 2011, IEEE Transactions on Neural Networks.

[25]  Stephen Grossberg,et al.  A massively parallel architecture for a self-organizing neural pattern recognition machine , 1988, Comput. Vis. Graph. Image Process..

[26]  Pericles A. Mitkas,et al.  Fuzzy lattice reasoning (FLR) classifier and its application for ambient ozone estimation , 2007, Int. J. Approx. Reason..

[27]  Michael J. Lyons,et al.  Coding facial expressions with Gabor wavelets , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[28]  Danica Kragic,et al.  Motion intention recognition in robot assisted applications , 2008, Robotics Auton. Syst..

[29]  Vassilis G. Kaburlasos.  Adaptive resonance theory with supervised learning and large database applications , 1992 .

[30]  Manuel Graña,et al.  Lattice independent component analysis for functional magnetic resonance imaging , 2011, Inf. Sci..

[31]  Sethuraman Panchanathan,et al.  Optimization-Based Domain Adaptation towards Person-Adaptive Classification Models , 2011, 2011 10th International Conference on Machine Learning and Applications and Workshops.

[32]  Stephen Grossberg,et al.  Fuzzy ARTMAP: A neural network architecture for incremental supervised learning of analog multidimensional maps , 1992, IEEE Trans. Neural Networks.

[33]  Esma Aïmeur,et al.  Activity recognition using eye-gaze movements and traditional interactions , 2011, Interact. Comput..

[34]  Zakia Hammal,et al.  Pain monitoring: A dynamic and context-sensitive system , 2012, Pattern Recognit..

[35]  Surendra Ranganath,et al.  Facial expressions in American sign language: Tracking and recognition , 2012, Pattern Recognit..

[36]  Wanqing Li,et al.  A Real-Time Facial Expression Recognition System for Online Games , 2008, Int. J. Comput. Games Technol..

[37]  Maja Pantic,et al.  Meta-Analysis of the First Facial Expression Recognition Challenge , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[38]  Vassilis G. Kaburlasos,et al.  A Lattice-Computing ensemble for reasoning based on formal fusion of disparate data types, and an industrial dispensing application , 2014, Inf. Fusion.

[39]  Peter Sussner,et al.  Morphological perceptrons with competitive learning: Lattice-theoretical framework and constructive learning algorithm , 2011, Inf. Sci..

[40]  Alex Pentland,et al.  Human-Centred Intelligent Human-Computer Interaction (HCI2): how far are we from attaining it? , 2008, Int. J. Auton. Adapt. Commun. Syst..

[41]  Athanasios Kehagias,et al.  Novel Fuzzy Inference System (FIS) Analysis and Design Based on Lattice Theory , 2007, IEEE Transactions on Fuzzy Systems.

[42]  Vassilis G. Kaburlasos,et al.  A granular extension of the fuzzy-ARTMAP (FAM) neural classifier based on fuzzy lattice reasoning (FLR) , 2009, Neurocomputing.

[43]  Fadi Dornaika,et al.  Improving dynamic facial expression recognition with feature subset selection , 2011, Pattern Recognit. Lett..

[44]  Dimitris E. Koulouriotis,et al.  A unified methodology for the efficient computation of discrete orthogonal image moments , 2009, Inf. Sci..

[45]  Jerry M. Mendel,et al.  Type-2 fuzzy sets and systems: an overview , 2007, IEEE Computational Intelligence Magazine.

[46]  Manuel Graña.  Lattice computing and natural computing , 2009, Neurocomputing.

[47]  Plamen P. Angelov,et al.  Real-time human activity recognition from wireless sensors using evolving fuzzy systems , 2010, International Conference on Fuzzy Systems.