A new facial expression recognition based on curvelet transform and online sequential extreme learning machine initialized with spherical clustering

In this paper, a novel algorithm is proposed for facial expression recognition by integrating curvelet transform and online sequential extreme learning machine (OSELM) with radial basis function (RBF) hidden node having optimal network architecture. In the proposed algorithm, the curvelet transform is firstly applied to each region of the face image divided into local regions instead of whole face image to reduce the curvelet coefficients too huge to classify. Feature set is then generated by calculating the entropy, the standard deviation and the mean of curvelet coefficients of each region. Finally, spherical clustering (SC) method is employed to the feature set to automatically determine the optimal hidden node number and RBF hidden node parameters of OSELM by aim of increasing classification accuracy and reducing the required time to select the hidden node number. So, the learning machine is called as OSELM-SC. It is constructed two groups of experiments: The aim of the first one is to evaluate the classification performance of OSELM-SC on the benchmark datasets, i.e., image segment, satellite image and DNA. The second one is to test the performance of the proposed facial expression recognition algorithm on the Japanese Female Facial Expression database and the Cohn-Kanade database. The obtained experimental results are compared against the state-of-the-art methods. The results demonstrate that the proposed algorithm can produce effective facial expression features and exhibit good recognition accuracy and robustness.

[1]  Shaogang Gong,et al.  Facial expression recognition based on Local Binary Patterns: A comprehensive study , 2009, Image Vis. Comput..

[2]  Huan-Long Zhang,et al.  Comparative study of dimension reduction and recognition algorithms of DCT and 2DPCA , 2008, 2008 International Conference on Machine Learning and Cybernetics.

[3]  A. Uçar,et al.  Color Face Recognition Based on Curvelet Transform Ayşegül UÇAR , 2012 .

[4]  Bin Shen,et al.  Automatic coefficient selection in Weighted Maximum Margin Criterion , 2008, 2008 19th International Conference on Pattern Recognition.

[5]  John D. Austin,et al.  Adaptive histogram equalization and its variations , 1987 .

[6]  Min Liu,et al.  A new online learning algorithm for structure-adjustable extreme learning machine , 2010, Comput. Math. Appl..

[7]  Takeo Kanade,et al.  Comprehensive database for facial expression analysis , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[8]  Nicu Sebe,et al.  Facial expression recognition from video sequences: temporal and static modeling , 2003, Comput. Vis. Image Underst..

[9]  Yajie Tian,et al.  Handbook of face recognition , 2003 .

[10]  Simon Haykin,et al.  Neural Networks and Learning Machines , 2010 .

[11]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[12]  Anastasios Tefas,et al.  Salient feature and reliable classifier selection for facial expression classification , 2010, Pattern Recognit..

[13]  Narasimhan Sundararajan,et al.  An efficient sequential learning algorithm for growing and pruning RBF (GAP-RBF) networks , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[14]  Yo Horikawa,et al.  Facial Expression Recognition using KCCA with Combining Correlation Kernels and Kansei Information , 2007, 2007 International Conference on Computational Science and its Applications (ICCSA 2007).

[15]  Yakup Demir,et al.  Modelling and simulation with neural and fuzzy‐neural networks of switched circuits , 2003 .

[16]  Turk J Elec Eng Behavior learning of a memristor-based chaotic circuit by extreme learning machines , 2016 .

[17]  Cüneyt Güzelis,et al.  A New Formulation for Classification by Ellipsoids , 2005, TAINN.

[18]  Anil K. Jain,et al.  Combining classifiers for face recognition , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).

[19]  Minh N. Do,et al.  The finite ridgelet transform for image representation , 2003, IEEE Trans. Image Process..

[20]  H. Sallam,et al.  Toward a Fuzzy Astrophysics Research Resources (FARR) , 2007 .

[21]  Narasimhan Sundararajan,et al.  A Fast and Accurate Online Sequential Learning Algorithm for Feedforward Networks , 2006, IEEE Transactions on Neural Networks.

[22]  Q. M. Jonathan Wu,et al.  Human face recognition based on multidimensional PCA and extreme learning machine , 2011, Pattern Recognit..

[23]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[24]  Siu-Yeung Cho,et al.  A face emotion tree structure representation with probabilistic recursive neural network modeling , 2010, Neural Computing and Applications.

[25]  Michael J. Lyons,et al.  Automatic Classification of Single Facial Images , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  Masahide Kaneko,et al.  Facial Expression Recognition Using Facial-component-based Bag of Words and PHOG Descriptors , 2010 .

[27]  Laurent Demanet,et al.  Fast Discrete Curvelet Transforms , 2006, Multiscale Model. Simul..

[28]  E. Candès,et al.  Curvelets: A Surprisingly Effective Nonadaptive Representation for Objects with Edges , 2000 .

[29]  Chee Peng Lim,et al.  A Hybrid Art-grnn Online Learning Neural Network with a -insensitive Loss Function , 2022 .

[30]  Yakup Demir,et al.  A penalty function method for designing efficient robust classifiers with input space optimal separating surfaces , 2014 .

[31]  Yuan Lan,et al.  Ensemble of online sequential extreme learning machine , 2009, Neurocomputing.

[32]  Michael J. Lyons,et al.  Coding facial expressions with Gabor wavelets , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[33]  Y Lu,et al.  A Sequential Learning Scheme for Function Approximation Using Minimal Radial Basis Function Neural Networks , 1997, Neural Computation.

[34]  Chee Kheong Siew,et al.  Extreme learning machine: Theory and applications , 2006, Neurocomputing.

[35]  Q. M. Jonathan Wu,et al.  Curvelet based face recognition via dimension reduction , 2009, Signal Process..

[36]  Kwontaeg Choi,et al.  Incremental face recognition for large-scale social network services , 2012, Pattern Recognit..

[37]  Qiang Ji,et al.  Facial expression understanding in image sequences using dynamic and active visual information fusion , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[38]  Y. V. Venkatesh,et al.  Facial expression recognition using radial encoding of local Gabor features and classifier synthesis , 2012, Pattern Recognit..

[39]  Ayşegül UÇAR Facial Expression Recognition Based on Significant Face Components Using Steerable Pyramid Transform Ayşegül UÇAR , 2013 .

[40]  Zahir M. Hussain,et al.  Higher order orthogonal moments for invariant facial expression recognition , 2010, Digit. Signal Process..

[41]  Peter W. McOwan,et al.  A real-time automated system for the recognition of human facial expressions , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[42]  Thomas S. Huang,et al.  Capturing subtle facial motions in 3D face tracking , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[43]  Paramasivan Saratchandran,et al.  Performance evaluation of a sequential minimal radial basis function (RBF) neural network learning algorithm , 1998, IEEE Trans. Neural Networks.

[44]  Marian Stewart Bartlett,et al.  Classifying Facial Actions , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[45]  Dian Tjondronegoro,et al.  Facial Expression Recognition Using Facial Movement Features , 2011, IEEE Transactions on Affective Computing.

[46]  Takeo Kanade,et al.  Recognizing Action Units for Facial Expression Analysis , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[47]  Ayşegül Uçar,et al.  Color Face Recognition Based on Steerable Pyramid Transform and Extreme Learning Machines , 2014, TheScientificWorldJournal.

[48]  Yo Horikawa Facial Expression Recognition using KCCA with Combining Correlation Kernels and Kansei Information , 2007 .

[49]  John C. Platt A Resource-Allocating Network for Function Interpolation , 1991, Neural Computation.

[50]  P. Ekman,et al.  Constants across cultures in the face and emotion. , 1971, Journal of personality and social psychology.