A New Feature Extraction Technique for Human Facial Expression Recognition Systems Using Depth Camera

The analysis of facial expressions in telemedicine and healthcare plays a significant role in providing sufficient information about patients like stroke and cardiac in monitoring their expressions for better management of their diseases. Due to some privacy concerns, depth camera is a good candidate in such domains over RGB camera for facial expression recognition (FER). The accuracy of such FER systems are completely reliant on the extraction of the informative features. In this work, we have tested and validated the accuracy of a new feature extraction method based on symlet wavelet transform. In this method, the human face is divided into number of regions and in each region the movement of pixels have been traced in order to create the feature vectors. Each expression frame is decomposed up to 4 levels. In each decomposition level, the distance between the two corresponding pixels is found by using the distance formula in order to extract the most informative coefficients. After feature vector creation, Linear Discriminant Analysis (LDA) has been employed to reduce the dimensions of the feature space. Lastly, Hidden Markov Model (HMM) has been exploited for expression recognition. Most of the previous FER systems used existing available standard datasets and all the datasets were pose-based datasets. Therefore, we have collected our own depth data of 15 subjects by employing the dept camera. For the whole experiments, 10-fold cross validation scheme was utilized for the experiments. The proposed technique showed a significant improvement in accuracy against the existing works.

[1]  Stan Z. Li,et al.  Learning spatially localized, parts-based representation , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[2]  Agus Harjoko,et al.  A Neural Network based Facial Expression Recognition using Fisherface , 2012 .

[3]  Ferdinando Silvestro Samaria,et al.  Face recognition using Hidden Markov Models , 1995 .

[4]  Y. V. Venkatesh,et al.  Facial expression recognition using radial encoding of local Gabor features and classifier synthesis , 2012, Pattern Recognit..

[5]  Senthil Ragavan Valayapalayam Kittusamy,et al.  Facial Expressions Recognition Using Eigenspaces , 2012 .

[6]  Jukka Turunen,et al.  A wavelet-based method for estimating damping in power systems , 2011 .

[7]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[8]  Mahesh M. Goyani,et al.  A literature survey on Facial Expression Recognition using Global Features , 2013 .

[9]  Karen Das,et al.  Recognition of Facial Expression Using Eigenvector Based Distributed Features and Euclidean Distance Based Decision Making Technique , 2013, ArXiv.

[10]  Ioannis Pitas,et al.  Application of non-negative and local non negative matrix factorization to facial expression recognition , 2004, ICPR 2004.

[11]  Xuelong Li,et al.  Iterative Subspace Analysis Based on Feature Line Distance , 2009, IEEE Trans. Image Process..

[12]  Sungyoung Lee,et al.  A robust feature extraction method for human facial expressions recognition systems , 2012, IVCNZ '12.

[13]  Gwen Littlewort,et al.  Learning spatiotemporal features by using independent component analysis with application to facial expression recognition , 2012, Neurocomputing.

[14]  Putra Sumari,et al.  Privacy Issues in Pervasive Healthcare Monitoring System: A Review , 2010 .

[15]  Shaogang Gong,et al.  Facial expression recognition based on Local Binary Patterns: A comprehensive study , 2009, Image Vis. Comput..