Facial Expression Recognition in Image Sequences Using 1D Transform and Gabor Wavelet Transform

Magnifying emotions recognition from facial expression is highly demanded in several applications domains such as security, education, psychology, medical diagnosis, marketing and business negotiations. For the growth and productivity of these domains, researchers are keenly involved in improving the effectiveness of facial expression recognition (FER) systems. However, they still lack potency in terms of recognition accuracy, inter-subject facial variations and appearance complexity. This paper attempts to improve recognition accuracy by employing Radon transform and Gabor wavelet transform along with robust classifiers. Facial detection is examined by oval parameters approach and facial tracking is achieved using vertex mask generation. Radon transform and Gabor transform filters have been applied to extract variable features. Finally, self-organized maps and neural network are used as recognizer engine to measure six basic facial expressions. Unlike conventional results that were evaluated using a single dataset, our experimental results have shown state-of-the-art accuracy of 86 and 83.7 percent over two public datasets as Cohn-Kanade and AT&T datasets respectively.

[1]  Daijin Kim,et al.  Depth map-based human activity tracking and recognition using body joints features and Self-Organized Map , 2014, Fifth International Conference on Computing, Communications and Networking Technologies (ICCCNT).

[2]  Mian Ahmad Zeb,et al.  Security and QoS Optimization for Distributed Real Time Environment , 2007, 7th IEEE International Conference on Computer and Information Technology (CIT 2007).

[3]  Lihong Zheng,et al.  Facial expression recognition using hybrid features and self-organizing maps , 2017, 2017 IEEE International Conference on Multimedia and Expo (ICME).

[4]  Daijin Kim,et al.  A Depth Video Sensor-Based Life-Logging Human Activity Recognition System for Elderly Care in Smart Indoor Environments , 2014, Sensors.

[5]  A. Jalal,et al.  Security Architecture for Third Generation (3G) using GMHS Cellular Network , 2007, 2007 International Conference on Emerging Technologies.

[6]  Daijin Kim,et al.  Depth Images-based Human Detection, Tracking and Activity Recognition Using Spatiotemporal Features and Modified HMM , 2016 .

[7]  Ahmad Jalal,et al.  Collaboration Achievement along with Performance Maintenance in Video Streaming , 2007 .

[8]  Yi-Ping Hung,et al.  Illumination Compensation Using Oriented Local Histogram Equalization and its Application to Face Recognition , 2012, IEEE Transactions on Image Processing.

[9]  Wu Jiying,et al.  A discriminant manifold non-negative matrix factorization algorithm for facial expression recognition , 2016, 2016 IEEE 13th International Conference on Signal Processing (ICSP).

[10]  Wei-Yang Lin,et al.  Automatic facial expression recognition for affective computing based on bag of distances , 2013, 2013 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference.

[11]  Jitendra Sharma,et al.  Facial expression recognition using LBP template of facial parts and multilayer neural network , 2017, 2017 International Conference on I-SMAC (IoT in Social, Mobile, Analytics and Cloud) (I-SMAC).

[12]  Sarajane Marques Peres,et al.  Self Organizing Maps and bit signature: A study applied on signal language recognition , 2008, 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence).

[13]  Daijin Kim,et al.  Shape and Motion Features Approach for Activity Tracking and Recognition from Kinect Video Camera , 2015, 2015 IEEE 29th International Conference on Advanced Information Networking and Applications Workshops.

[14]  Tae-Seong Kim,et al.  Human Activity Recognition via the Features of Labeled Depth Body Parts , 2012, ICOST.

[15]  Shaharyar Kamal,et al.  Dense RGB-D Map-Based Human Tracking and Activity Recognition using Skin Joints Features and Self-Organizing Map , 2015, KSII Trans. Internet Inf. Syst..

[16]  María E. Buemi,et al.  Facial expression recognition based on static and dynamic approaches , 2016, 2016 23rd International Conference on Pattern Recognition (ICPR).

[17]  Daijin Kim,et al.  A Depth Video-based Human Detection and Activity Recognition using Multi-features and Embedded Hidden Markov Models for Health Care Monitoring Systems , 2017, Int. J. Interact. Multim. Artif. Intell..

[18]  Dong-Seong Kim,et al.  Detecting Complex 3D Human Motions with Body Model Low-Rank Representation for Real-Time Smart Activity Monitoring System , 2018, KSII Trans. Internet Inf. Syst..

[19]  Daijin Kim,et al.  A spatiotemporal motion variation features extraction approach for human tracking and pose-based action recognition , 2015, 2015 International Conference on Informatics, Electronics & Vision (ICIEV).

[20]  Tae-Seong Kim,et al.  Human Activity Recognition via Recognized Body Parts of Human Depth Silhouettes for Residents Monitoring Services at Smart Home , 2013 .

[21]  Tae-Seong Kim,et al.  Recognition of Human Home Activities via Depth Silhouettes and ℜ Transformation for Smart Homes , 2012 .

[22]  Ahmad Jalal,et al.  Advanced Performance Achievement using Multi- Algorithmic Approach of Video Transcoder for Low Bitrate Wireless Communication , 2005 .

[23]  Daijin Kim,et al.  Human Depth Sensors-Based Activity Recognition Using Spatiotemporal Features and Hidden Markov Model for Smart Environments , 2016, J. Comput. Networks Commun..

[24]  Daijin Kim,et al.  Depth silhouettes context: A new robust feature for human tracking and activity recognition based on embedded HMMs , 2015, 2015 12th International Conference on Ubiquitous Robots and Ambient Intelligence (URAI).

[25]  Ayoub Al-Hamadi,et al.  Frame-Based Facial Expression Recognition Using Geometrical Features , 2014, Adv. Hum. Comput. Interact..

[26]  Mansour Alsulaiman,et al.  Intrusion Detection System Using Self-Organizing Maps , 2009, 2009 Third International Conference on Network and System Security.

[27]  Ahmad Jalal,et al.  The Mechanism of Edge Detection using the Block Matching Criteria for the Motion Estimation , 2005 .

[28]  Daijin Kim,et al.  Robust human activity recognition from depth video using spatiotemporal multi-fused features , 2017, Pattern Recognit..

[29]  Xiaomin Mu,et al.  Recognizing facial expressions based on Gabor filter selection , 2011, 2011 4th International Congress on Image and Signal Processing.

[30]  Ahmad Jalal,et al.  Security Enhancement for E-Learning Portal , 2008 .

[31]  Ahmad Jalal,et al.  Dense depth maps-based human pose tracking and recognition in dynamic scenes using ridge data , 2014, 2014 11th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).

[32]  Kiran Talele,et al.  Facial expression recognition using general regression neural network , 2016, 2016 IEEE Bombay Section Symposium (IBSS).

[33]  Shaharyar Kamal,et al.  Real-time life logging via a depth silhouette-based human activity recognition system for smart home services , 2014, 2014 11th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).

[34]  Shaharyar Kamal,et al.  A Hybrid Feature Extraction Approach for Human Detection, Tracking and Activity Recognition Using Depth Sensors , 2016 .

[35]  Tae-Seong Kim,et al.  Depth video-based human activity recognition system using translation and scaling invariant features for life logging at smart home , 2012, IEEE Transactions on Consumer Electronics.

[36]  Daijin Kim,et al.  Human daily activity recognition with joints plus body features representation using Kinect sensor , 2015, 2015 International Conference on Informatics, Electronics & Vision (ICIEV).

[37]  Zhiqiang Chen,et al.  Recognize Facial Expression Using Active Appearance Model and Neural Network , 2017, 2017 International Conference on Cyber-Enabled Distributed Computing and Knowledge Discovery (CyberC).

[38]  Daijin Kim,et al.  Ridge body parts features for human pose estimation and recognition from RGB-D video data , 2014, Fifth International Conference on Computing, Communications and Networking Technologies (ICCCNT).

[39]  Ahmad Jalal,et al.  Multiple Facial Feature Detection Using Vertex-Modeling Structure , 2007 .

[40]  Dong-Liang Lee,et al.  A face detection and recognition system based on rectangular feature orientation , 2010, 2010 International Conference on System Science and Engineering.

[41]  Ahmad Jalal,et al.  Global Security Using Human Face Understanding under Vision Ubiquitous Architecture System , 2008 .

[42]  Tae-Seong Kim,et al.  Daily Human Activity Recognition Using Depth Silhouettes and R\mathcal{R} Transformation for Smart Home , 2011, ICOST.

[43]  Daijin Kim,et al.  Individual detection-tracking-recognition using depth activity images , 2015, 2015 12th International Conference on Ubiquitous Robots and Ambient Intelligence (URAI).

[44]  Sangwook Kim,et al.  Algorithmic implementation and efficiency maintenance of real-time environment using low-bitrate wireless communication , 2006, The Fourth IEEE Workshop on Software Technologies for Future Embedded and Ubiquitous Systems, and the Second International Workshop on Collaborative Computing, Integration, and Assurance (SEUS-WCCIA'06).