An optimization of the K-Nearest Neighbor using Dynamic Time Warping as a measurement similarity for facial expressions recognition

At the present time, the facial expressions recognition system from video sequences is a huge challenging problem to face in human and computer interaction. Emotions are important information to retrieve and treat. With the developed system, we were able to decode facial expressions and deduce human emotions, all in keeping a low error rate. The aim of this paper is to bring together two areas of which are K-Nearest Neighbor (KNN) and Dynamic Time Warping (DTW) applying for facial expressions classification. The proposed system constructs the robust features based on Active Shape Models (ASM), computes distance similarity between feature vectors by DTW, then uses KNN as a classifier. Our system achieved 90.1% of recognition accuracy using the Cohn-Kanade (CK+) facial expressions database.

[1]  Narendra Ahuja,et al.  Detecting Faces in Images: A Survey , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Timothy F. Cootes,et al.  Active Shape Models-Their Training and Application , 1995, Comput. Vis. Image Underst..

[3]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[4]  Daniel Lemire,et al.  Faster retrieval with a two-pass dynamic-time-warping lower bound , 2008, Pattern Recognit..

[5]  Theophano Mitsa,et al.  Temporal Data Mining , 2010 .

[6]  An Liu,et al.  New facial expression recognition based on FSVM and KNN , 2015 .

[7]  James M. Keller,et al.  A fuzzy K-nearest neighbor algorithm , 1985, IEEE Transactions on Systems, Man, and Cybernetics.

[8]  Bao-Liang Lu,et al.  Identifying Stable Patterns over Time for Emotion Recognition from EEG , 2016, IEEE Transactions on Affective Computing.

[9]  Elsaeed E. AbdElrazek,et al.  A Real-Time System for Facial Expression Recognition using Support Vector Machines and k-Nearest Neighbor Classifier , 2017 .

[10]  Timothy F. Cootes,et al.  Active Appearance Models , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Takeo Kanade,et al.  The Extended Cohn-Kanade Dataset (CK+): A complete dataset for action unit and emotion-specified expression , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.

[12]  Takeo Kanade,et al.  Multi-PIE , 2008, 2008 8th IEEE International Conference on Automatic Face & Gesture Recognition.

[13]  Fred Nicolls,et al.  Active shape models with SIFT descriptors and MARS , 2015, 2014 International Conference on Computer Vision Theory and Applications (VISAPP).

[14]  Deepak Ghimire,et al.  Geometric Feature-Based Facial Expression Recognition in Image Sequences Using Multi-Class AdaBoost and Support Vector Machines , 2013, Sensors.

[15]  P. Ekman,et al.  DIFFERENCES Universals and Cultural Differences in the Judgments of Facial Expressions of Emotion , 2004 .