Combining integral projection and Gabor transformation for automatic facial feature detection and extraction

In order to achieve subject-independent facial feature detection and extraction and obtain robustness against illumination variety, a novel method of combining integral projection and Gabor transformation is presented in this paper. First, to avoid manually picked expression features, we employ binary image and gray-level integral projection to detect and locate the exact position of human facial features automatically. Second, we segment the extracted areas into small cells for 7times7 pixels each and apply Gabor transformation on each cell. This greatly reduces the execution time of the Gabor transformation while retaining important information. Finally, a support vector machine is used for classifying facial emotions and when tested on the JAFFE database, the method has achieved a high recognition rate of 94%.

[1]  Rosalind W. Picard Toward Agents that Recognize Emotion , 1998 .

[2]  Maja Pantic,et al.  Automatic Analysis of Facial Expressions: The State of the Art , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Paul A. Viola,et al.  Robust Real-time Object Detection , 2001 .

[4]  P. Ekman Emotion in the human face , 1982 .

[5]  P. Ekman Facial expression and emotion. , 1993, The American psychologist.

[6]  Rosalind W. Picard,et al.  Towards a Learning Companion that Recognizes Affect , 2001 .

[7]  Zhi-Hua Zhou,et al.  Projection functions for eye detection , 2004, Pattern Recognit..

[8]  P. Ekman,et al.  Strong evidence for universals in facial expressions: a reply to Russell's mistaken critique. , 1994, Psychological bulletin.

[9]  LinLin Shen,et al.  A review on Gabor wavelets for face recognition , 2006, Pattern Analysis and Applications.

[10]  Kang Kejun Mean-based fast median filter , 2004 .

[11]  Beat Fasel,et al.  Automati Fa ial Expression Analysis: A Survey , 1999 .

[12]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[13]  Paul Ekman,et al.  Emotions inside out. 130 Years after Darwin's "The Expression of the Emotions in Man and Animal". , 2003, Annals of the New York Academy of Sciences.

[14]  Michael J. Lyons,et al.  Coding facial expressions with Gabor wavelets , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[15]  Yasuhiro Nakamura,et al.  Mathematical representation and image generation of human faces by metamorphosis , 1997 .

[16]  Rosalind W. Picard,et al.  Finding similar patterns in large image databases , 1993, 1993 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[17]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[18]  Rosalind W. Picard Toward computers that recognize and respond to user emotion , 2000, IBM Syst. J..

[19]  Ken Turkowski,et al.  Filters for common resampling tasks , 1990 .

[20]  Ginés García-Mateos,et al.  Face Detection Using Integral Projection Models , 2002, SSPR/SPR.

[21]  E. Vesterinen,et al.  Affective Computing , 2009, Encyclopedia of Biometrics.