Automatic recognition of human facial expressions

The paper presents a new idea for detecting an unknown human face in input imagery and recognizing his/her facial expression represented in the deformation of the two dimensional net, called potential net. The method deals with the facial information, faceness and expressions, as an overall pattern of the net activated by edges in a single input image of face, rather than from changes in the shape of the facial organs or their geometrical relationships. We build models of facial expressions from the deformation patterns in the potential net for face images in the training set of different expressions and then project them into emotion space. Expression of an unknown subject can be recognized from the projection of the net for the image into the emotion space. The potential net is further used to model the common human face. The mosaic method representing energy in the net is used as a template for finding candidates for the face area and the candidates are verified their faceness by projecting them into emotion space in order to select the finalist. Precise location of the face is determined by the histogram analysis of vertical and horizontal projections of edges.<<ETX>>

[1]  Zensho Yokose,et al.  THE LAW OF THE “FIELD” IN VISUAL FORM PERCEPTION (I): A THEORETICAL FORMULA TO SEEK THE FIELD STRENGTH OF THE FORM AND ITS EXPERIMENTAL PROOF , 1954 .

[2]  H. Kazmierczak,et al.  The potential field as an aid to character recognition , 1959, IFIP Congress.

[3]  K. Motokawa,et al.  The electrical field in the retina and pattern vision. , 1962, The Tohoku journal of experimental medicine.

[4]  Richard O. Duda,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.

[5]  金出 武雄,et al.  Picture processing system by computer complex and recognition of human faces , 1974 .

[6]  Takeo Kanade,et al.  Picture Processing System by Computer Complex and Recognition of Human Faces , 1974 .

[7]  L Sirovich,et al.  Low-dimensional procedure for the characterization of human faces. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[8]  H. Harashima.  "Model-based analysis syn-thesis coding of videotelephone images" , 1989 .

[9]  Fumio Hara,et al.  The recognition of basic facial expressions by neural network , 1991, [Proceedings] 1991 IEEE International Joint Conference on Neural Networks.

[10]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[11]  W. J. Welsh,et al.  Classification of facial features for recognition , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[12]  Demetri Terzopoulos,et al.  Sampling and reconstruction with adaptive meshes , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[13]  Kenji Mase,et al.  Recognition of Facial Expression from Optical Flow , 1991 .

[14]  Ashok Samal,et al.  Automatic recognition and analysis of human faces and facial expressions: a survey , 1992, Pattern Recognit..

[15]  William H. Press,et al.  Numerical Recipes in C, 2nd Edition , 1992 .

[16]  Pertti Roivainen,et al.  3-D Motion Estimation in Model-Based Facial Image Coding , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Demetri Terzopoulos,et al.  Analysis and Synthesis of Facial Image Sequences Using Physical and Anatomical Models , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Larry S. Davis,et al.  Computing spatio-temporal representations of human faces , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[19]  Alex Pentland,et al.  A vision system for observing and extracting facial action parameters , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[20]  Chil-Woo Lee,et al.  Detection and pose estimation of human face with synthesized image models , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[21]  Hiroshi Murase,et al.  Illumination planning for object recognition in structured environments , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[22]  Saburo Tsuji,et al.  Recognizing human facial expressions in a potential field , 1994, Proceedings of the 12th IAPR International Conference on Pattern Recognition, Vol. 3 - Conference C: Signal Processing (Cat. No.94CH3440-5).

[23]  Chil-Woo Lee,et al.  Recognition of Human Facial Expressions Without Feature Extraction , 1994, ECCV.