Human emotion recognition from motion using a radial basis function network architecture

A radial basis function network architecture is developed that learns the correlation of facial feature motion patterns and human emotions. We describe a hierarchical approach which at the highest level identifies emotions, at the mid level determines motion of facial features, and at the low level recovers motion directions. Individual emotion networks were trained to recognize the 'smile' and 'surprise' emotions. Each emotion network was trained by viewing a set of sequences of one emotion for many subjects. The trained neural network was then tested for retention, extrapolation and rejection ability. Success rates were about 88% for retention, 73% for extrapolation, and 79% for rejection.<<ETX>>

[1]  J. N. Bassili.  Emotion recognition: the role of facial movement and the relative importance of upper and lower areas of the face. , 1979, Journal of personality and social psychology.

[2]  J. Moran,et al.  Sensation and perception , 1980 .

[3]  S. Renals,et al.  Phoneme classification experiments using radial basis functions , 1989, International 1989 Joint Conference on Neural Networks.

[4]  S. Qian,et al.  Nonlinear adaptive networks: A little theory, a few applications , 1990 .

[5]  P. S. Lewis,et al.  Function approximation and time series prediction with neural networks , 1990, 1990 IJCNN International Joint Conference on Neural Networks.

[6]  Kenji Mase,et al.  Recognition of Facial Expression from Optical Flow , 1991 .

[7]  Allen M. Waxman,et al.  Adaptive 3-D Object Recognition from Multiple Views , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Larry S. Davis,et al.  Labeling of human face components from range data , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Tomaso Poggio,et al.  Example Based Image Analysis and Synthesis , 1993 .

[10]  Pertti Roivainen,et al.  3-D Motion Estimation in Model-Based Facial Image Coding , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Dean A. Pomerleau,et al.  Neural Network Perception for Mobile Robot Guidance , 1993 .

[12]  L. S. Davis,et al.  The Use Of A Radial Basis Function Network For Visual Autonomous Road Following , 1993, Proceedings of the Intelligent Vehicles '93 Symposium.

[13]  Azriel Rosenfeld,et al.  Binocular motion stereo using MAP estimation , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[14]  Demetri Terzopoulos,et al.  Analysis and Synthesis of Facial Image Sequences Using Physical and Anatomical Models , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Larry S. Davis,et al.  Computing spatio-temporal representations of human faces , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[16]  Alex Pentland,et al.  A vision system for observing and extracting facial action parameters , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[17]  R. Palmer,et al.  Introduction to the theory of neural computation , 1994, The advanced book program.

[18]  Chil-Woo Lee,et al.  Recognition of Human Facial Expressions Without Feature Extraction , 1994, ECCV.

[19]  Michael J. Black,et al.  Tracking and recognizing rigid and non-rigid facial motions using local parametric models of image motion , 1995, Proceedings of IEEE International Conference on Computer Vision.