Real-Time Facial Expression Recognition for Natural Interaction

The recognition of emotional information is a key step toward giving computers the ability to interact more naturally and intelligently with people. This paper presents a completely automated real-time system for facial expression's recognition based on facial features' tracking and a simple emotional classification method. Facial features' tracking uses a standard webcam and requires no specific illumination or background conditions. Emotional classification is based on the variation of certain distances and angles from the neutral face and manages the six basic universal emotions of Ekman. The system has been integrated in a 3D engine for managing virtual characters, allowing the exploration of new forms of natural interaction.

[1]  Dmitry O. Gorodnichy,et al.  Nouse 'use your nose as a mouse' perceptual vision technology for hands-free games and interfaces , 2004, Image Vis. Comput..

[2]  Sing Bing Kang,et al.  Emerging Topics in Computer Vision , 2004 .

[3]  Zakia Hammal,et al.  Facial Expression Recognition Based on the Belief Theory: Comparison with Different Classifiers , 2005, ICIAP.

[4]  S. Baldassarri,et al.  MaxinePPT : Using 3 D Virtual Characters for Natural Interaction , 2006 .

[5]  Kentaro Toyama,et al.  “Look, Ma – No Hands!” Hands-Free Cursor Control with Real-Time 3D Face Tracking , 1998 .

[6]  Maja Pantic,et al.  Automatic Analysis of Facial Expressions: The State of the Art , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[8]  D. Ullyot.  Look ma, no hands! , 1996, The Annals of thoracic surgery.

[9]  Simon Baker,et al.  Lucas-Kanade 20 Years On: A Unifying Framework , 2004, International Journal of Computer Vision.

[10]  M. Turk,et al.  Perceptual Interfaces , 2003 .

[11]  J. N. Bassili.  Emotion recognition: the role of facial movement and the relative importance of upper and lower areas of the face. , 1979, Journal of personality and social psychology.

[12]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[13]  Gerhard Roth,et al.  Nouse 'Use Your Nose as a Mouse' - a New Technology for Hands-free Games and Interfaces , 2002 .

[14]  Gary R. Bradski,et al.  Real time face and object tracking as a component of a perceptual user interface , 1998, Proceedings Fourth IEEE Workshop on Applications of Computer Vision. WACV'98 (Cat. No.98EX201).

[15]  Dmitry O. Gorodnichy.  Nouse ‘Use Your Nose as a Mouse’ – a New Technology for Hands-free Games and Interfaces , 2002 .

[16]  Fabio Roli,et al.  Image Analysis and Processing - ICIAP 2005, 13th International Conference, Cagliari, Italy, September 6-8, 2005, Proceedings , 2005, ICIAP.

[17]  M. Betke,et al.  The Camera Mouse: visual tracking of body features to provide computer access for people with severe disabilities , 2002, IEEE Transactions on Neural Systems and Rehabilitation Engineering.