Smart cameras: 2D affine models for determining subject facial expressions

In this paper we consider how next generation of smart cameras will move beyond face detection and tracking to develop more useful analysis tools for determining the expressions and emotions of the subjects in images. An initial proof-of-concept using an extension of an Active Appearance Model (AAM) to measure facial parameters and a set of classifiers to determine facial states are described. Preliminary findings are encouraging and suggest that the use of the component-based AAM models and SVM classifiers will enable new applications and opportunities in smart cameras.

[1]  Paul L. Rosin,et al.  Speech and expression driven animation of a video-realistic appearance based hierarchical facial model , 2006 .

[2]  Michael J. Black,et al.  Tracking and recognizing rigid and non-rigid facial motions using local parametric models of image motion , 1995, Proceedings of IEEE International Conference on Computer Vision.

[3]  Maja Pantic,et al.  Web-based database for facial expression analysis , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[4]  Haizhou Ai,et al.  Face Alignment Under Various Poses and Expressions , 2005, ACII.

[5]  Timothy F. Cootes,et al.  Active Appearance Models , 1998, ECCV.

[6]  P. Ekman,et al.  Facial action coding system: a technique for the measurement of facial movement , 1978 .

[7]  F. Wallhoff,et al.  The Facial Expressions and Emotions Database Homepage (FEEDTUM) , 2005 .

[8]  H. Bülthoff,et al.  The contribution of different facial regions to the recognition of conversational expressions. , 2008, Journal of vision.

[9]  Yunus Saatci,et al.  Cascaded classification of gender and facial expression using active appearance models , 2006, 7th International Conference on Automatic Face and Gesture Recognition (FGR06).

[10]  Léon J. M. Rothkrantz,et al.  Facial expression recognition in still pictures and videos using active appearance models: a comparison approach , 2007, CompSysTech '07.

[11]  Se-Young Oh,et al.  Real-time Recognition of Facial Expression using Active Appearance Model with Second Order Minimization and Neural Network , 2006, 2006 IEEE International Conference on Systems, Man and Cybernetics.

[12]  Hyeonjoon Moon,et al.  The FERET evaluation methodology for face-recognition algorithms , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[13]  I. Bacivarov,et al.  Separating Directional Lighting Variability in Statistical Face Modelling Based on Texture Space Decomposition , 2007, 2007 15th International Conference on Digital Signal Processing.

[14]  Emil M. Petriu,et al.  A 3D-anthropometric-muscle-based active appearance model , 2004, 2004 IEEE Symposium on Virtual Environments, Human-Computer Interfaces and Measurement Systems, 2004. (VCIMS)..

[15]  Maja Pantic,et al.  Expert system for automatic analysis of facial expressions , 2000, Image Vis. Comput..

[16]  P SumathiC.,et al.  Automatic Facial Expression Analysis A Survey , 2012 .

[17]  Peter M. Corcoran,et al.  Statistical models of appearance for eye tracking and eye-blink detection and measurement , 2008, IEEE Transactions on Consumer Electronics.

[18]  Harry Wechsler,et al.  The FERET database and evaluation procedure for face-recognition algorithms , 1998, Image Vis. Comput..

[19]  Peter M. Corcoran,et al.  Automated sorting of consumer image collections using face and peripheral region image classifiers , 2005, IEEE Transactions on Consumer Electronics.

[20]  Guang Yang,et al.  A New Facial Expression Analysis System Based on Warp Image , 2006, 2006 6th World Congress on Intelligent Control and Automation.

[21]  Michael J. Black,et al.  Recognizing Facial Expressions in Image Sequences Using Local Parameterized Models of Image Motion , 1997, International Journal of Computer Vision.

[22]  Peter Corcoran,et al.  A combined approach to feature extraction for mouth characterization and tracking , 2008 .

[23]  Daijin Kim,et al.  Facial Expression Transformations for Expression-Invariant Face Recognition , 2006, ISVC.

[24]  Beat Fasel,et al.  Automati Fa ial Expression Analysis: A Survey , 1999 .

[25]  Cuiping Zhang,et al.  Component-Based Active Appearance Models for Face Modelling , 2006, ICB.

[26]  Shaogang Gong,et al.  2D statistical models of facial expressions for realistic 3D avatar animation , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[27]  Michael J. Lyons,et al.  Coding facial expressions with Gabor wavelets , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[28]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[29]  Ming Yang,et al.  Face detection for automatic exposure control in handheld camera , 2006, Fourth IEEE International Conference on Computer Vision Systems (ICVS'06).