Group expression intensity estimation in videos via Gaussian Processes

Facial expression analysis has been a very active field of research in recent years. This paper proposes a method for finding the apex of an expression, e.g. happiness, in a video containing a group of people based on expression intensity estimation. The proposed method is directly applied to video summarisation based on group happiness and timestamps; further, a novel Gaussian Process Regression based expression intensity estimation method is described. To demonstrate its performance, experiments on smile intensity estimation are performed and compared to other regression based techniques. The smile intensity estimator is extended to group happiness intensity estimation. The proposed intensity estimator can be extended easily for other expressions. The experiments are performed on an `in the wild' dataset. Quantitative results are presented for comparison of our happiness-intensity detector. A user study was also conducted to verify the results of the proposed method.

[1]  Andrew C. Gallagher,et al.  Understanding images of groups of people , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Gwen Littlewort,et al.  Toward Practical Smile Detection , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[4]  Radford M. Neal.  Pattern Recognition and Machine Learning , 2007, Technometrics.

[5]  Andrew Zisserman,et al.  Representing shape with a spatial pyramid kernel , 2007, CIVR '07.

[6]  Vittorio Ferrari,et al.  We Are Family: Joint Pose Estimation of Multiple Persons , 2010, ECCV.

[7]  Tamás D. Gedeon,et al.  Collecting Large, Richly Annotated Facial-Expression Databases from Movies , 2012, IEEE MultiMedia.

[8]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[9]  Takio Kurita,et al.  Appearance-Based Smile Intensity Estimation by Cascaded Support Vector Machines , 2010, ACCV Workshops.

[10]  Roland Göcke,et al.  Learning AAM fitting through simulation , 2009, Pattern Recognition.

[11]  Huma Lodhi,et al.  Chemoinformatics and Advanced Machine Learning Perspectives: Complex Computational Methods and Collaborative Techniques , 2010 .

[12]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[13]  Ville Ojansivu,et al.  Blur Insensitive Texture Classification Using Local Phase Quantization , 2008, ICISP.

[14]  Tamás D. Gedeon,et al.  Emotion recognition using PHOG and LPQ features , 2011, Face and Gesture 2011.