Active Batch Selection for Fuzzy Classification in Facial Expression Recognition

Automated recognition of facial expressions is an important problem in computer vision applications. Due to the vagueness in class definitions, expression recognition is often conceived as a fuzzy label problem. Annotating a data point in such a problem involves significant manual effort. Active learning techniques are effective in reducing human labeling effort to induce a classification model as they automatically select the salient and exemplar instances from vast amounts of unlabeled data. Further, to address the high redundancy in data such as image or video sequences as well as to account for the presence of multiple labeling agents, there have been recent attempts towards a batch mode form of active learning where a batch of data points is selected simultaneously from an unlabeled set. In this paper, we propose a novel optimization-based batch mode active learning technique for fuzzy label classification problems. To the best of our knowledge, this is the first effort to develop such a scheme primarily intended for the fuzzy label context. The proposed algorithm is computationally simple, easy to implement and has provable performance bounds. Our results on facial expression datasets corroborate the efficacy of the framework in reducing human annotation effort in real world recognition applications involving fuzzy labels.

[1]  Maja Pantic,et al.  Web-based database for facial expression analysis , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[2]  P. Ekman Facial expression and emotion. , 1993, The American psychologist.

[3]  Dale Schuurmans,et al.  Discriminative Batch Mode Active Learning , 2007, NIPS.

[4]  A. Khanam,et al.  Fuzzy Based Facial Expression Recognition , 2008, 2008 Congress on Image and Signal Processing.

[5]  David A. Cohn,et al.  Active Learning with Statistical Models , 1996, NIPS.

[6]  Xiaowei Xu,et al.  Representative Sampling for Text Classification Using Support Vector Machines , 2003, ECIR.

[7]  Sethuraman Panchanathan,et al.  A Systematic Requirements Analysis and Development of an Assistive Device to Enhance the Social Interaction of People Who are Blind or Visually Impaired , 2008 .

[8]  Rong Jin,et al.  Large-scale text categorization by batch mode active learning , 2006, WWW '06.

[9]  Shie-Jue Lee,et al.  A Fuzzy Similarity-Based Approach for Multi-label Document Classification , 2009, 2009 Second International Workshop on Computer Science and Engineering.

[10]  Zhenjiang Miao,et al.  Fuzzy discriminant projections for facial expression recognition , 2008, 2008 19th International Conference on Pattern Recognition.

[11]  P. Ekman,et al.  Strong evidence for universals in facial expressions: a reply to Russell's mistaken critique. , 1994, Psychological bulletin.

[12]  H. Sebastian Seung,et al.  Selective Sampling Using the Query by Committee Algorithm , 1997, Machine Learning.

[13]  Ran El-Yaniv,et al.  Online Choice of Active Learning Algorithms , 2003, J. Mach. Learn. Res..

[14]  Fakhri Karray,et al.  Fuzzy entropy: a brief survey , 2001, 10th IEEE International Conference on Fuzzy Systems. (Cat. No.01CH37297).

[15]  I. Lizarazo,et al.  Fuzzy image segmentation for urban land-cover classification , 2010 .

[16]  John Langford,et al.  Importance weighted active learning , 2008, ICML '09.

[17]  Nello Cristianini,et al.  Query Learning with Large Margin Classi ersColin , 2000 .

[18]  Rong Jin,et al.  Batch mode active learning and its application to medical image classification , 2006, ICML.

[19]  Yuhong Guo,et al.  Active Instance Sampling via Matrix Partition , 2010, NIPS.

[20]  M. L. Fisher,et al.  An analysis of approximations for maximizing submodular set functions—I , 1978, Math. Program..

[21]  Daphne Koller,et al.  Support Vector Machine Active Learning with Applications to Text Classification , 2000, J. Mach. Learn. Res..

[22]  Rong Jin,et al.  Semi-supervised SVM batch mode active learning for image retrieval , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[23]  Rong Jin,et al.  Batch Mode Active Learning with Applications to Text Categorization and Image Retrieval , 2009, IEEE Transactions on Knowledge and Data Engineering.

[24]  Greg Schohn,et al.  Less is More: Active Learning with Support Vector Machines , 2000, ICML.

[25]  Gwen Littlewort,et al.  Real Time Face Detection and Facial Expression Recognition: Development and Applications to Human Computer Interaction. , 2003, 2003 Conference on Computer Vision and Pattern Recognition Workshop.

[26]  Maja Pantic,et al.  Fully Automatic Facial Action Unit Detection and Temporal Analysis , 2006, 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'06).

[27]  Witold Pedrycz,et al.  Fuzzy set theoretic adjustment to training set class labels using robust location measures , 2000, Proceedings of the IEEE-INNS-ENNS International Joint Conference on Neural Networks. IJCNN 2000. Neural Computing: New Challenges and Perspectives for the New Millennium.

[28]  Sethuraman Panchanathan,et al.  Learning from summaries of videos: Applying batch mode active learning to face-based biometrics , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.

[29]  Gwen Littlewort,et al.  Dynamics of Facial Expression Extracted Automatically from Video , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[30]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[31]  Peter Robinson,et al.  Mind reading machines: automated inference of cognitive mental states from video , 2004, 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583).

[32]  Klaus Brinker,et al.  Incorporating Diversity in Active Learning with Support Vector Machines , 2003, ICML.

[33]  Russell Greiner,et al.  Optimistic Active-Learning Using Mutual Information , 2007, IJCAI.