Face localization using fuzzy classifier with wavelet-localized focus color features and shape features

This paper proposes a new fuzzy classifier (FC)-based face localization approach. The FC used is a self-organizing TS-type fuzzy network with support vector learning (SOTFN-SV). The SOTFN-SV learns consequent parameters using a linear support vector machine to improve generalization ability. The FC is first applied to segment human skin pixels in scaled hue and saturation (hS) color space, after which connected skin-color regions are regarded as face candidates. The FC is then applied to detect and localize faces from the candidates. The proposed FC-based face localization approach uses shape and wavelet-localized focus color features. A best fitting ellipse of each face candidate is found to obtain shape features. Focus color features are extracted from four focus regions, including the two eyes, the mouth, and the face skin-color region. To find these focus color regions, the Haar-wavelet transformation is first applied to the face candidates in the YCb color space to localize all possible pairs of eye candidates. The mouth region is then localized according to its geometric relationship with the eyes. The hS color features of the located eyes, mouth, and face skin are extracted. These focus color features, together with shape features, serve as inputs to another FC for final face localization. Comparisons with various classifiers and face detection methods demonstrate the advantage of the FC-based skin color segmentation and face localization method.

[1]  Chia-Feng Juang,et al.  A Self-Organizing TS-Type Fuzzy Network With Support Vector Learning and its Application to Classification Problems , 2007, IEEE Transactions on Fuzzy Systems.

[2]  Ayman Alfalou,et al.  Fuzzy logic and optical correlation-based face recognition method for patient monitoring application in home video surveillance , 2011 .

[3]  Zehang Sun,et al.  Object detection using feature subset selection , 2004, Pattern Recognit..

[4]  Chin-Teng Lin,et al.  Support-vector-based fuzzy neural network for pattern classification , 2006, IEEE Transactions on Fuzzy Systems.

[5]  John Q. Gan,et al.  Constructing L2-SVM-Based Fuzzy Classifiers in High-Dimensional Space With Automatic Model Selection and Fuzzy Rule Ranking , 2007, IEEE Transactions on Fuzzy Systems.

[6]  Chia-Feng Juang,et al.  Human Body Posture Classification by a Neural Fuzzy Network and Home Care System Application , 2007, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[7]  Rainer Lienhart,et al.  An extended set of Haar-like features for rapid object detection , 2002, Proceedings. International Conference on Image Processing.

[8]  Chia-Feng Juang,et al.  Block Histogram-Based Neural Fuzzy Approach to the Segmentation of Skin Colors , 2007, J. Inf. Sci. Eng..

[9]  Anil K. Jain,et al.  Face Detection in Color Images , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Plamen P. Angelov,et al.  Evolving Fuzzy-Rule-Based Classifiers From Data Streams , 2008, IEEE Transactions on Fuzzy Systems.

[11]  Won-Hyung Lee,et al.  Extraction of face objects using skin color information , 2002, IEEE 2002 International Conference on Communications, Circuits and Systems and West Sino Expositions.

[12]  Federico Girosi,et al.  Training support vector machines: an application to face detection , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[13]  Gin-Der Wu,et al.  A Maximizing-Discriminability-Based Self-Organizing Fuzzy Network for Classification Problems , 2010, IEEE Transactions on Fuzzy Systems.

[14]  Chia-Feng Juang,et al.  Using self-organizing fuzzy network with support vector learning for face detection in color images , 2008, Neurocomputing.

[15]  Tomaso A. Poggio,et al.  A Trainable System for Object Detection , 2000, International Journal of Computer Vision.

[16]  Tomaso A. Poggio,et al.  Example-Based Learning for View-Based Human Face Detection , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Ludmila I. Kuncheva,et al.  Fuzzy Classifier Design , 2000, Studies in Fuzziness and Soft Computing.

[18]  Chengjun Liu,et al.  Face detection using discriminating feature analysis and Support Vector Machine , 2006, Pattern Recognit..

[19]  Ataollah Ebrahimzadeh,et al.  Recognition of communication signal types using genetic algorithm and support vector machines based on the higher order statistics , 2010, Digit. Signal Process..

[20]  A. Sheikholeslami,et al.  Real-time face detection and lip feature extraction using field-programmable gate arrays , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[21]  Takeo Kanade,et al.  Neural Network-Based Face Detection , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  Chia-Feng Juang,et al.  Water bath temperature control by a recurrent fuzzy controller and its FPGA implementation , 2006, IEEE Transactions on Industrial Electronics.

[23]  Jing-Yu Yang,et al.  Face detection using template matching and skin-color information , 2007, Neurocomputing.

[24]  M. Brunig,et al.  Face detection and tracking for video coding applications , 2000, Conference Record of the Thirty-Fourth Asilomar Conference on Signals, Systems and Computers (Cat. No.00CH37154).

[25]  Chia-Feng Juang,et al.  Fuzzy System Learned Through Fuzzy Clustering and Support Vector Machine for Human Skin Color Segmentation , 2007, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[26]  Raphaël Féraud,et al.  A Fast and Accurate Face Detector Based on Neural Networks , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[27]  Shaogang Gong,et al.  Modelling facial colour and identity with Gaussian mixtures , 1998, Pattern Recognit..

[28]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[29]  Osamu Ikeda.  Segmentation of faces in video footage using HSV color for face detection and image retrieval , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[30]  A. Alfalou,et al.  Robust and discriminating method for face recognition based on correlation technique and independent component analysis model. , 2011, Optics letters.

[31]  Ioannis Pitas,et al.  A novel method for automatic face segmentation, facial feature extraction and tracking , 1998, Signal Process. Image Commun..

[32]  Christophe Garcia,et al.  Convolutional face finder: a neural architecture for fast and robust face detection , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  James M. Rehg,et al.  Statistical Color Models with Application to Skin Detection , 2004, International Journal of Computer Vision.

[34]  Chia-Feng Juang,et al.  Fuzzy system-based real-time face tracking in a multi-subject environment with a pan-tilt-zoom camera , 2010, Expert Syst. Appl..

[35]  L. Darrell Whitley,et al.  Adaptive Appearance Model and Condensation Algorithm for Robust Face Tracking , 2010, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[36]  Jue Wang,et al.  Classification of parkinsonian and essential tremor using empirical mode decomposition and support vector machine , 2011, Digit. Signal Process..