Facial image processing for facial analysis

This paper discusses a methodology for improved image processing for human facial analysis and tries to integrate results from the visible images with the corresponding thermal images. First, an enhanced face detection algorithm in color images is described. The performance of Haar Classifiers is known as a fast real-time face detection algorithm. However, it generates false detection. The suggested solution in previous research is to increase the training set. The proposed solution in this paper is to pre-process the color images by implementing color segmentation in Chrominance component and Hue component prior to face detection algorithm. Datasets from different resources are tested and the experimental results produced suggested that this approach increases the detection rate and reduces the false detection rate in some datasets, but not for all. The performances from these datasets are compared and the possible future implementation is discussed. Further, the detection is extended to eyes, nose, and mouth detection. The second contribution of this paper is to establish a link between the visible images and thermal image. The method of applying visible image information to locate the face features in thermal image is illustrated. Finally, some possible future implementation of the results of the facial analysis within the domain of security is discussed.

[1]  Maja Pantic,et al.  Web-based database for facial expression analysis , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[2]  Rama Chellappa,et al.  Human and machine recognition of faces: a survey , 1995, Proc. IEEE.

[3]  M. Bartlett,et al.  Machine Analysis of Facial Expressions , 2007 .

[4]  Narendra Ahuja,et al.  Detecting Faces in Images: A Survey , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Rainer Lienhart,et al.  An extended set of Haar-like features for rapid object detection , 2002, Proceedings. International Conference on Image Processing.

[6]  David Zhang,et al.  Automated Biometrics: Technologies and Systems , 2000 .

[7]  E. Granum,et al.  Skin colour detection under changing lighting conditions , 1999 .

[8]  Seong G. Kong,et al.  Recent advances in visual and infrared face recognition - a review , 2005, Comput. Vis. Image Underst..

[9]  Lawrence B. Wolff,et al.  Tracking human faces in infrared video , 2003, Image Vis. Comput..

[10]  Maja Pantic,et al.  Fully automatic facial feature point detection using Gabor feature based boosted classifiers , 2005, 2005 IEEE International Conference on Systems, Man and Cybernetics.

[11]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[12]  Seong G. Kong,et al.  Multiscale Fusion of Visible and Thermal IR Images for Illumination-Invariant Face Recognition , 2007, International Journal of Computer Vision.

[13]  Anil K. Jain,et al.  Face Detection in Color Images , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Maja Pantic,et al.  A Dynamic Texture-Based Approach to Recognition of Facial Actions and Their Temporal Models , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Erik Hjelmås,et al.  Face Detection: A Survey , 2001, Comput. Vis. Image Underst..

[16]  Javier Lorenzo-Navarro,et al.  Face and Facial Feature Detection Evaluation - Performance Evaluation of Public Domain Haar Detectors for Face and Facial Feature Detection , 2008, VISAPP.

[17]  Min C. Shin,et al.  Does colorspace transformation make any difference on skin detection? , 2002, Sixth IEEE Workshop on Applications of Computer Vision, 2002. (WACV 2002). Proceedings..

[18]  Beat Fasel,et al.  Automati Fa ial Expression Analysis: A Survey , 1999 .

[19]  Tomaso A. Poggio,et al.  A general framework for object detection , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).