Investigation of New Techniques for Face detection

The task of detecting human faces within either a still image or a video frame is one of the most popular object detection problems. For the last twenty years researchers have shown great interest in this problem because it is an essential preprocessing stage for computing systems that process human faces as input data. Example applications include face recognition systems, vision systems for autonomous robots, human computer interaction systems (HCI), surveillance systems, biometric based authentication systems, video transmission and video compression systems, and content based image retrieval systems. In this thesis, non-traditional methods are investigated for detecting human faces within color images or video frames. The attempted methods are chosen such that the required computing power and memory consumption are adequate for realtime hardware implementation. First, a standard color image database is introduced in order to accomplish fair evaluation and benchmarking of face detection and skin segmentation approaches. Next, a new pre-processing scheme based on skin segmentation is presented to prepare the input image for feature extraction. The presented pre-processing scheme requires relatively low computing power and memory needs. Then, several feature extraction techniques are evaluated. This thesis introduces feature extraction based on Two Dimensional Discrete Cosine Transform (2D-DCT), Two Dimensional Discrete Wavelet Transform (2D-DWT), geometrical moment invariants, and edge detection. It also attempts to construct a hybrid feature vector by the fusion between 2D-DCT coefficients and edge information, as well as the fusion between 2D-DWT coefficients and geometrical moments. A self organizing map (SOM) based classifier is used within all the experiments to distinguish between facial and non-facial samples. Two strategies are tried to make the final decision from the output of a single SOM or multiple SOM. Finally, an FPGA based framework that implements the presented techniques, is presented as well as a partial implementation. Every presented technique has been evaluated consistently using the same dataset. The experiments show very promising results. The highest detection rate of 89.2% was obtained when using a fusion between DCT coefficients and edge information to construct the feature vector. A second highest rate of 88.7% was achieved by using a fusion between DWT coefficients and geometrical moments. Finally, a third highest rate of 85.2% was obtained by calculating the moments of edges.

[1]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[2]  Khashayar Khorasani,et al.  Facial expression recognition using constructive feedforward neural networks , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[3]  Sang Uk Lee,et al.  Face Detection Using a First-Order RCE Classifier , 2003, EURASIP J. Adv. Signal Process..

[4]  Paul A. Viola,et al.  Fast Multi-view Face Detection , 2003 .

[5]  Teuvo Kohonen,et al.  The self-organizing map , 1990, Neurocomputing.

[6]  Karim Faez,et al.  Face Detection Based on Central Geometrical Moments of Face Components , 2006, 2006 IEEE International Conference on Systems, Man and Cybernetics.

[7]  Tomaso A. Poggio,et al.  Example-Based Learning for View-Based Human Face Detection , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Amara Lynn Graps,et al.  An introduction to wavelets , 1995 .

[9]  Esa Alhoniemi,et al.  Self-organizing map in Matlab: the SOM Toolbox , 1999 .

[10]  D. Collobert,et al.  MULTRAK: a system for automatic multiperson localization and tracking in real-time , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[11]  Xiuwen Liu,et al.  Face detection using spectral histograms and SVMs , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[12]  Andrew Blake,et al.  Computationally efficient face detection , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[13]  Narendra Ahuja,et al.  Detecting Faces in Images: A Survey , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  I K Fodor,et al.  A Survey of Dimension Reduction Techniques , 2002 .

[15]  V. V. Buldygin,et al.  Brunn-Minkowski inequality , 2000 .

[16]  Stan Z. Li,et al.  Learning to detect multi-view faces in real-time , 2002, Proceedings 2nd International Conference on Development and Learning. ICDL 2002.

[17]  Ming-Kuei Hu,et al.  Visual pattern recognition by moment invariants , 1962, IRE Trans. Inf. Theory.

[18]  A. Ardeshir Goshtasby,et al.  Detecting human faces in color images , 1998, Image Vis. Comput..

[19]  Aleix M. Martinez,et al.  The AR face database , 1998 .

[20]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[21]  Ian Craw,et al.  A SOM Based Approach to Skin Detection with Application in Real Time Systems , 2001, BMVC.

[22]  T. Ramdas,et al.  FPGA implementation of an integer MIPS processor in Handel-C and its application to human face detection , 2004, 2004 IEEE Region 10 Conference TENCON 2004..

[23]  James S. Walker,et al.  A Primer on Wavelets and Their Scientific Applications , 1999 .

[24]  H. D. Cheng,et al.  A reconfigurable hardware accelerator for moment computation , 1997, Proceedings. Tenth Annual IEEE International ASIC Conference and Exhibit (Cat. No.97TH8334).

[25]  F. Alexandre,et al.  Parallel FPGA implementation of self-organizing maps , 2004, Proceedings. The 16th International Conference on Microelectronics, 2004. ICM 2004..

[26]  Takeo Kanade,et al.  Rotation invariant neural network-based face detection , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[27]  R. McCready Real-Time Face Detection on a Configurable Hardware Platform , 2000 .

[28]  Erik Hjelmås,et al.  Face Detection: A Survey , 2001, Comput. Vis. Image Underst..

[29]  W. James MacLean,et al.  A Proposed Pipelined-Architecture for FPGA-Based Affine-Invariant Feature Detectors , 2006, 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'06).

[30]  Narayanan Vijaykrishnan,et al.  A parallel architecture for hardware face detection , 2006, IEEE Computer Society Annual Symposium on Emerging VLSI Technologies and Architectures (ISVLSI'06).

[31]  Narayanan Vijaykrishnan,et al.  Embedded hardware face detection , 2004, 17th International Conference on VLSI Design. Proceedings..

[32]  Chengjun Liu,et al.  A Bayesian Discriminating Features Method for Face Detection , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[33]  V. S. K. Reddy,et al.  A high-level pipelined FPGA based DCT for video coding applications , 2003, TENCON 2003. Conference on Convergent Technologies for Asia-Pacific Region.

[34]  Federico Girosi,et al.  Training support vector machines: an application to face detection , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[35]  John Y. Cheung,et al.  Design of Low Memory Usage Discrete Wavelet Transform on FPGA Using Novel Diagonal Scan , 2006, International Symposium on Parallel Computing in Electrical Engineering (PARELEC'06).

[36]  Melanie Po-Leen Ooi Hardware implementation for face detection on Xilinx Virtex-II FPGA using the reversible component transformation colour space , 2006, Third IEEE International Workshop on Electronic Design, Test and Applications (DELTA'06).

[37]  Young-Seuk Park,et al.  Self-Organizing Map , 2008 .

[38]  de Paul Zeeuw,et al.  Pna Probability, Networks and Algorithms Probability, Networks and Algorithms a Toolbox for the Lifting Scheme on Quincunx Grids (lisq) a Toolbox for the Lifting Scheme on Quincunx Grids (lisq) , 2022 .

[39]  P. Peer,et al.  Human skin color clustering for face detection , 2003, The IEEE Region 8 EUROCON 2003. Computer as a Tool..

[40]  Georgios Tziritas,et al.  Face Detection Using Quantized Skin Color Regions Merging and Wavelet Packet Analysis , 1999, IEEE Trans. Multim..

[41]  Sandor Z. Der,et al.  FERET (Face Recognition Technology) Recognition Algorithm Development and Test Results. , 1996 .

[42]  Charles K. Chui,et al.  An Introduction to Wavelets , 1992 .

[43]  Takeo Kanade,et al.  A statistical method for 3D object detection applied to faces and cars , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[44]  Ali M. Al-Haj,et al.  An FPGA-Based Parallel Distributed Arithmetic Implementation of the 1-D Discrete Wavelet Transform , 2005, Informatica.

[45]  Matti Pietikäinen,et al.  Physics-based face database for color research , 2000, J. Electronic Imaging.

[46]  Stan Z. Li,et al.  FloatBoost learning and statistical face detection , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[47]  IEEE conference on computer vision and pattern recognition , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[48]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[49]  Gerhard Fettweis,et al.  Design and automatic code generation of a two-dimensional fast cosine transform for SIMD DSP architectures , 2005, 2005 13th European Signal Processing Conference.

[50]  Takeo Kanade,et al.  Probabilistic modeling of local appearance and spatial relationships for object recognition , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[51]  Hiroomi Hikawa FPGA implementation of self organizing map with digital phase locked loops , 2005, Neural Networks.

[52]  Abbes Amira,et al.  A framework for FPGA based Discrete Biorthogonal Wavelet Transforms implementation , 2005, 2005 13th European Signal Processing Conference.

[53]  Takeo Kanade,et al.  Neural Network-Based Face Detection , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[54]  Yu Wei,et al.  FPGA implementation of AdaBoost algorithm for detection of face biometrics , 2004, IEEE International Workshop on Biomedical Circuits and Systems, 2004..

[55]  Oliver R. Hinton,et al.  About Moment Normalization and Complex Moment Descriptors , 1988, Pattern Recognition.

[56]  Neil W. Bergmann,et al.  Video compression on FPGA-based custom computers , 1997, Proceedings of International Conference on Image Processing.

[57]  Shaogang Gong,et al.  Support vector regression and classification based multi-view face detection and recognition , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[58]  Daggu Venkateshwar Rao,et al.  An efficient reconfigurable architecture and implementation of edge detection algorithm using Handle-C , 2004, International Conference on Information Technology: Coding and Computing, 2004. Proceedings. ITCC 2004..

[59]  Theocharis Theocharides,et al.  Embedded hardware face detection for digital surveillance systems , 2006 .

[60]  B.S. Pimentel,et al.  A FPGA implementation of a DCT-based digital electrocardiographic signal compression device , 2001, Symposium on Integrated Circuits and Systems Design.

[61]  Jouko Lampinen,et al.  Clustering properties of hierarchical self-organizing maps , 1992, Journal of Mathematical Imaging and Vision.

[62]  Chiunhsiun Lin,et al.  Face detection by color and multilayer feedforward neural network , 2005, 2005 IEEE International Conference on Information Acquisition.

[63]  Glenn Healey,et al.  The Illumination-Invariant Recognition of 3D Objects Using Local Color Invariants , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[64]  Kostas Masselos,et al.  Performance comparison of two-dimensional discrete wavelet transform computation schedules on a VLIW digital signal processor , 2006 .

[65]  Cameron D. Patterson,et al.  An FPGA-based Run-time Reconfigurable 2-D Discrete Wavelet Transform Core , 2001 .

[66]  Teuvo Kohonen,et al.  Self-organized formation of topologically correct feature maps , 2004, Biological Cybernetics.

[67]  Tadahiro Kuroda,et al.  A real-time multi face detection technique using positive-negative lines-of-face template , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[68]  Vladimir Vezhnevets,et al.  A Survey on Pixel-Based Skin Color Detection Techniques , 2003 .

[69]  Bruno Jedynak,et al.  Maximum Entropy Models for Skin Detection , 2003, EMMCVPR.

[70]  Narendra Ahuja,et al.  Detecting human faces in color images , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[71]  Whoi-Yul Kim,et al.  A region-based shape descriptor using Zernike moments , 2000, Signal Process. Image Commun..

[72]  A. Sheikholeslami,et al.  Real-time face detection and lip feature extraction using field-programmable gate arrays , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[73]  Wang Qing,et al.  FPGA based Sobel algorithm as vehicle edge detector in VCAS , 2003, International Conference on Neural Networks and Signal Processing, 2003. Proceedings of the 2003.

[74]  Sheng Liu,et al.  An image database for benchmarking of automatic face detection and recognition algorithms , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[75]  Emmanuel Ifeachor,et al.  Digital Signal Processing: A Practical Approach , 1993 .

[76]  Rabab Kreidieh Ward,et al.  A new facial expression recognition technique using 2D DCT and k-means algorithm , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[77]  Narendra Ahuja,et al.  A SNoW-Based Face Detector , 1999, NIPS.

[78]  Ingrid Daubechies,et al.  Ten Lectures on Wavelets , 1992 .

[79]  Luc Van Gool,et al.  Recognizing color patterns irrespective of viewpoint and illumination , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[80]  Anil K. Jain,et al.  Face Detection in Color Images , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[81]  Beat Fasel,et al.  Automati Fa ial Expression Analysis: A Survey , 1999 .

[82]  Georg Pölzlbauer Survey and Comparison of Quality Measures for Self-Organizing Maps , 2004 .

[83]  Anthonio Teolis,et al.  Computational signal processing with wavelets , 1998, Applied and numerical harmonic analysis.

[84]  Harry Shum,et al.  Statistical Learning of Multi-view Face Detection , 2002, ECCV.

[85]  Peter Lee,et al.  Feature extraction algorithms using FPGA technology , 1998 .

[86]  Jan Flusser,et al.  On the independence of rotation moment invariants , 2000, Pattern Recognit..

[87]  A. N. Rajagopalan,et al.  Human Face Detection in Cluttered Color Images Using Skin Color, Edge Information , 2002, ICVGIP.

[88]  Ioannis Andreadis,et al.  Real-time computation of Zernike moments , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[89]  Narendra Ahuja,et al.  Face Detection Using Multimodal Density Models , 2001, Comput. Vis. Image Underst..

[90]  L. E. Truesdell The Census of Population , 1930 .

[91]  J. Canny A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[92]  Tony Lindeberg,et al.  Edge Detection and Ridge Detection with Automatic Scale Selection , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[93]  Hong Shan Neoh,et al.  Adaptive Edge Detection for Real-Time Video Processing using FPGAs , 2005 .

[94]  Bernt Schiele,et al.  Skin Patch Detection in Real-World Images , 2002, DAGM-Symposium.

[95]  S. Hyakin,et al.  Neural Networks: A Comprehensive Foundation , 1994 .

[96]  T. Kohonen,et al.  Exploratory Data Analysis by the Self-Organizing Map: Structures of Welfare and Poverty in the World , 1996 .

[97]  Djemel Ziou,et al.  Edge Detection Techniques-An Overview , 1998 .