Digital architecture for real-time CNN-based face detection for video processing

In this paper, we propose a hardware computing architecture for face detection that classifies an image as a face or non-face. The computing architecture is first designed, modeled and tested in MATLAB Simulink using Xilinx block set and was later tested using a Virtex-6 FPGA ML605 Evaluation Kit. The system uses learned filters which were previously extracted by training on a set of face and non-face patterns. The system is fully feature based and does not require any assumptions on specific image processing techniques. The proposed approach takes an input image as a whole and passes it through different modules that apply sub-algorithms based on image convolution and sub-sampling followed by a non-linear signal processor containing artificial neurons. The architecture takes the form of a deep convolutional neural network (CNN) which can classify if a search window inside a picture contains a human face or not.

[1]  Takeshi Mita,et al.  Joint Haar-like features for face detection , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[2]  F.L. Lewis,et al.  Facial expression recognition using a two stage neural network , 2007, 2007 Mediterranean Conference on Control & Automation.

[3]  Beat Fasel.  Head-pose invariant facial expression recognition using convolutional neural networks , 2002, Proceedings. Fourth IEEE International Conference on Multimodal Interfaces.

[4]  Scott B. Baden,et al.  Accelerating Viola-Jones Face Detection to FPGA-Level Using GPUs , 2010, 2010 18th IEEE Annual International Symposium on Field-Programmable Custom Computing Machines.

[5]  Gang Hua,et al.  A convolutional neural network cascade for face detection , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Christophe Garcia,et al.  Convolutional face finder: a neural architecture for fast and robust face detection , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  T. Kuroda,et al.  A 0.79-${\hbox {mm}}^{2}$ 29-mW Real-Time Face Detection Core , 2007, IEEE Journal of Solid-State Circuits.

[8]  Fan Yang,et al.  Fast and Robust Face Detection on a Parallel Optimized Architecture Implemented on FPGA , 2009, IEEE Transactions on Circuits and Systems for Video Technology.

[9]  Takeo Kanade,et al.  Rotation invariant neural network-based face detection , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[10]  Konstantinos N. Plataniotis,et al.  Face recognition using LDA-based algorithms , 2003, IEEE Trans. Neural Networks.

[11]  Moataz M. Abdelwahab,et al.  Efficient Web-based Facial Recognition System Employing 2DHOG , 2012, ArXiv.

[12]  Narendra Ahuja,et al.  Detecting Faces in Images: A Survey , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Norbert Krüger,et al.  Face recognition by elastic bunch graph matching , 1997, Proceedings of International Conference on Image Processing.

[14]  Kuroda Tadahiro,et al.  A 0.79mm2 29mW Real-Time Face Detection Core , 2006 .

[15]  Takeo Kanade,et al.  Neural Network-Based Face Detection , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Abhishek Ranjan,et al.  Parallelizing a Face Detection and Tracking System for Multi-Core Processors , 2012, 2012 Ninth Conference on Computer and Robot Vision.

[17]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[18]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[19]  Ryan Kastner,et al.  Parallelized Architecture of Multiple Classifiers for Face Detection , 2009, 2009 20th IEEE International Conference on Application-specific Systems, Architectures and Processors.

[20]  Eldad Melamed.  Design guidelines for embedded real time face detection application , 2011 .

[21]  A. Bouzerdoum,et al.  A face detection system using shunting inhibitory convolutional neural networks , 2004, 2004 IEEE International Joint Conference on Neural Networks (IEEE Cat. No.04CH37541).

[22]  Yann LeCun,et al.  Synergistic Face Detection and Pose Estimation with Energy-Based Models , 2004, J. Mach. Learn. Res..

[23]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.

[24]  Kiran Talele,et al.  Efficient Face Detection using Adaboost , 2012 .

[25]  R. Vaillant,et al.  Original approach for the localisation of objects in images , 1994 .

[26]  V. Kshirsagar,et al.  Face recognition using Eigenfaces , 2011, 2011 3rd International Conference on Computer Research and Development.