Embedded facial image processing with Convolutional Neural Networks

This paper presents an embedded facial image analysis framework based on Convolutional Neural Networks (ConvNets). This robust framework has been proposed by Garcia, Delakis and Duffner on general purpose workstations without any constraints on computational and memory resources. We show that ConvNets, which consist of a pipeline of convolution and subsampling operations followed by a Multi Layer Perceptron, are particularly well suited for implementation on embedded processors. We present a set of high-level optimizations, such as automatic fractional transformation, convolution and subsam-pling fusion and memory requirement optimizations that can be applied to these algorithms without any loss in performance, leading to a speedup factor up to 700 compared to the reference implementation. This work leads to a face processing library able to handle the complete framework and its applications on mobile phones.

[1]  A. Murat Tekalp,et al.  Face detection and facial feature extraction using color, shape and symmetry-based cost functions , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[2]  Christophe Garcia,et al.  Convolutional face finder: a neural architecture for fast and robust face detection , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Tomaso A. Poggio,et al.  Example-Based Learning for View-Based Human Face Detection , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Seok-Cheol Kee,et al.  A fast and robust face detection based on module switching network , 2004, Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings..

[5]  Erik Hjelmås,et al.  Face Detection: A Survey , 2001, Comput. Vis. Image Underst..

[6]  Roberto Brunelli,et al.  Face Recognition: Features Versus Templates , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[8]  Takeo Kanade,et al.  Neural Network-Based Face Detection , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Christophe Garcia,et al.  Robust Face Alignment Using Convolutional Neural Networks , 2018, VISAPP.

[10]  Stefan Duffner,et al.  Facial Image Processing with Convolutional Neural Networks , 2007 .

[11]  Ning Xi,et al.  A Hierarchical FloatBoost and MLP Classifier for Mobile Phone Embedded Eye Location System , 2006, ISNN.

[12]  S. Duffner,et al.  An Embedded Robust Facial Feature Detector , 2007, 2007 IEEE Workshop on Machine Learning for Signal Processing.

[13]  Andrew Bateman,et al.  The DSP Handbook: Algorithms, Applications and Design Techniques , 2002 .

[14]  S. Duffner,et al.  A connexionist approach for robust and precise facial feature detection in complex scenes , 2005, ISPA 2005. Proceedings of the 4th International Symposium on Image and Signal Processing and Analysis, 2005..

[15]  Narendra Ahuja,et al.  Detecting Faces in Images: A Survey , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Christophe Garcia,et al.  Real-Time Video Convolutional Face Finder on Embedded Platforms , 2007, EURASIP J. Embed. Syst..

[17]  Johel Mitéran,et al.  Cascade Boosting-Based Object Detection from High-Level Description to Hardware Implementation , 2009, EURASIP J. Embed. Syst..

[18]  Theocharis Theocharides,et al.  Embedded hardware face detection for digital surveillance systems , 2006 .

[19]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[20]  Pengfei Zhao,et al.  Cascade AdaBoost Classifiers with Stage Features Optimization for Cellular Phone Embedded Face Detection System , 2005, ICNC.

[21]  Timothy F. Cootes,et al.  Locating faces using statistical feature detectors , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.