An Embedded Robust Facial Feature Detector

In this paper, we present a robust and optimized facial feature detector algorithm which meets the constraints of embedded processors allowing facial feature based services on mobile terminals, such as teleconferencing, advanced user interface, image indexing and security access control. The studied facial feature detector is based on convolutional neural networks, a feature extraction and classification technique which consists of a pipeline of convolution and sub-sampling operations, followed by a multi layer perceptron. The design of embedded systems requires a good trade off between performance and code size due to the limited amount of available resources. We show that such convolutional neural network can efficiently avoid any floating-point computation without any loss in performance. We also propose several algorithmic optimizations to reduce the complexity of the algorithm and avoid common drawbacks of embedded applications such as miss-caches. Experimental results show that our embedded facial feature detection system can accurately locate facial feature with less computational load. It is able to process up to 12 faces/s on an Xscale PXA27x embedded processor @ 624MHz, which represents a speed-up factor of 700 compared to the reference floating point implementation.

[1]  Narendra Ahuja,et al.  Detecting Faces in Images: A Survey , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Bernhard Fröba,et al.  Orientation Template Matching for Face Localization in Complex Visual Scenes , 2000, ICIP.

[3]  Christophe Garcia,et al.  Embedded Convolutional Face Finder , 2006, 2006 IEEE International Conference on Multimedia and Expo.

[4]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[5]  Yang Wang,et al.  Facial Feature Tracking using a Multi-State Hierarchical Shape Model under Varying Face Pose and Facial Expression , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[6]  Zhiwei Zhu,et al.  Robust Pose Invariant Facial Feature Detection and Tracking in Real-Time , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[7]  Andrew Bateman,et al.  The DSP Handbook: Algorithms, Applications and Design Techniques , 2002 .

[8]  T Koga,et al.  MOTION COMPENSATED INTER-FRAME CODING FOR VIDEO CONFERENCING , 1981 .

[9]  Alex Pentland,et al.  Probabilistic Visual Learning for Object Representation , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Marcel J. T. Reinders,et al.  Locating facial features in image sequences using neural networks , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[11]  Timothy F. Cootes,et al.  Active Appearance Models , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Terence Sim,et al.  The CMU Pose, Illumination, and Expression (PIE) database , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[13]  John A. Nelder,et al.  A Simplex Method for Function Minimization , 1965, Comput. J..

[14]  Luca Benini,et al.  Source code optimization and profiling of energy consumption in embedded systems , 2000, ISSS '00.

[15]  Fei Zuo,et al.  Real-time face recognition for smart home applications , 2005, 2005 Digest of Technical Papers. International Conference on Consumer Electronics, 2005. ICCE..

[16]  Harry Wechsler,et al.  The FERET database and evaluation procedure for face-recognition algorithms , 1998, Image Vis. Comput..

[17]  Christophe Garcia,et al.  Convolutional face finder: a neural architecture for fast and robust face detection , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Jingying Chen,et al.  A robust facial feature tracking system , 2005, IEEE Conference on Advanced Video and Signal Based Surveillance, 2005..

[19]  Jian-Gang Wang,et al.  Frontal-view face detection and facial feature extraction using color and morphological operations , 1999, Pattern Recognit. Lett..

[20]  S. Duffner,et al.  A connexionist approach for robust and precise facial feature detection in complex scenes , 2005, ISPA 2005. Proceedings of the 4th International Symposium on Image and Signal Processing and Analysis, 2005..

[21]  Timothy F. Cootes,et al.  A comparison of shape constrained facial feature detectors , 2004, Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings..