Real-time Accurate Facial Feature Corner Localization by Rule-Based Selection

We propose a coarse-to-fine approach for localizing eye and lip corners, which is accurate and robust, and can be executed in real-time. Given an image, we first detect the face and the rough initial positions of eyes and lip in the coarsest level. In the middle level, SUSAN corner detection is applied to obtain candidate corners, from which we select a best one as the facial feature corner. Finally, in the finest level, the corner is further refined by Normalized Cross-Correlation (NCC) template matching. We have tested our algorithm on the database containing over 5000 faces with various poses, expressions, occlusions and light conditions. The experimental results show that our method can successfully localize the facial feature corners with more than 20FPS, which is very appealing.

[1]  Kuo-Young Cheng,et al.  Control of Feature‐point‐driven Facial Animation Using a Hypothetical Face , 2001, Comput. Graph. Forum.

[2]  King Ngi Ngan,et al.  Locating facial region of a head-and-shoulders color image , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[3]  Qiang Ji,et al.  Active and dynamic information fusion for facial expression understanding from image sequences , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Geovanni Martinez,et al.  FACIAL FEATURE EXTRACTION BASED ON THE SMALLEST UNIVALUE SEGMENT ASSIMILATING NUCLEUS ( SUSAN ) ALGORITHM , 2004 .

[5]  Saïda Bouakaz,et al.  Feature points based facial animation retargeting , 2008, VRST '08.

[6]  Anil K. Jain,et al.  Face Detection in Color Images , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Fred Nicolls,et al.  Locating Facial Features with an Extended Active Shape Model , 2008, ECCV.

[8]  Kiyoharu Aizawa,et al.  Model-based image coding advanced video coding techniques for very low bit-rate applications , 1995, Proc. IEEE.

[9]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[10]  S. M. Steve.  SUSAN - a new approach to low level image processing , 1997 .

[11]  Zhi Liu,et al.  An efficient face segmentation algorithm based on binary partition tree , 2005, Signal Process. Image Commun..

[12]  Lijun Yin,et al.  Avatar-mediated face tracking and lip reading for human computer interaction , 2004, MULTIMEDIA '04.

[13]  Adrian F. Clark,et al.  An algorithm for face and facial-feature location based on grey-scale information and facial geometry , 1999 .

[14]  Nicu Sebe,et al.  Multimodal Human Computer Interaction: A Survey , 2005, ICCV-HCI.

[15]  Anthony V. W. Smith,et al.  Real-time facial expression recognition based on features' positions and dimensions , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[16]  Chengjun Liu,et al.  A Bayesian Discriminating Features Method for Face Detection , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Gwen Littlewort,et al.  Real Time Face Detection and Facial Expression Recognition: Development and Applications to Human Computer Interaction. , 2003, 2003 Conference on Computer Vision and Pattern Recognition Workshop.

[18]  Terence Sim,et al.  The CMU Pose, Illumination, and Expression (PIE) database , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.