Algorithm for real time faces detection in 3D space

This paper presents the algorithm of stereo-faces detection in video sequences. A stereo-face is a face of a man presented by set of images obtained from different points of view. Such data can be used for faces structure estimation. Our algorithm is based on computationally effective method of face detection in mono image. Information about face positions is then combined using sparse stereo matching algorithm. Sparse means that stereo correspondence is estimated not for all scene points but only for points of interest. This allows obtaining the low computation cost of algorithm. We use few criteria to estimate correspondence. These are: epipolar constraint, size correspondence, 3D region of interest constraint and histogram correspondence. Object distance estimation method that does not use projective transformations of stereo planes is also considered.

[1]  Richard I. Hartley,et al.  In Defense of the Eight-Point Algorithm , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Alexander M. Bronstein,et al.  Three-Dimensional Face Recognition , 2005, International Journal of Computer Vision.

[3]  Matthew Turk,et al.  A Morphable Model For The Synthesis Of 3D Faces , 1999, SIGGRAPH.

[4]  Neil A. Thacker,et al.  An Evaluation of the Performance of RANSAC Algorithms for Stereo Camera Calibrarion , 2000, BMVC.

[5]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[6]  Ayoub Al-Hamadi,et al.  A Novel Method for 3D Face Detection and Normalization , 2007, J. Multim..

[7]  Joonki Paik,et al.  Face Recognition Using Optimized 3D Information from Stereo Images , 2005, ICIAR.

[8]  Berk Gökberk,et al.  3D face recognition for biometric applications , 2005, 2005 13th European Signal Processing Conference.

[9]  Zicheng Liu,et al.  Rapid modeling of animated faces from video , 2001, Comput. Animat. Virtual Worlds.