3D head pose tracking using a particle filter with nose template matching

In this paper, we propose a real-time tracking method for driver's head pose in real vehicle environment by using multiple NIR cameras. In order to achieve real-time performance and high-accuracy, 6-DOF of head pose is estimated by a particle filter with restricted state space. Firstly, the 3D position of nose hole is measured by template matching of stereo images. Because nose hole is the most dark area in the captured NIR images, we can robustly detect the position of the nose very precisely. From the 3D position of the nose, we can estimate the head pose as an initial estimate. Then, each hypothesis is updated by prior probability with a constraint of nose position. Thus it can reduce the number of particles with maintained accuracy. The experimental results indicate that this method is effective for head pose tracking.

[1]  Mohan M. Trivedi,et al.  Robust real-time detection, tracking, and pose estimation of faces in video streams , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[2]  Alexander Zelinsky,et al.  An algorithm for real-time stereo vision implementation of head pose and gaze direction measurement , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[3]  Andrew Blake,et al.  A Probabilistic Exclusion Principle for Tracking Multiple Objects , 2004, International Journal of Computer Vision.

[4]  Takeo Kanade,et al.  Real-time combined 2D+3D active appearance models , 2004, CVPR 2004.

[5]  Michael Isard,et al.  CONDENSATION—Conditional Density Propagation for Visual Tracking , 1998, International Journal of Computer Vision.

[6]  Shunji Katahara,et al.  Motion Estimation of Driver's Head from Nostrils Detection , 2002 .

[7]  Zhengyou Zhang,et al.  Flexible camera calibration by viewing a plane from unknown orientations , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[8]  Berthold K. P. Horn,et al.  Closed-form solution of absolute orientation using unit quaternions , 1987 .

[9]  M. Pitt,et al.  Filtering via Simulation: Auxiliary Particle Filters , 1999 .

[10]  Yoichi Sato,et al.  Head Pose Estimation System Based on Particle Filtering with Adaptive Diffusion Control , 2005, MVA.

[11]  Dmitry O. Gorodnichy,et al.  On importance of nose for face tracking , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.