Estimating 3D Facial Shape and Motion from Stereo Image Using Active Appearance Models with Stereo Constraints

This paper proposes a new fitting algorithm which we call Stereo Active Appearance Model (STAAM). This algorithm fits a 2D+3D Active Appearance Model to stereo images acquired from calibrated vision system and computes the 3D shape and rigid motion parameters. The use of calibration information reduces the number of model parameters, restricts the degree of freedom in the model parameters, and increases the accuracy and speed of fitting. Moreover, the STAAM uses a modified inverse compositional simultaneous update fitting algorithm to reduce the fitting computation greatly. Experimental results show that (1) the modified inverse compositional simultaneous update algorithm accelerates the AAM fitting speed while keeping its fitting accuracy, (2) the STAAM improves fitting stability using calibration information.

[1]  Jing Xiao,et al.  Robust full-motion recovery of head by dynamic templates and re-registration techniques , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[2]  McElory Hoffmann,et al.  PFAAM An Active Appearance Model based Particle Filter for both Robust and Precise Tracking , 2007, Fourth Canadian Conference on Computer and Robot Vision (CRV '07).

[3]  Jörgen Ahlberg.  Using the active appearance algorithm for face and facial feature tracking , 2001, Proceedings IEEE ICCV Workshop on Recognition, Analysis, and Tracking of Faces and Gestures in Real-Time Systems.

[4]  Franck Davoine,et al.  Facial action tracking using particle filters and active appearance models , 2005, sOc-EUSAI '05.

[5]  Timothy F. Cootes,et al.  Interpreting face images using active appearance models , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[6]  Jing Xiao,et al.  Multi-view AAM fitting and camera calibration , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[7]  Simon Baker,et al.  Lucas-Kanade 20 Years On: A Unifying Framework , 2004, International Journal of Computer Vision.

[8]  Shaogang Gong,et al.  Modelling faces dynamically across views and over time , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[9]  Jing Xiao,et al.  Fitting a Single Active Appearance Model Simultaneously to Multiple Images , 2004, BMVC.

[10]  Timothy F. Cootes,et al.  Active Appearance Models , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Takeo Kanade,et al.  Real-time combined 2D+3D active appearance models , 2004, CVPR 2004.

[12]  Simon Baker,et al.  Active Appearance Models Revisited , 2004, International Journal of Computer Vision.