Accelerating Active Shape Model using GPU for facial extraction in video

We present a novel parallel implementation of Active Shape Model (ASM) on GPU for massive facial feature extractions in video or image sequence. With the Compute Unified Device Architecture (CUDA)-enabled GPU, the acceleration is significant and reported a 48 times performance boost comparing to a CPU implementation. We adopt the hardware built-in bilinear interpolation of texture to shorten the time for a large number of image scale transform operations. Then, a GPU-based parallel mahalanobis distance calculation is introduced in the searching process, and this enables most of the computations to be performed simultanously. As a result, we can achieve real-time performance in our video-driven 3D facial animation system.

[1]  Timothy F. Cootes,et al.  Active Shape Models-Their Training and Application , 1995, Comput. Vis. Image Underst..

[2]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[3]  Kazuhiro Otsuka,et al.  Simultaneous and fast 3D tracking of multiple faces in video by GPU-based stream processing , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[4]  D. Zhang,et al.  Principle Component Analysis , 2004 .

[5]  Timothy F. Cootes,et al.  Statistical models of appearance for computer vision , 1999 .

[6]  Timothy F. Cootes,et al.  Active shape models , 1998 .

[7]  Calyampudi R. Rao,et al.  Linear Statistical Inference and Its Applications. , 1975 .

[8]  Jyh‐Yeong Chang,et al.  Automated facial expression recognition system using neural networks , 2001 .

[9]  N. L. Johnson,et al.  Linear Statistical Inference and Its Applications , 1966 .

[10]  Timothy F. Cootes,et al.  Active Shape Models: Evaluation of a Multi-Resolution Method for Improving Image Search , 1994, BMVC.

[11]  Sun Da.  Feature-Based Face Recognition by Elastic Graph Matching , 2002 .

[12]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[13]  Tony F. Chan,et al.  Image processing and analysis , 2005 .

[14]  Nicholas Ayache,et al.  Fast segmentation, tracking, and analysis of deformable objects , 1993, 1993 (4th) International Conference on Computer Vision.

[15]  H. Deutsch.  Principle Component Analysis , 2004 .