3-D model assisted facial error concealment technique using regenerative particle filter based tracking

This paper proposes a novel approach for error concealment in corrupted frames, using the Candide 3.0 face model. In head and shoulder video sequences, for example in live chats and video conferencing, error concealment performance may be improved using methods that are specifically designed to handle the structural details of the human face. The proposed approach uses perspective projection to adapt the model onto the face in the video and then performs tracking using regenerative particle filters. The pixel information from past frames is transformed into the current (corrupted) frame through this model. The simulation results are promising.

[1]  Ming-Hsuan Yang,et al.  Adaptive Probabilistic Visual Tracking with Incremental Subspace Update , 2004, ECCV.

[2]  Jae-Young Pyun.  Error concealment aware streaming video system over packet-based mobile networks , 2008, IEEE Transactions on Consumer Electronics.

[3]  Bo Yan,et al.  A Hybrid Frame Concealment Algorithm for H.264/AVC , 2010, IEEE Transactions on Image Processing.

[4]  Markus Kampmann.  Automatic 3-D face model adaptation for model-based coding of videophone sequences , 2002, IEEE Trans. Circuits Syst. Video Technol..

[5]  Liu Da.  The Error Concealment Feature in the H.26L Test Model , 2003 .

[6]  Liang Zhang,et al.  Estimation of eye and mouth corner point positions in a knowledge-based coding system , 1996, Other Conferences.

[7]  Alan L. Yuille,et al.  Feature extraction from faces using deformable templates , 2004, International Journal of Computer Vision.

[8]  Somnath Sengupta,et al.  Hybrid temporal/spatial error concealment strategy robust to scene transitions , 2011, Proceedings of 2011 IEEE Pacific Rim Conference on Communications, Computers and Signal Processing.

[9]  Markus Kampmann.  Estimation of the chin and cheek contours for precise face model adaptation , 1997, Proceedings of International Conference on Image Processing.

[10]  Patrick Pérez,et al.  Color-Based Probabilistic Tracking , 2002, ECCV.

[11]  Jörgen Ahlberg.  AN UPDATED PARAMETERISED FACE , 2001 .

[12]  Liang Zhang,et al.  Automatic adaptation of a face model using action units for semantic coding of videophone sequences , 1998, IEEE Trans. Circuits Syst. Video Technol..

[13]  Oscar C. Au,et al.  Edge-Directed Error Concealment , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[14]  Liang Zhang,et al.  Estimation of the mouth features using deformable templates , 1997, Proceedings of International Conference on Image Processing.