Tracking and Recognition of Multiple Faces at Distances

Many applications require tracking and recognition of multiple faces at distances, such as in video surveillance. Such a task, dealing with noncooperative objects is more challenging than handling a single face and than tackling a cooperative user. The difficulties include mutual occlusions of multiple faces and arbitrary head poses. In this paper, we present a method for solving the problems and a real-time system implementation. An appearance model updating mechanism is developed via Gaussian Mixture Models to deal with tracking under head rotation and mutual occlusion. Face recognition based on video sequence is then performed to get the identity information. Through fusing the tracking and recognition information, the performance of them are both improved. A real-time system for multi-face tracking and recognition at distances is presented. The system can track multiple faces under head rotations, and deal with total occlusion effectively regardless of the motion trajectory. It is also able to recognize multi-persons simultaneously. Experimental results demonstrate promising performance of the system.

[1]  PietikainenMatti,et al.  Face Description with Local Binary Patterns , 2006 .

[2]  Azriel Rosenfeld,et al.  Face recognition: A literature survey , 2003, CSUR.

[3]  Matti Pietikäinen,et al.  Face Description with Local Binary Patterns: Application to Face Recognition , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  S. Li,et al.  Ëøøò º Ä ½ ¸ä Ó Ò Ù ½ ¸òééù Òò ¾ ¸ Òòööû Ððð ¿ Àóòòâââòò Òò ½ ¸ Ààööý Ëëùñ ½ ½ Åååöó×óóø Ê×××öö ×׸òò¸òò Statistical Learning of Multi-view Face Detection , 2002 .

[5]  Farzin Mokhtarian,et al.  Towards robust head tracking by particles , 2005, IEEE International Conference on Image Processing 2005.

[6]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[7]  J. Elder,et al.  Towards Face Recognition at a Distance , 2006 .

[8]  Linda G. Shapiro,et al.  Computer and Robot Vision , 1991 .

[9]  Quan Pan,et al.  Reliable and fast tracking of faces under varying pose , 2006, 7th International Conference on Automatic Face and Gesture Recognition (FGR06).

[10]  Yuan-Fang Wang,et al.  Real-time multiperson tracking in video surveillance , 2003, Fourth International Conference on Information, Communications and Signal Processing, 2003 and the Fourth Pacific Rim Conference on Multimedia. Proceedings of the 2003 Joint.

[11]  Paul A. Viola,et al.  Robust Real-time Object Detection , 2001 .

[12]  Shaogang Gong,et al.  Face Recognition in Dynamic Scenes , 1997, BMVC.

[13]  Maolin Chen,et al.  Head tracking with shape modeling and detection , 2005, The 2nd Canadian Conference on Computer and Robot Vision (CRV'05).

[14]  Thomas S. Huang,et al.  Image processing , 1971 .

[15]  Stanley T. Birchfield,et al.  Elliptical head tracking using intensity gradients and color histograms , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[16]  Alex Pentland,et al.  A Bayesian similarity measure for direct image matching , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[17]  Charay Lerdsudwichai,et al.  Tracking multiple people with recovery from partial and total occlusion , 2005, Pattern Recognit..

[18]  Shengcai Liao,et al.  Illumination Invariant Face Recognition Using Near-Infrared Images , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Harry Shum,et al.  Statistical Learning of Multi-view Face Detection , 2002, ECCV.