Face recognition from a moving platform via sparse representation

A video-based surveillance system for passengers includes face detection, face tracking and face recognition. In general, the final recognition result of the video-based surveillance system is usually determined by the cumulative recognition results. Under this strategy, the correctness of face tracking plays an important role for the system recognition rate. For face tracking, the challenges of face tracking on a moving platform are that the space and time information used for conventional face tracking algorithms may be lost. Consequently, conventional face tracking algorithms can barely handle the face tracking on a moving platform. In this paper, we have verified the state-of-the-art technologies for face detection, face tracking and face recognition on a moving platform. In the mean time, we also proposed a new strategy for face tracking on a moving platform or face tracking under very low frame rate. The steps of the new strategy for face detection are: (1) classification the detected faces over a certain period instead of every frame (2) Tracking of each passenger is equivalent to reconstruct the time order of certain period for each passenger. If the cumulative recognition results are the only part needed for the surveillance system, step 2 can be skipped. In addition, if the additional information from the passengers is required, such as path tracking, lip read, gesture recognition, etc, time order reconstruction in step 2 can offer the information required.

[1]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Lei Zhang,et al.  Sparse representation or collaborative representation: Which helps face recognition? , 2011, 2011 International Conference on Computer Vision.

[3]  Zihan Zhou,et al.  Towards a practical face recognition system: Robust registration and illumination by sparse representation , 2009, CVPR.

[4]  Dorin Comaniciu,et al.  Real-time tracking of non-rigid objects using mean shift , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[5]  Harold H. Szu,et al.  Re-establish the time-order across sensors of different modalities , 2011 .

[6]  Alejandro F. Frangi,et al.  Two-dimensional PCA: a new approach to appearance-based face representation and recognition , 2004 .

[7]  Tomaso A. Poggio,et al.  A general framework for object detection , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[8]  Trac D. Tran,et al.  Robust face recognition using locally adaptive sparse representation , 2010, 2010 IEEE International Conference on Image Processing.

[9]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[10]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[11]  A. G. Amitha Perera,et al.  A unified framework for tracking through occlusions and across sensor gaps , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[12]  Vincent Lepetit,et al.  Are sparse representations really relevant for image classification? , 2011, CVPR 2011.

[13]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Mei Han,et al.  A detection-based multiple object tracking method , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[15]  James J. Little,et al.  A Boosted Particle Filter: Multitarget Detection and Tracking , 2004, ECCV.

[16]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1995, EuroCOLT.

[17]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[18]  Yongsheng Gao,et al.  Face recognition across pose: A review , 2009, Pattern Recognit..

[19]  Yuxiao Hu,et al.  Face recognition using Laplacianfaces , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Paul A. Viola,et al.  Robust Real-time Object Detection , 2001 .

[21]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[22]  Anders P. Eriksson,et al.  Is face recognition really a Compressive Sensing problem? , 2011, CVPR 2011.