Dynamic biometrics fusion at feature level for video-based human recognition

This paper proposes a novel human recognition method in video, which combines human face and gait traits using a dynamic multi-modal biometrics fusion scheme. The Fisherface approach is adopted to extract face features, while for gait features, Locality Preserving Projection (LPP) is used to achieve low-dimensional manifold embedding of the temporal silhouette data derived from image sequences. Face and gait features are fused dynamically at feature level based on a distance-driven fusion method. Encouraging experimental results are achieved on the video sequences containing 20 people, which show that dynamically fused features produce a more discriminating power than any individual biometric as well as integrated features built on common static fusion schemes.

[1]  Liang Wang,et al.  Analyzing Human Movements from Silhouettes Using Manifold Learning , 2006, 2006 IEEE International Conference on Video and Signal Based Surveillance.

[2]  Tieniu Tan,et al.  Silhouette Analysis-Based Gait Recognition for Human Identification , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Xiaoli Zhou,et al.  Feature Fusion of Face and Gait for Human Recognition at a Distance in Video , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[4]  Xiaoli Zhou,et al.  Integrating Face and Gait for Human Recognition , 2006, 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'06).

[5]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[6]  Kuldip K. Paliwal,et al.  Information Fusion and Person Verification Using Speech & Face Information , 2002 .

[7]  Trevor Darrell,et al.  On probabilistic combination of face and gait cues for identification , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[8]  Arun Ross,et al.  Score normalization in multimodal biometric systems , 2005, Pattern Recognit..

[9]  Xiaofei He,et al.  Locality Preserving Projections , 2003, NIPS.

[10]  Mark S. Nixon,et al.  On a Large Sequence-Based Human Gait Database , 2004 .