Adaptive Fusion of Gait and Face for Human Identification in Video

Most work on multi-biometric fusion is based on static fusion rules which cannot respond to the changes of the environment and the individual users. This paper proposes adaptive multi-biometric fusion, which dynamically adjusts the fusion rules to suit the real-time external conditions. As a typical example, the adaptive fusion of gait and face in video is studied. Two factors that may affect the relationship between gait and face in the fusion are considered, i.e., the view angle and the subject-to-camera distance. Together they determine the way gait and face are fused at an arbitrary time. Experimental results show that the adaptive fusion performs significantly better than not only single biometric traits, but also those widely adopted static fusion rules including SUM, PRODUCT, MIN, and MAX.

[1]  Xiaofei He,et al.  Locality Preserving Projections , 2003, NIPS.

[2]  Arun Ross,et al.  Multibiometric systems , 2004, CACM.

[3]  Trevor Darrell,et al.  On probabilistic combination of face and gait cues for identification , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[4]  Tieniu Tan,et al.  Silhouette Analysis-Based Gait Recognition for Human Identification , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Rama Chellappa,et al.  Fusion of gait and face for human identification , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[6]  Xiaoli Zhou,et al.  Integrating Face and Gait for Human Recognition , 2006, 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'06).

[7]  Xiaoli Zhou,et al.  Integrating Face and Gait for Human Recognition at a Distance in Video , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[8]  Liang Wang,et al.  Analyzing Human Movements from Silhouettes Using Manifold Learning , 2006, 2006 IEEE International Conference on Video and Signal Based Surveillance.

[9]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.