Multi-view Multi-modal Gait Based Human Identity Recognition from Surveillance Videos

In this paper we propose a novel human-identification scheme from long range gait profiles in surveillance videos. We investigate the role of multi view gait images acquired from multiple cameras, the importance of infrared and visible range images in ascertaining identity, the impact of multimodal fusion, efficient subspace features and classifier methods, and the role of soft/secondary biometric (walking style) in enhancing the accuracy and robustness of the identification systems, Experimental evaluation of several subspace based gait feature extraction approaches (PCA/LDA) and learning classifier methods (NB/MLP/SVM/SMO) on different datasets from a publicly available gait database CASIA, show significant improvement in recognition accuracies with multimodal fusion of multi-view gait images from visible and infrared cameras acquired from video surveillance scenarios.

[1]  V. Govindaraju,et al.  Taxonomy of Behavioural Biometrics , 2010 .

[2]  A. Izenman Linear Discriminant Analysis , 2013 .

[3]  Ira Kemelmacher-Shlizerman,et al.  Face Reconstruction from a Single Image using a Single Reference Face Shape , 2009 .

[4]  Alberto Del Bimbo,et al.  3D Face Recognition Using Isogeodesic Stripes , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Achmad Basuki,et al.  A Review of Chinese Academy of Sciences (CASIA) Gait Database As a Human Gait Recognition Dataset , 2011 .

[6]  J. Platt Sequential Minimal Optimization : A Fast Algorithm for Training Support Vector Machines , 1998 .

[7]  Jiri Matas,et al.  On Combining Classifiers , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Tieniu Tan,et al.  Combining Face and Iris Biometrics for Identity Verification , 2003, AVBPA.

[9]  Zhengguang Xu,et al.  Using Ear Biometrics for Personal Recognition , 2005, IWBRS.

[10]  Sudeep Sarkar,et al.  Comparison and Combination of Ear and Face Images in Appearance-Based Biometrics , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Ahmed Bouridane,et al.  Fusion of Finger-Knuckle-Print and Palmprint for an Efficient Multi-Biometric System of Person Recognition , 2011, 2011 IEEE International Conference on Communications (ICC).

[12]  Andrew Beng Jin Teoh,et al.  Multimodal biometrics based bit extraction method for template security , 2011, 2011 6th IEEE Conference on Industrial Electronics and Applications.

[13]  Lindsay I. Smith,et al.  A tutorial on Principal Components Analysis , 2002 .

[14]  Emdad Hossain,et al.  Multimodal Identity Verification Based on Learning Face and Gait Cues , 2011, ICONIP.

[15]  Arun Ross,et al.  Information fusion in biometrics , 2003, Pattern Recognit. Lett..

[16]  Lin Huang Person recognition by feature fusion , 2011, 2011 International Conference on Computer Science and Service System (CSSS).