A new gait energy image based on mask processing for pedestrian gait recognition

Under a more realistic experimental setup, the performance of the existing gait recognition approaches would drop drastically. Because pedestrians are mostly under different and unknown covariate conditions. Thus, the influence caused by changes of clothing and carrying on profile of pedestrians is the main obstacle of gait recognition. In this paper, we propose a new Gait Energy Image based on mask processing (MP-GEI) to reduce the influence of covariate conditions. Firstly, we calculate the Gait Energy Image (GEI) and its synthetic average template which includes the various features of 124 subjects under different covariate conditions from five views (54°, 72°, 90°, 108°, 126°). Secondly, we propose Gait Entropy Image (GEnI) and calculate its synthetic average template (T-GEnI). Thirdly, we calculate the mask representing the dynamic feature areas in T-GEnI by setting the threshold. Finally, we use parts of the mask to remove the irrelevant gait information in GEI. In this work, we explore the performance of MP-GEI with two models based on convolution neural network (CNN), and experiments are carried out on the CASIA Dataset B. Our results demonstrate that the proposed approach achieves better correct classification rate compared with GEI when pedestrians are under different and unknown covariate conditions. In addition, using the pre-trained VGG-16 model to extract deep features for recognition is more effective than fine-tuning the pre-trained VGG-16 model.

[1]  Kiyoshi Tanaka,et al.  Clothing-invariant gait recognition using convolutional neural network , 2016, 2016 International Symposium on Intelligent Signal Processing and Communication Systems (ISPACS).

[2]  Haiping Lu,et al.  A layered deformable model for gait analysis , 2006, 7th International Conference on Automatic Face and Gesture Recognition (FGR06).

[3]  W. Eric L. Grimson,et al.  Gait analysis for recognition and classification , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[4]  J. Little,et al.  Recognizing People by Their Gait: The Shape of Motion , 1998 .

[5]  Shaogang Gong,et al.  Gait recognition without subject cooperation , 2010, Pattern Recognit. Lett..

[6]  Mark S. Nixon,et al.  What image information is important in silhouette-based gait recognition? , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[7]  Matti Pietikäinen,et al.  Performance evaluation of texture measures with classification based on Kullback discrimination of distributions , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[8]  Dimitris N. Metaxas,et al.  Human gait recognition at sagittal plane , 2007, Image Vis. Comput..

[9]  Adam Prügel-Bennett,et al.  Automatic gait recognition using area-based metric , 2003, Pattern Recognit. Lett..

[10]  Hua Li,et al.  3D gait recognition using multiple cameras , 2006, 7th International Conference on Automatic Face and Gesture Recognition (FGR06).

[11]  Bir Bhanu,et al.  Individual recognition using gait energy image , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[13]  Mark S. Nixon,et al.  Gender Classification in Human Gait Using Support Vector Machine , 2005, ACIVS.

[14]  Yunhong Wang,et al.  Cross-View Gait-Based Gender Classification by Transfer Learning , 2013, PCM.

[15]  Shaogang Gong,et al.  Gait recognition using Gait Entropy Image , 2009, ICDP.