Multi-gait recognition using hypergraph partition

Gait recognition is a challenging problem in computer vision, especially when multi-persons walk together, called as multi-gait recognition. Multi-gait recognition includes two aspects: participant segmentation and participant recognition. In this paper, we propose to segment each participant by hypergraph partition and recognize each participant by multi-linear canonical correlation analysis algorithm (UMCCA). Firstly, raw pixel areas are obtained by grid, and each pixel area is taken as a hypergraph vertex. Then HOG-based detection and tracking technology is used to calculate the weight of each hyperedge. After segmentation, UMCCA is used to extract gait features. Finally, identity of multi-gait is recognized. The experimental results demonstrate that our proposed method achieves good performance on multi-gait dataset.

[1]  Michael Schreckenberg,et al.  Simulation of competitive egress behavior: comparison with aircraft evacuation data , 2003 .

[2]  Wei Jia,et al.  Survey of Gait Recognition , 2009, ICIC.

[3]  Wei Lv,et al.  Analyzing pedestrian merging flow on a floor–stair interface using an extended lattice gas model , 2014, Simul..

[4]  François Fleuret,et al.  Exact Acceleration of Linear Object Detectors , 2012, ECCV.

[5]  Fumiya Iida,et al.  Morphological Computation of Multi-Gaited Robot Locomotion Based on Free Vibration , 2013, Artificial Life.

[6]  Jordi Gonzàlez,et al.  A coarse-to-fine approach for fast deformable object detection , 2011, CVPR 2011.

[7]  Xudong Jiang,et al.  Human Detection by Quadratic Classification on Subspace of Extended Histogram of Gradients , 2014, IEEE Transactions on Image Processing.

[8]  Jieping Ye,et al.  Tensor Completion for Estimating Missing Values in Visual Data , 2013, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  J. MacQueen.  Some methods for classification and analysis of multivariate observations , 1967 .

[10]  Jiwen Lu,et al.  Joint Subspace Learning for View-Invariant Gait Recognition , 2011, IEEE Signal Processing Letters.

[11]  Luc Van Gool,et al.  Online Multiperson Tracking-by-Detection from a Single, Uncalibrated Camera , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Joos Vandewalle,et al.  A Multilinear Singular Value Decomposition , 2000, SIAM J. Matrix Anal. Appl..

[13]  Pascal Fua,et al.  Ieee Transactions on Pattern Analysis and Machine Intelligence 1 Multiple Object Tracking Using K-shortest Paths Optimization , 2022 .

[14]  Luc Van Gool,et al.  SURF: Speeded Up Robust Features , 2006, ECCV.

[15]  Amnon Shashua,et al.  Probabilistic graph and hypergraph matching , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[16]  David A. McAllester,et al.  Cascade object detection with deformable part models , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[17]  Jan Feyereisl,et al.  Online Multi-target Tracking by Large Margin Structured Learning , 2012, ACCV.

[18]  Yan Zhang,et al.  Facial Expression Recognition under Partial Occlusion Based on Gabor Multi-orientation Features Fusion and Local Gabor Binary Pattern Histogram Sequence , 2013, 2013 Ninth International Conference on Intelligent Information Hiding and Multimedia Signal Processing.

[19]  Yihong Gong,et al.  Unsupervised Image Categorization by Hypergraph Partition , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Afshin Dehghan,et al.  Part-based multiple-person tracking with partial occlusion handling , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[21]  Thomas Mauthner,et al.  Occlusion Geodesics for Online Multi-object Tracking , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[22]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[23]  Iasonas Kokkinos,et al.  Rapid Deformable Object Detection using Dual-Tree Branch-and-Bound , 2011, NIPS.

[24]  Shamik Sural,et al.  Gait recognition using Pose Kinematics and Pose Energy Image , 2012, Signal Process..

[25]  Xuelong Li,et al.  General Tensor Discriminant Analysis and Gabor Features for Gait Recognition , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Junjie Yan,et al.  The Fastest Deformable Part Model for Object Detection , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[27]  Ramakant Nevatia,et al.  Detection and Tracking of Multiple, Partially Occluded Humans by Bayesian Combination of Edgelet based Part Detectors , 2007, International Journal of Computer Vision.

[28]  H. Kuhn.  The Hungarian method for the assignment problem , 1955 .

[29]  Rong Qiang Guan,et al.  Fusion Algorithm for Multi-Gait of Hexapod Bionic Rescue Robot , 2012 .

[30]  Jun Yu,et al.  Click Prediction for Web Image Reranking Using Multimodal Sparse Coding , 2014, IEEE Transactions on Image Processing.

[31]  Ramakant Nevatia,et al.  Multiple Target Tracking by Learning-Based Hierarchical Association of Detection Responses , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[32]  Cordelia Schmid,et al.  Human Detection Using Oriented Histograms of Flow and Appearance , 2006, ECCV.

[33]  Fredrik Gustafsson,et al.  Multi-target tracking with PHD filter using Doppler-only measurements , 2014, Digit. Signal Process..

[34]  Edwin R. Hancock,et al.  Hypergraph matching based on Marginalized Constrained Compatibility , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[35]  P. Krishnamurthy,et al.  A multi-gait approach for humanoid navigation in cluttered environments , 2014, The 26th Chinese Control and Decision Conference (2014 CCDC).

[36]  Serge J. Belongie,et al.  Higher order learning with graphs , 2006, ICML.

[37]  Haihong Hu,et al.  Frame difference energy image for gait recognition with incomplete silhouettes , 2009, Pattern Recognit. Lett..

[38]  Haifeng Hu,et al.  Enhanced Gabor Feature Based Classification Using a Regularized Locally Tensor Discriminant Model for Multiview Gait Recognition , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[39]  Pascal Fua,et al.  Multicamera People Tracking with a Probabilistic Occupancy Map , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[40]  W. Weng,et al.  Cellular automaton simulation of pedestrian counter flow with different walk velocities. , 2006, Physical review. E, Statistical, nonlinear, and soft matter physics.

[41]  David A. McAllester,et al.  Object Detection with Discriminatively Trained Part Based Models , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[42]  Stefan Roth,et al.  People-tracking-by-detection and people-detection-by-tracking , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[43]  De-Shuang Huang.  Emerging Intelligent Computing Technology and Applications. With Aspects of Artificial Intelligence, 5th International Conference on Intelligent Computing, ICIC 2009, Ulsan, South Korea, September 16-19, 2009, Proceedings , 2009, ICIC.

[44]  J. Rodríguez.  On the Laplacian Spectrum and Walk-regular Hypergraphs , 2003 .

[45]  Ziyang Wang,et al.  Team-moving effect in bi-direction pedestrian flow , 2012 .

[46]  Haifeng Hu,et al.  Multiview Gait Recognition Based on Patch Distribution Features and Uncorrelated Multilinear Sparse Local Discriminant Canonical Correlation Analysis , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[47]  Jing-Yu Yang,et al.  Face recognition based on the uncorrelated discriminant transformation , 2001, Pattern Recognit..

[48]  Bernhard Schölkopf,et al.  Learning with Hypergraphs: Clustering, Classification, and Embedding , 2006, NIPS.

[49]  Haiping Lu,et al.  MPCA: Multilinear Principal Component Analysis of Tensor Objects , 2008, IEEE Transactions on Neural Networks.

[50]  Tardi Tjahjadi,et al.  Gait recognition based on shape and motion analysis of silhouette contours , 2013, Comput. Vis. Image Underst..

[51]  Bir Bhanu,et al.  Individual recognition using gait energy image , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[52]  Seungdo Jeong,et al.  A framework for online gait recognition based on multilinear tensor analysis , 2012, The Journal of Supercomputing.

[53]  Pascal Fua,et al.  Making Action Recognition Robust to Occlusions and Viewpoint Changes , 2010, ECCV.

[54]  Steven Gold,et al.  Softmax to Softassign: neural network algorithms for combinatorial optimization , 1996 .