The AVA Multi-View Dataset for Gait Recognition

In this paper, we introduce a new multi-view dataset for gait recognition. The dataset was recorded in an indoor scenario, using six convergent cameras setup to produce multi-view videos, where each video depicts a walking human. Each sequence contains at least 3 complete gait cycles. The dataset contains videos of 20 walking persons with a large variety of body size, who walk along straight and curved paths. The multi-view videos have been processed to produce foreground silhouettes. To validate our dataset, we have extended some appearance-based 2D gait recognition methods to work with 3D data, obtaining very encouraging results. The dataset, as well as camera calibration information, is freely available for research purposes.

[1]  Marc Van Droogenbroeck,et al.  Frontal-view gait recognition by intra- and inter-frame rectangle size distribution , 2009, Pattern Recognit. Lett..

[2]  Ronen Basri,et al.  Actions as space-time shapes , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[3]  Tieniu Tan,et al.  A Framework for Evaluating the Effect of View Angle, Clothing and Carrying Condition on Gait Recognition , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[4]  Nikolaos V. Boulgouris,et al.  Gait Recognition With Shifted Energy Image and Structural Feature Extraction , 2012, IEEE Transactions on Image Processing.

[5]  Osama Masoud,et al.  View-independent human motion classification using image-based reconstruction , 2009, Image Vis. Comput..

[6]  Adrian Kaehler,et al.  Learning OpenCV 3: Computer Vision in C++ with the OpenCV Library , 2016 .

[7]  Francisco José Madrid-Cuevas,et al.  Automatic generation and detection of highly reliable fiducial markers under occlusion , 2014, Pattern Recognit..

[8]  Tardi Tjahjadi,et al.  Gait recognition based on shape and motion analysis of silhouette contours , 2013, Comput. Vis. Image Underst..

[9]  Bir Bhanu,et al.  Individual recognition using gait energy image , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Shaogang Gong,et al.  Gait recognition without subject cooperation , 2010, Pattern Recognit. Lett..

[11]  Shamik Sural,et al.  Gait Recognition in the Presence of Occlusion: A New Dataset and Baseline Algorithms , 2011 .

[12]  Bogdan Kwolek,et al.  View Independent Human Gait Recognition Using Markerless 3D Human Motion Capture , 2012, ICCVG.

[13]  Qiang Wu,et al.  Multiple views gait recognition using View Transformation Model based on optimized Gait Energy Image , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.

[14]  Du Tran,et al.  Human Activity Recognition with Metric Learning , 2008, ECCV.

[15]  Mark S. Nixon,et al.  On a Large Sequence-Based Human Gait Database , 2004 .

[16]  Tieniu Tan,et al.  Human identification based on gait , 2005, The Kluwer international series on biometrics.

[17]  Barbara Caputo,et al.  Recognizing human actions: a local SVM approach , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[18]  Ioannis Pitas,et al.  The i3DPost Multi-View and 3D Human Action/Interaction Database , 2009, 2009 Conference for Visual Media Production.

[19]  Francisco José Madrid-Cuevas,et al.  Shape from silhouette using Dempster-Shafer theory , 2010, Pattern Recognit..

[20]  Mark S. Nixon,et al.  Self-Calibrating View-Invariant Gait Biometrics , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[21]  Ralph Gross,et al.  The CMU Motion of Body (MoBo) Database , 2001 .

[22]  Tieniu Tan,et al.  Efficient Night Gait Recognition Based on Template Matching , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[23]  Tieniu Tan,et al.  A survey on visual surveillance of object motion and behaviors , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[24]  Hossein Ragheb,et al.  MuHAVi: A Multicamera Human Action Video Dataset for the Evaluation of Action Recognition Methods , 2010, 2010 7th IEEE International Conference on Advanced Video and Signal Based Surveillance.

[25]  Larry S. Davis,et al.  A Robust Background Subtraction and Shadow Detection , 1999 .

[26]  Sudeep Sarkar,et al.  The humanID gait challenge problem: data sets, performance, and analysis , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Gary R. Bradski,et al.  Learning OpenCV - computer vision with the OpenCV library: software that sees , 2008 .

[28]  Andrew J. Davison,et al.  Active Matching , 2008, ECCV.

[29]  Qiang Wu,et al.  Gait Recognition Under Various Viewing Angles Based on Correlated Motion Regression , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[30]  Yasushi Makihara,et al.  The OU-ISIR Gait Database Comprising the Treadmill Dataset , 2012, IPSJ Trans. Comput. Vis. Appl..

[31]  Alan W. C. Tan,et al.  Gait recognition via optimally interpolated deformable contours , 2013, Pattern Recognit. Lett..

[32]  Tieniu Tan,et al.  Silhouette Analysis-Based Gait Recognition for Human Identification , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[33]  Rémi Ronfard,et al.  Free viewpoint action recognition using motion history volumes , 2006, Comput. Vis. Image Underst..

[34]  Rita Cucchiara,et al.  Video Surveillance Online Repository (ViSOR): an integrated framework , 2010, Multimedia Tools and Applications.

[35]  Jiwen Lu,et al.  Uncorrelated discriminant simplex analysis for view-invariant gait signal computing , 2010, Pattern Recognit. Lett..

[36]  Ryszard Tadeusiewicz,et al.  Computer Vision and Graphics , 2014, Lecture Notes in Computer Science.

[37]  Shamik Sural,et al.  Gait recognition using Pose Kinematics and Pose Energy Image , 2012, Signal Process..

[38]  Ryo Kurazume,et al.  Identification of people walking along curved trajectories , 2014, Pattern Recognit. Lett..

[39]  Wei Zeng,et al.  Human gait recognition via deterministic learning , 2012, Neural Networks.