Ieee Transactions on Pattern Analysis and Machine Intelligence 1 Matching Shape Sequences in Video with Applications in Human Movement Analysis. Ieee Transactions on Pattern Analysis and Machine Intelligence 2

We present an approach for comparing two sequences of deforming shapes using both parametric models and nonparametric methods. In our approach, Kendall's definition of shape is used for feature extraction. Since the shape feature rests on a non-Euclidean manifold, we propose parametric models like the autoregressive model and autoregressive moving average model on the tangent space and demonstrate the ability of these models to capture the nature of shape deformations using experiments on gait-based human recognition. The nonparametric model is based on dynamic time-warping. We suggest a modification of the dynamic time-warping algorithm to include the nature of the non-Euclidean space in which the shape deformations take place. We also show the efficacy of this algorithm by its application to gait-based human recognition. We exploit the shape deformations of a person's silhouette as a discriminating feature and provide recognition results using the nonparametric model. Our analysis leads to some interesting observations on the role of shape and kinematics in automated gait-based person authentication.

[1]  J. Cutting,et al.  Gait Perception as an Example of How We May Perceive Events , 1981 .

[2]  Aaron F. Bobick,et al.  Gait recognition using static, activity-specific parameters , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[3]  King-Sun Fu,et al.  Shape Discrimination Using Fourier Descriptors , 1977, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Biing-Hwang Juang,et al.  Fundamentals of speech recognition , 1993, Prentice Hall signal processing series.

[5]  Aaron F. Bobick,et al.  Modelling the effects of walking speed on appearance-based gait recognition , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[6]  Rama Chellappa,et al.  Stochastic models for closed boundary analysis: Representation and reconstruction , 1981, IEEE Trans. Inf. Theory.

[7]  Anuj Srivastava,et al.  Bayesian and geometric subspace tracking , 2004, Advances in Applied Probability.

[8]  F. Bookstein Size and Shape Spaces for Landmark Data in Two Dimensions , 1986 .

[9]  Richard A. Davis,et al.  Time Series: Theory and Methods , 2013 .

[10]  M P Murray,et al.  COMPARISON OF FREE AND FAST SPEED WALKING PATTERNS OF NORMAL MEN , 1966, American journal of physical medicine.

[11]  Robert Kohn,et al.  Representation and Self-Similarity of Shapes , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Mark S. Nixon,et al.  Gait Extraction and Description by Evidence-Gathering , 1999 .

[13]  Michael J. Black,et al.  EigenTracking: Robust Matching and Tracking of Articulated Objects Using a View-Based Representation , 1996, International Journal of Computer Vision.

[14]  Bir Bhanu,et al.  Individual recognition using gait energy image , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  F C T van der Helm,et al.  Describing gait as a sequence of states. , 2006, Journal of biomechanics.

[16]  Sven Loncaric,et al.  A survey of shape analysis techniques , 1998, Pattern Recognit..

[17]  Rama Chellappa,et al.  Role of shape and kinematics in human movement analysis , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[18]  Gene H. Golub,et al.  Matrix computations , 1983 .

[19]  Anand Rangarajan,et al.  The Softassign Procrustes Matching Algorithm , 1997, IPMI.

[20]  Stefano Soatto,et al.  Recognition of human gaits , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[21]  Stefano Soatto,et al.  Dynamic Textures , 2003, International Journal of Computer Vision.

[22]  John G. Proakis,et al.  Digital signal processing (3rd ed.): principles, algorithms, and applications , 1996 .

[23]  Remco C. Veltkamp,et al.  State of the Art in Shape Matching , 2001, Principles of Visual Information Retrieval.

[24]  Tieniu Tan,et al.  Gait recognition based on Procrustes shape analysis , 2002, Proceedings. International Conference on Image Processing.

[25]  Sudeep Sarkar,et al.  The gait identification challenge problem: data sets and baseline algorithm , 2002, Object recognition supported by user interaction for service robots.

[26]  Robert T. Collins,et al.  Silhouette-based human identification from body shape and gait , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[27]  Stefano Soatto,et al.  A model (In)validation approach to gait recognition , 2002, Proceedings. First International Symposium on 3D Data Processing Visualization and Transmission.

[28]  Stefano Soatto,et al.  Deformotion: Deforming Motion, Shape Average and the Joint Registration and Approximation of Structures in Images , 2003, International Journal of Computer Vision.

[29]  Alireza Khotanzad,et al.  Invariant Image Recognition by Zernike Moments , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[30]  Swapan K. Parui,et al.  How to discriminate shapes using the shape vector , 1986, Pattern Recognit. Lett..

[31]  Rikard Berthilsson,et al.  A Statistical Theory of Shape , 1998, SSPR/SPR.

[32]  John G. Proakis,et al.  Digital Signal Processing: Principles, Algorithms, and Applications , 1992 .

[33]  Robert Kohn,et al.  Representation and self-similarity of shapes , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[34]  A. B. Drought,et al.  WALKING PATTERNS OF NORMAL MEN. , 1964, The Journal of bone and joint surgery. American volume.

[35]  Guillermo Sapiro,et al.  Dynamic Shapes Average , 2003 .

[36]  Ming-Kuei Hu,et al.  Visual pattern recognition by moment invariants , 1962, IRE Trans. Inf. Theory.

[37]  Edward H. Adelson,et al.  Analyzing and recognizing walking figures in XYT , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[38]  Chaur-Chin Chen Improved moment invariants for shape discrimination , 1993, Pattern Recognit..

[39]  Rama Chellappa,et al.  "Shape Activity": a continuous-state HMM for moving/deforming shapes with application to abnormal activity detection , 2005, IEEE Transactions on Image Processing.

[40]  R. D. Lockhart,et al.  The Human Figure in Motion , 1957 .

[41]  Theodosios Pavlidis,et al.  A review of algorithms for shape analysis , 1978 .

[42]  G. Johansson Visual perception of biological motion and a model for its analysis , 1973 .

[43]  Anuj Srivastava,et al.  Geometric Analysis of Continuous, Planar Shapes , 2003, EMMCVPR.

[44]  Ian L. Dryden,et al.  Statistical shape analysis in high-level vision , 2003 .

[45]  Mark S. Nixon,et al.  Extraction and recognition of periodically deforming objects by continuous, spatio-temporal shape description , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[46]  Dariu Gavrila,et al.  The Visual Analysis of Human Movement: A Survey , 1999, Comput. Vis. Image Underst..

[47]  Mark S. Nixon,et al.  What image information is important in silhouette-based gait recognition? , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[48]  Aaron F. Bobick,et al.  Performance Analysis of Time-Distance Gait Parameters under Different Speeds , 2003, AVBPA.

[49]  B. Moor,et al.  Subspace angles and distances between ARMA models , 2000 .

[50]  Bart De Moor,et al.  Subspace algorithms for the stochastic identification problem, , 1993, Autom..

[51]  Adam Prügel-Bennett,et al.  Automatic gait recognition using area-based metrics , 2003 .

[52]  Narendra Ahuja,et al.  A model for dynamic shape and its applications , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[53]  H. Damasio,et al.  IEEE Transactions on Pattern Analysis and Machine Intelligence: Special Issue on Perceptual Organization in Computer Vision , 1998 .

[54]  Kanti V. Mardia,et al.  Shape changes in the plane for landmark data , 1995 .

[55]  Rama Chellappa,et al.  Identification of humans using gait , 2004, IEEE Transactions on Image Processing.

[56]  A. Ardeshir Goshtasby,et al.  Description and Discrimination of Planar Shapes Using Shape Matrices , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[57]  HARRY BLUM,et al.  Shape description using weighted symmetric axis features , 1978, Pattern Recognit..

[58]  M. Nixon,et al.  Extraction and recognition of periodically deforming objects by continuous, spatio-temporal shape description , 2004, CVPR 2004.

[59]  Kinh Tieu,et al.  Learning pedestrian models for silhouette refinement , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[60]  Herbert Freeman,et al.  On the Encoding of Arbitrary Geometric Configurations , 1961, IRE Trans. Electron. Comput..

[61]  Aaron F. Bobick,et al.  Modelling the effects of walking speed on appearance-based gait recognition , 2004, CVPR 2004.

[62]  Payam Saisan,et al.  Gait recognition using dynamic affine invariants , 2004 .

[63]  Robert T. Collins,et al.  Gait Shape Estimation for Identification , 2003, AVBPA.

[64]  J. Cutting,et al.  Recognizing friends by their walk: Gait perception without familiarity cues , 1977 .

[65]  E. Klassen Bayesian, Geometric Subspace Tracking , 2002 .

[66]  D. Kendall SHAPE MANIFOLDS, PROCRUSTEAN METRICS, AND COMPLEX PROJECTIVE SPACES , 1984 .

[67]  Esther M. Arkin,et al.  An efficiently computable metric for comparing polygonal shapes , 1991, SODA '90.