Towards view-invariant gait modeling: Computing view-normalized body part trajectories

This paper proposes an approach to compute view-normalized body part trajectories of pedestrians walking on potentially non-linear paths. The proposed approach finds applications in gait modeling, gait biometrics, and in medical gait analysis. Our approach uses the 2D trajectories of both feet and the head extracted from the tracked silhouettes. On that basis, it computes the apparent walking (sagittal) planes for each detected gait half-cycle. A homography transformation is then computed for each walking plane to make it appear as if walking was observed from a fronto-parallel view. Finally, each homography is applied to head and feet trajectories over each corresponding gait half-cycle. View normalization makes head and feet trajectories appear as if seen from a fronto-parallel viewpoint, which is assumed to be optimal for gait modeling purposes. The proposed approach is fully automatic as it requires neither manual initialization nor camera calibration. An extensive experimental evaluation of the proposed approach confirms the validity of the normalization process.

[1]  P. Shekelle,et al.  Detection and Management of Falls and Instability in Vulnerable Elders by Community Physicians , 2004, Journal of the American Geriatrics Society.

[2]  Dimitris N. Metaxas,et al.  Human Gait Recognition , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[3]  Murray Mp,et al.  Gait as a total pattern of movement. , 1967 .

[4]  Herman Buschke,et al.  Abnormality of gait as a predictor of non-Alzheimer's dementia. , 2002, The New England journal of medicine.

[5]  John K. Tsotsos,et al.  Automatic detection of abnormal gait , 2009, Image Vis. Comput..

[6]  Fabio Cuzzolin Using Bilinear Models for View-invariant Action and Identity Recognition , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[7]  M. P. Murray Gait as a total pattern of movement. , 1967, American journal of physical medicine.

[8]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[9]  J. Cutting,et al.  Gait Perception as an Example of How We May Perceive Events , 1981 .

[10]  Larry S. Davis,et al.  EigenGait: Motion-Based Recognition of People Using Image Self-Similarity , 2001, AVBPA.

[11]  James W. Davis,et al.  Multiview fusion for canonical view generation based on homography constraints , 2006, VSSN '06.

[12]  Sudeep Sarkar,et al.  Improved gait recognition by gait dynamics normalization , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Stefano Soatto,et al.  Recognition of human gaits , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[14]  Matthias R. Lemke,et al.  Segmentation of Behavior and Time Structure of Movements in Depressed Patients , 2000, Psychopathology.

[15]  Aaron F. Bobick,et al.  Action recognition using probabilistic parsing , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[16]  Yasushi Makihara,et al.  Adaptation to Walking Direction Changes for Gait Identification , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[17]  Tieniu Tan,et al.  Modelling the Effect of View Angle Variation on Appearance-Based Gait Recognition , 2006, ACCV.

[18]  John N. Carter,et al.  Towards pose invariant gait reconstruction , 2005, IEEE International Conference on Image Processing 2005.

[19]  Yasushi Makihara,et al.  Which Reference View is Effective for Gait Identification Using a View Transformation Model? , 2006, 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'06).

[20]  Mark S. Nixon,et al.  What image information is important in silhouette-based gait recognition? , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[21]  Tieniu Tan,et al.  Gait analysis for human identification in frequency domain , 2004, Third International Conference on Image and Graphics (ICIG'04).

[22]  Robert Bergevin,et al.  Body tracking in human walk from monocular video sequences , 2005, The 2nd Canadian Conference on Computer and Robot Vision (CRV'05).

[23]  G. Johansson Visual perception of biological motion and a model for its analysis , 1973 .

[24]  Rama Chellappa,et al.  Role of shape and kinematics in human movement analysis , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[25]  Aaron F. Bobick,et al.  A Multi-view Method for Gait Recognition Using Static Body Parameters , 2001, AVBPA.

[26]  Rama Chellappa,et al.  Towards a view invariant gait recognition algorithm , 2003, Proceedings of the IEEE Conference on Advanced Video and Signal Based Surveillance, 2003..

[27]  Steve McLaughlin,et al.  Comparative study of textural analysis techniques to characterise tissue from intravascular ultrasound , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[28]  Robert Bergevin,et al.  Trajectories normalization for viewpoint invariant gait recognition , 2008, 2008 19th International Conference on Pattern Recognition.

[29]  Ahmed M. Elgammal,et al.  Towards Scalable View-Invariant Gait Recognition: Multilinear Analysis for Gait , 2005, AVBPA.

[30]  Andrew Zisserman,et al.  Multiple View Geometry , 1999 .

[31]  Mubarak Shah,et al.  Establishing motion correspondence , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[32]  Bir Bhanu,et al.  Statistical feature fusion for gait-based human recognition , 2004, CVPR 2004.

[33]  Xu Han,et al.  Gait Recognition Considering Directions of Walking , 2006, 2006 IEEE Conference on Cybernetics and Intelligent Systems.

[34]  Andrew Zisserman,et al.  Multiple view geometry in computer visiond , 2001 .

[35]  Mark S. Nixon,et al.  Markerless Human Gait Analysis via Image Sequences , 2003 .

[36]  Michael Hild Estimation of 3D motion trajectory and velocity from monocular image sequences in the context of human gait recognition , 2004, ICPR 2004.

[37]  Larry S. Davis,et al.  View-invariant Estimation of Height and Stride for Gait Recognition , 2002, Biometric Authentication.

[38]  Liang Wang,et al.  Abnormal Walking Gait Analysis Using Silhouette-Masked Flow Histograms , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[39]  Aaron F. Bobick,et al.  Gait recognition using static, activity-specific parameters , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[40]  K. S. Arun,et al.  Least-Squares Fitting of Two 3-D Point Sets , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[41]  Bir Bhanu,et al.  Performance prediction for individual recognition by gait , 2005, Pattern Recognit. Lett..

[42]  Larry S. Davis,et al.  Person identification using automatic height and stride estimation , 2002, Object recognition supported by user interaction for service robots.

[43]  Andrew Zisserman,et al.  Multiple View Geometry in Computer Vision (2nd ed) , 2003 .