Computing and evaluating view-normalized body part trajectories

This paper proposes an approach to compute and evaluate view-normalized body part trajectories of pedestrians from monocular video sequences. The proposed approach uses the 2D trajectories of both feet and of the head extracted from the tracked silhouettes. On that basis, it segments the walking trajectory into piecewise linear segments. Finally, a normalization process is applied to head and feet trajectories over each obtained straight walking segment. View normalization makes head and feet trajectories appear as if seen from a fronto-parallel viewpoint. The latter is assumed to be optimal for gait modeling and identification purposes. The proposed approach is fully automatic as it requires neither manual initialization nor camera calibration. An extensive experimental evaluation of the proposed approach confirms the validity of the normalization process.

[1]  K. S. Arun,et al.  Least-Squares Fitting of Two 3-D Point Sets , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Z. Zivkovic Improved adaptive Gaussian mixture model for background subtraction , 2004, ICPR 2004.

[3]  Michael Hild Estimation of 3D motion trajectory and velocity from monocular image sequences in the context of human gait recognition , 2004, ICPR 2004.

[4]  Larry S. Davis,et al.  View-invariant Estimation of Height and Stride for Gait Recognition , 2002, Biometric Authentication.

[5]  Aaron F. Bobick,et al.  Gait recognition from time-normalized joint-angle trajectories in the walking plane , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[6]  James W. Davis,et al.  Multiview fusion for canonical view generation based on homography constraints , 2006, VSSN '06.

[7]  Bir Bhanu,et al.  Performance prediction for individual recognition by gait , 2005, Pattern Recognit. Lett..

[8]  Dimitris N. Metaxas,et al.  Human Gait Recognition , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[9]  Fabio Cuzzolin Using Bilinear Models for View-invariant Action and Identity Recognition , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[10]  Stefano Soatto,et al.  Recognition of human gaits , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[11]  Takeo Kanade,et al.  Introduction to the Special Section on Video Surveillance , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Robert Bergevin,et al.  Computing View-normalized Body Parts Trajectories , 2007, Fourth Canadian Conference on Computer and Robot Vision (CRV '07).

[13]  Ahmed M. Elgammal,et al.  Towards Scalable View-Invariant Gait Recognition: Multilinear Analysis for Gait , 2005, AVBPA.

[14]  Sudeep Sarkar,et al.  The humanID gait challenge problem: data sets, performance, and analysis , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Dar-Shyang Lee,et al.  Effective Gaussian mixture learning for video background subtraction , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Rama Chellappa,et al.  Towards a view invariant gait recognition algorithm , 2003, Proceedings of the IEEE Conference on Advanced Video and Signal Based Surveillance, 2003..

[17]  John N. Carter,et al.  Towards pose invariant gait reconstruction , 2005, IEEE International Conference on Image Processing 2005.

[18]  Xu Han,et al.  Gait Recognition Considering Directions of Walking , 2006, 2006 IEEE Conference on Cybernetics and Intelligent Systems.

[19]  Aaron F. Bobick,et al.  A Multi-view Method for Gait Recognition Using Static Body Parameters , 2001, AVBPA.

[20]  Pascal Fua,et al.  3D tracking for gait characterization and recognition , 2004, Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings..

[21]  Tieniu Tan,et al.  Gait analysis for human identification in frequency domain , 2004, Third International Conference on Image and Graphics (ICIG'04).

[22]  Amit K. Roy-Chowdhury,et al.  GAIT-BASED HUMAN IDENTIFICATION FROM A MONOCULAR VIDEO SEQUENCE , 2003 .

[23]  M. P. Murray Gait as a total pattern of movement. , 1967, American journal of physical medicine.

[24]  Mark S. Nixon,et al.  Markerless Human Gait Analysis via Image Sequences , 2003 .

[25]  Edward Y. Chang,et al.  Proceedings of the third ACM international workshop on Video surveillance & sensor networks , 2005 .

[26]  Zoran Zivkovic,et al.  Improved adaptive Gaussian mixture model for background subtraction , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[27]  Larry S. Davis,et al.  W4: Real-Time Surveillance of People and Their Activities , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[28]  Marc Parizeau,et al.  MONNET: Monitoring Pedestrians with a Network of Loosely-Coupled Cameras , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[29]  Yasushi Makihara,et al.  Adaptation to Walking Direction Changes for Gait Identification , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[30]  Richard O. Duda,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.

[31]  Robert Bergevin,et al.  Body tracking in human walk from monocular video sequences , 2005, The 2nd Canadian Conference on Computer and Robot Vision (CRV'05).

[32]  G. Johansson Visual perception of biological motion and a model for its analysis , 1973 .

[33]  Murray Mp,et al.  Gait as a total pattern of movement. , 1967 .