Finding Gait in Space and Time

We describe an approach to characterize the signatures generated by walking humans in spatio-temporal domain. To describe the computational model for this periodic pattern, we take the mathematical theory of geometry group theory, which is widely used in crystallographic structure research. Both empirical and theoretical analyses prove that spatio-temporal helical patterns generated by legs belong to the Frieze Groups because they can be characterized by a repetitive motif along the direction of walking. The theory is applied to an automatic detection-and-tracking system capable of counting heads and handling occlusion by recognizing such patterns. Experimental results for videos acquired from both static and moving ground sensors are presented. Our algorithm demonstrates robustness to non-rigid human deformation as well as background clutter

[1]  Dariu Gavrila,et al.  The Visual Analysis of Human Movement: A Survey , 1999, Comput. Vis. Image Underst..

[2]  S.C. Gupta,et al.  Phase-locked loops , 1975, Proceedings of the IEEE.

[3]  Jeffrey E. Boyd,et al.  Synchronization of oscillations for machine perception of gaits , 2004, Comput. Vis. Image Underst..

[4]  J. Little,et al.  Recognizing People by Their Gait: The Shape of Motion , 1998 .

[5]  Larry S. Davis,et al.  An Efficient and Robust Human Classification Algorithm , 2004 .

[6]  R. Nelson,et al.  Low level recognition of human motion (or how to get your man without finding his body parts) , 1994, Proceedings of 1994 IEEE Workshop on Motion of Non-rigid and Articulated Objects.

[7]  Tieniu Tan,et al.  Recent developments in human motion analysis , 2003, Pattern Recognit..

[8]  Paul A. Viola,et al.  Detecting Pedestrians Using Patterns of Motion and Appearance , 2005, International Journal of Computer Vision.

[9]  David Wright,et al.  Indra's Pearls: The Vision of Felix Klein , 2002 .

[10]  Qingmin Liao,et al.  Virtual face rendering based on gradient features in VLBR networks , 2002, IS&T/SPIE Electronic Imaging.

[11]  Larry S. Davis,et al.  Real-Time Human Detection, Tracking, and Verification in Uncontrolled Camera Motion Environments , 2006, Fourth IEEE International Conference on Computer Vision Systems (ICVS'06).

[12]  Larry S. Davis,et al.  Pedestrian classification from moving platforms using cyclic motion pattern , 2005, IEEE International Conference on Image Processing 2005.

[13]  Paul A. Viola,et al.  Detecting Pedestrians Using Patterns of Motion and Appearance , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[14]  Rama Chellappa,et al.  Visual tracking and recognition using appearance-adaptive models in particle filters , 2004, IEEE Transactions on Image Processing.

[15]  Jitendra Malik,et al.  Recognizing action at a distance , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[16]  Qinfen Zheng,et al.  Multi moving people detection from binocular sequences , 2003, 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03)..

[17]  M. A. Armstrong.  Groups and symmetry , 1988 .

[18]  Dimitris N. Metaxas,et al.  Automating gait generation , 2001, SIGGRAPH.

[19]  R. Chellappa,et al.  Automatic registration of oblique aerial images , 1994, Proceedings of 1st International Conference on Image Processing.

[20]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[21]  E H Adelson,et al.  Spatiotemporal energy models for the perception of motion. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[22]  Slavik Jablan.  Theory of symmetry and ornament , 1995 .

[23]  Yanxi Liu,et al.  Gait Sequence Analysis Using Frieze Patterns , 2002, ECCV.

[24]  Edward H. Adelson,et al.  Analyzing and recognizing walking figures in XYT , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[25]  Larry S. Davis,et al.  Probabilistic template based pedestrian detection in infrared videos , 2002, Intelligent Vehicle Symposium, 2002. IEEE.

[26]  Fang Liu,et al.  Finding periodicity in space and time , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).