Describing motion for recognition

Our goal is to describe motion of a moving human figure in order to recognize individuals by variation in the characteristics of the motion description. We begin with a short sequence of images of a moving figure, taken by a static camera, and derive dense optical flow data for the sequence. We determine a range of scale-independent features of each how image as a whole, ranging from the motion of the centroid of the moving points (assuming a static background), to the integral of the torque relative to the centroid. We then analyze the periodic structure of these sequences. All elements are multiples of the fundamental period of the gait, but they differ in phase. The phase is time-invariant, since it is independent of the sampling period. We show that there are several regularities in the phase differences of the signals. Moreover, some scalar measures of the signals may be useful in recognition. The representation is model-free, and therefore could be used to characterize the motion of other non-rigid bodies.

[1]  Nancy Hamilton,et al.  Kinesiology;: The scientific basis of human motion , 1971 .

[2]  I. Barrodale,et al.  Algorithms for Least-Squares Linear Prediction and Maximum Entropy Spectral Analysis, , 1978 .

[3]  R. E. Erickson,et al.  Algorithms for least-squares linear prediction and maximum entropy spectral analysis; Part II; Fortran program , 1980 .

[4]  T. Poggio,et al.  A parallel algorithm for real-time computation of optical flow , 1989, Nature.

[5]  William H. Press,et al.  Numerical Recipes in C, 2nd Edition , 1992 .

[6]  Randal C. Nelson,et al.  Detecting activities , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[7]  James J. Little,et al.  A smart buffer for tracking using motion data , 1993, 1993 Computer Architectures for Machine Perception.

[8]  E. Adelson,et al.  Analyzing gait with spatiotemporal surfaces , 1994, Proceedings of 1994 IEEE Workshop on Motion of Non-rigid and Articulated Objects.

[9]  J. Aggarwal,et al.  Lower limb kinematics of human walking with the medial axis transformation , 1994, Proceedings of 1994 IEEE Workshop on Motion of Non-rigid and Articulated Objects.

[10]  Edward H. Adelson,et al.  Analyzing and recognizing walking figures in XYT , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[11]  Steven M. Seitz,et al.  Affine invariant detection of periodic motion , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[12]  A ne Invariant Detection of Periodic Motion , 1994 .

[13]  Mubarak Shah,et al.  A survey of motion analysis from moving light displays , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[14]  Randal C. Nelson,et al.  Nonparametric Recognition of Nonrigid Motion , 1995 .