View-invariant analysis of periodic motion

Periodicity has been recognized as an important cue for tasks like activity recognition and gait analysis. However, most existing techniques analyze periodic motions only in image coordinates, making them very dependent on the viewing angle. In this paper we propose a new technique for reconstructing periodic point trajectories in 3D given only their apparent trajectories in image coordinates from a single stationary camera. We show that this reconstruction is possible without performing a costly gradient descent-type optimization, and is based only on a single SVD. This new algorithm is shown to accurately reconstruct natural human motions, allowing them to be compared in 3D world coordinates, independent of the angle from which they were originally viewed.

[1]  Fang Liu,et al.  Finding periodicity in space and time , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[2]  J. Little,et al.  Describing motion for recognition , 1995, Proceedings of International Symposium on Computer Vision - ISCV.

[3]  James W. Davis,et al.  Categorical representation and recognition of oscillatory motion patterns , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[4]  Steven M. Seitz,et al.  View-Invariant Analysis of Cyclic Motion , 1997, International Journal of Computer Vision.

[5]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[6]  Serge J. Belongie,et al.  Structure from Periodic Motion , 2004, SCVMA.

[7]  Daniel E. Koditschek,et al.  Dynamical system representation, generation, and recognition of basic oscillatory motion gestures , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[8]  Xavier Binefa,et al.  Classifying periodic motions in video sequences , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[9]  Mubarak Shah,et al.  Cyclic motion detection for motion based recognition , 1994, Pattern Recognit..

[10]  Michael J. Black,et al.  Representing cyclic human motion using functional analysis , 2005, Image Vis. Comput..

[11]  Hironobu Fujiyoshi,et al.  Real-time human motion analysis by image skeletonization , 1998, Proceedings Fourth IEEE Workshop on Applications of Computer Vision. WACV'98 (Cat. No.98EX201).

[12]  Charles R. Dyer,et al.  Cyclic motion detection using spatiotemporal surfaces and curves , 1990, [1990] Proceedings. 10th International Conference on Pattern Recognition.

[13]  Randal C. Nelson,et al.  Detection and Recognition of Periodic, Nonrigid Motion , 1997, International Journal of Computer Vision.

[14]  Ahmed M. Elgammal,et al.  Inferring 3D body pose from silhouettes using activity manifold learning , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[15]  Nikolaos Papanikolopoulos,et al.  Estimating 3D Trajectories of Periodic Motions from Stationary Monocular Views , 2008, ECCV.

[16]  Narendra Ahuja,et al.  Extraction and Analysis of Multiple Periodic Motions in Video Sequences , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.