Behavior classification by eigendecomposition of periodic motions

We show how periodic motions can be represented by a small number of eigenshapes that capture the whole dynamic mechanism of the motion. Spectral decomposition of a silhouette of a moving object serves as a basis for behavior classification by principle component analysis. The boundary contour of the walking dog, for example, is first computed efficiently and accurately. After normalization, the implicit representation of a sequence of silhouette contours given by their corresponding binary images, is used for generating eigenshapes for the given motion. Singular value decomposition produces these eigenshapes that are then used to analyze the sequence. We show examples of object as well as behavior classification based on the eigendecomposition of the binary silhouette sequence.

[1]  Mubarak Shah,et al.  The trajectory primal sketch: a multi-scale scheme for representing motion characteristics , 1989, Proceedings CVPR '89: IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[2]  James W. Davis,et al.  The Recognition of Human Movement Using Temporal Templates , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Randal C. Nelson,et al.  Detecting activities , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Hans-Hellmut Nagel,et al.  Model-based object tracking in monocular image sequences of road traffic scenes , 1993, International Journal of Computer 11263on.

[5]  Hironobu Fujiyoshi,et al.  Moving target classification and tracking from real-time video , 1998, Proceedings Fourth IEEE Workshop on Applications of Computer Vision. WACV'98 (Cat. No.98EX201).

[6]  Dariu Gavrila,et al.  The Issues , 2011 .

[7]  Chris Stauffer,et al.  Robust automated planar normalization of tracking data , 2003 .

[8]  Steven M. Seitz,et al.  View-Invariant Analysis of Cyclic Motion , 1997, International Journal of Computer Vision.

[9]  J. Crowley.  Recognizing Motion Using Local Appearance , 1998 .

[10]  Jeffrey Mark Siskind,et al.  A Maximum-Likelihood Approach to Visual Event Classification , 1996, ECCV.

[11]  Michael J. Black,et al.  Parameterized Modeling and Recognition of Activities , 1999, Comput. Vis. Image Underst..

[12]  Thomas B. Moeslund,et al.  A Survey of Computer Vision-Based Human Motion Capture , 2001, Comput. Vis. Image Underst..

[13]  Mubarak Shah,et al.  Cyclic motion detection for motion based recognition , 1994, Pattern Recognit..

[14]  Tony F. Chan,et al.  Active contours without edges , 2001, IEEE Trans. Image Process..

[15]  Hiroshi Murase,et al.  Moving object recognition in eigenspace representation: gait analysis and lip reading , 1996, Pattern Recognit. Lett..

[16]  Roman Goldenberg,et al.  Fast Geodesic Active Contours , 1999, Scale-Space.

[17]  Timothy F. Cootes,et al.  Active shape models , 1998 .

[18]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[19]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[20]  Fang Liu,et al.  Finding periodicity in space and time , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[21]  Guillermo Sapiro,et al.  Geodesic Active Contours , 1995, International Journal of Computer Vision.

[22]  James W. Davis,et al.  The Representation and Recognition of Action Using Temporal Templates , 1997, CVPR 1997.

[23]  Timothy F. Cootes,et al.  Active Shape Models-Their Training and Application , 1995, Comput. Vis. Image Underst..

[24]  Hironobu Fujiyoshi,et al.  Real-time human motion analysis by image skeletonization , 1998, Proceedings Fourth IEEE Workshop on Applications of Computer Vision. WACV'98 (Cat. No.98EX201).

[25]  J.A. O'Sullivan,et al.  Automatic target recognition using kinematic priors , 1994, Proceedings of 1994 33rd IEEE Conference on Decision and Control.

[26]  Mubarak Shah,et al.  View-Invariant Representation and Recognition of Actions , 2002, International Journal of Computer Vision.

[27]  Randal C. Nelson,et al.  Detection and Recognition of Periodic, Nonrigid Motion , 1997, International Journal of Computer Vision.

[28]  David C. Hogg,et al.  An efficient method for contour tracking using active shape models , 1994, Proceedings of 1994 IEEE Workshop on Motion of Non-rigid and Articulated Objects.

[29]  Rachid Deriche,et al.  Geodesic Active Regions for Motion Estimation and Tracking , 1999, ICCV.

[30]  Mubarak Shah,et al.  Motion-based recognition a survey , 1995, Image Vis. Comput..

[31]  Mubarak Shah,et al.  Motion-Based Recognition , 1997, Computational Imaging and Vision.

[32]  Dariu Gavrila,et al.  The Visual Analysis of Human Movement: A Survey , 1999, Comput. Vis. Image Underst..