Space-time A Contrario Clustering for Detecting Coherent Motions

This paper presents a method for detecting independent temporally-persistent motion patterns in image sequences. The result is a description of the dynamic content of a video sequence in terms of moving objects, their number, image position and approximate motion. For each detected motion pattern a local trajectory as well as a confidence level is provided. The method is based on local motion measurements extracted from short video segments. These measurements are mapped in an adequate grouping space where independent trajectories correspond to distinct clusters. The automatic cluster detection is handled in an a contrario framework, which is general and involves no parameter tuning. The method was validated on real video sequences featuring rigid and non-rigid moving objects, static and mobile cameras, and distracting motions. The output of this method could initialize tracking algorithms. Applications of interest are robot navigation, car-driver assistance, surveillance and activity recognition.

[1]  H. Bock.  On some significance tests in cluster analysis , 1985 .

[2]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[3]  Philip H. S. Torr,et al.  Stochastic Motion Clustering , 1994, ECCV.

[4]  Jean-Marc Odobez,et al.  Robust Multiresolution Estimation of Parametric Motion Models , 1995, J. Vis. Commun. Image Represent..

[5]  A. Yuille,et al.  A Theoretical Framework for Visual Motion , 1996 .

[6]  Andrew W. Fitzgibbon,et al.  Multibody Structure and Motion: 3-D Reconstruction of Independently Moving Objects , 2000, ECCV.

[7]  Patrick Bouthemy,et al.  Real-Time Tracking of Moving Persons by Exploiting Spatio-Temporal Image Slices , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Sudeep Sarkar,et al.  Perceptual Organization Based Computational Model for Robust Segmentation of Moving Objects , 2002, Comput. Vis. Image Underst..

[9]  Lionel Moisan,et al.  On the Theory of Planar Shape , 2003, Multiscale Model. Simul..

[10]  Lionel Moisan,et al.  A Grouping Principle and Four Applications , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[12]  The multibody trifocal tensor: motion segmentation from 3 perspective views , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[13]  John K. Tsotsos,et al.  Detecting Motion Patterns via Direction Maps with Application to Surveillance , 2005, 2005 Seventh IEEE Workshops on Applications of Computer Vision (WACV/MOTION'05) - Volume 1.

[14]  F. Cao,et al.  An a contrario space-time grouping framework for the detection of coherent motions , 2006 .

[15]  Julie Delon,et al.  A Unified Framework for Detecting Groups and Application to Shape Recognition , 2007, Journal of Mathematical Imaging and Vision.

[16]  Patrick Bouthemy,et al.  An a contrario Decision Framework for Region-Based Motion Detection , 2006, International Journal of Computer Vision.