Description of Motion of Segmented Regions

In this paper a proposal for the tracking moving objects and their movements description taken from sequences of images is presented. Some of the properties that can be inferred for each moving object are the magnitude and direction of motion. In the first part, the segmentation of moving objects is presented. This segmentation is made from optical flow without requiring a priori information of the scene. The estimation of optical flow is obtained by Pyramid Lucas-Kanade algorithm. Optical flow vectors are grouped by proximity, direction and magnitude. The segmentation of the objects in regions is made from the convex hull of origins of each optical flow vector wich forms the region. In the second part, the velocity and direction of movement of each region is obtained.

[1]  Sanjit K. Mitra,et al.  Region-based video coder using edge flow segmentation and hierarchical affine region matching , 1998, Electronic Imaging.

[2]  Helge J. Ritter,et al.  Adaptive color segmentation-a comparison of neural and statistical methods , 1997, IEEE Trans. Neural Networks.

[3]  Nebojsa Jojic,et al.  Consistent segmentation for optical flow estimation , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[4]  Antonio Torralba,et al.  SIFT Flow: Dense Correspondence across Different Scenes , 2008, ECCV.

[5]  Edward H. Adelson,et al.  Representing moving images with layers , 1994, IEEE Trans. Image Process..

[6]  Michael J. Black,et al.  Mixture models for optical flow computation , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[7]  John K. Tsotsos,et al.  A framework for visual motion understanding , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Marvin Minsky,et al.  A framework for representing knowledge , 1974 .

[9]  Anil K. Jain,et al.  A multi-channel filtering approach to texture segmentation , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[10]  Jitendra Malik,et al.  Large Displacement Optical Flow: Descriptor Matching in Variational Motion Estimation , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Dana H. Ballard,et al.  Generalizing the Hough transform to detect arbitrary shapes , 1981, Pattern Recognit..

[12]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[13]  Edward H. Adelson,et al.  A unified mixture framework for motion segmentation: incorporating spatial coherence and estimating the number of models , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[14]  Hans-Hellmut Nagel,et al.  Steps toward a Cognitive Vision System , 2004, AI Mag..

[15]  Ulrich Kressel,et al.  Tracking non-rigid, moving objects based on color cluster flow , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[16]  Harpreet S. Sawhney,et al.  Layered representation of motion video using robust maximum-likelihood estimation of mixture models and MDL encoding , 1995, Proceedings of IEEE International Conference on Computer Vision.

[17]  Richard Szeliski,et al.  A Database and Evaluation Methodology for Optical Flow , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[18]  Chiou-Shann Fuh,et al.  Hierarchical color image region segmentation for content-based image retrieval system , 2000, IEEE Trans. Image Process..

[19]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[20]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[21]  Chun-Shien Lu,et al.  Unsupervised texture segmentation via wavelet transform , 1997, Pattern Recognit..

[22]  V. F. Leavers,et al.  Which Hough transform , 1993 .

[23]  Hai Tao,et al.  A global matching framework for stereo computation , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[24]  Ying Wu,et al.  An Adaptive Self-Organizing Color Segmentation Algorithm with Application to Robust Real-time Human Hand Localization , 2000 .

[25]  H. Fleyeh,et al.  Color detection and segmentation for road and traffic signs , 2004, IEEE Conference on Cybernetics and Intelligent Systems, 2004..

[26]  Marvin Minsky,et al.  A framework for representing knowledge" in the psychology of computer vision , 1975 .

[27]  Mubarak Shah,et al.  Object based segmentation of video using color, motion and spatial information , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.