Object contour extraction using color and motion

A new approach to the extraction of the contour of a moving object is presented. The method is based on the integration of a motion segmentation technique using image substraction and a color segmentation technique based on the split-and-merge algorithm. The advantages of this method are: it can detect large moving objects and extract their boundaries; the background can be arbitrarily complicated and contain many non-moving objects occluded by the moving object; and it requires only three image frames that need not be consecutive, provided that the object is entirely contained in each of the three frames. The method is applied to a large number of color images of vehicles moving on a road and a highway ramp. The results are promising. The moving object boundaries are correctly extracted in 66 out of 73 test image sequences. The authors describe how this contour can be used as an input to a recognition system that classifies the vehicles into five generic categories. Of the 73 vehicles, 67 are correctly classified.<<ETX>>

[1]  Theodosios Pavlidis,et al.  Picture Segmentation by a Tree Traversal Algorithm , 1976, JACM.

[2]  Robert B. McGhee,et al.  Aircraft Identification by Moment Invariants , 1977, IEEE Transactions on Computers.

[3]  Keith Price,et al.  Picture Segmentation Using a Recursive Region Splitting Method , 1998 .

[4]  Ramesh C. Jain,et al.  On the Analysis of Accumulative Difference Pictures from Image Sequences of Real World Scenes , 1979, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Jake K. Aggarwal,et al.  Segmentation through the detection of changes due to motion , 1979 .

[6]  T. Kanade,et al.  Color information for region segmentation , 1980 .

[7]  Hans-Hellmut Nagel,et al.  Overview on Image Sequence Analysis , 1983 .

[8]  Theodosios Pavlidis,et al.  Integrating Region Growing and Edge Detection , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  F. Stein,et al.  Efficient two dimensional object recognition , 1990, [1990] Proceedings. 10th International Conference on Pattern Recognition.

[10]  Anil K. Jain,et al.  A multi-channel filtering approach to texture segmentation , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[11]  Hans-Hellmut Nagel,et al.  Algorithmic characterization of vehicle trajectories from image sequences by motion verbs , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[12]  Aldo Cumani,et al.  Image description of dynamic scenes , 1991, Pattern Recognit..

[13]  J. H. Duncan,et al.  On the Detection of Motion and the Computation of Optical Flow , 1992, IEEE Trans. Pattern Anal. Mach. Intell..