Moving Object Segmentation Algorithm for Human-like Vision System

The edge and motion are the main features that human visual system (HVS) perceives intensively. Therefore, it is very important to obtain accurate boundary of moving object coinciding with the boundary that HVS perceives for human-like vision system. This paper proposes an algorithm for the segmentation of the moving object with accurate boundary using color and motion focusing on the HVS perception in the general image sequence. The proposed algorithm is composed of three parts: color segmentation, motion analysis, and region refinement and merging part. In the color segmentation phase, K-Means algorithm is used in consideration of the sensitivity of the human color perception to get the accurate boundaries coinciding with the boundaries that HVS perceives. The global and local motion estimation are performed in parallel with color analysis. As the result of color and motion analysis, boundary and motion information of each region are obtained. After that, Bayesian clustering using color and motion provides more accurate boundary for each region although the color contrast between objects and background is low. In the final stage, regions are merged taking into account their motion. The experimental results of the proposed algorithm show the accurate moving object boundary coinciding with the boundary that HVS perceives.

[1]  JongWon Kim,et al.  Fast video object segmentation using affine motion and gradient-based color clustering , 1998, 1998 IEEE Second Workshop on Multimedia Signal Processing (Cat. No.98EX175).

[2]  B. Achiriloaie,et al.  VI REFERENCES , 1961 .

[3]  Seong-Dae Kim,et al.  Spatio-temporal video segmentation using a joint similarity measure , 1997, IEEE Trans. Circuits Syst. Video Technol..

[4]  Rangasami L. Kashyap,et al.  Bayesian estimation for multiscale image segmentation , 1999, 1999 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings. ICASSP99 (Cat. No.99CH36258).

[5]  Volker Rehrmann Object Oriented Motion Estimation in Color Image Sequences , 1998, ECCV.

[6]  Michael A. Arbib,et al.  Color Image Segmentation using Competitive Learning , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Michael J. Black,et al.  The Robust Estimation of Multiple Motions: Parametric and Piecewise-Smooth Flow Fields , 1996, Comput. Vis. Image Underst..

[8]  Sanjit K. Mitra,et al.  An algorithm for unsupervised color image segmentation , 1998, 1998 IEEE Second Workshop on Multimedia Signal Processing (Cat. No.98EX175).

[9]  B A Wandell,et al.  Color appearance: the effects of illumination and spatial pattern. , 1993, Proceedings of the National Academy of Sciences of the United States of America.