Silhouette extraction based on iterative spatio-temporal local color transformation and graph-cut segmentation

We propose an iterative scheme of spatio-temporal local color transformation of background and graph-cut segmentation for silhouette extraction. Given an initial background subtraction, spatio-temporal background color transformation is processed for fitting modeled background colors to input background ones under a different illumination condition. After foreground colors are modeled based on the fit background, spatio-temporal graph-cut algorithm is applied to acquire a foreground/background segmentation result. Because these two processes need well-segmented background and well-fit background each other, they are iterated in turn to obtain better silhouette extraction results. Silhouette extraction experiments for a walking human on a treadmill show the effectiveness of the proposed method.

[1]  Alex Pentland,et al.  Pfinder: Real-Time Tracking of the Human Body , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  B A Wandell,et al.  Linear models of surface and illuminant spectra. , 1992, Journal of the Optical Society of America. A, Optics and image science.

[3]  Atsushi Shimada,et al.  A fast algorithm for adaptive background model construction using parzen density estimation , 2007, 2007 IEEE Conference on Advanced Video and Signal Based Surveillance.

[4]  Helmut E. Bez,et al.  A practical adaptive approach for dynamic background subtraction using an invariant colour model and object tracking , 2005, Pattern Recognit. Lett..

[5]  Marie-Pierre Jolly,et al.  Interactive graph cuts for optimal boundary & region segmentation of objects in N-D images , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[6]  Andrew Blake,et al.  "GrabCut" , 2004, ACM Trans. Graph..

[7]  Andrew Blake,et al.  Statistical mosaics for tracking , 1996, Image Vis. Comput..

[8]  Marie-Pierre Jolly,et al.  Interactive Graph Cuts for Optimal Boundary and Region Segmentation of Objects in N-D Images , 2001, ICCV.

[9]  Woontack Woo,et al.  Identifying Foreground from Multiple Images , 2007, ACCV.