A Practical Approach to Boundary Accurate Multi-Object Extraction from Still Images and Videos

This paper presents recent improvements on a previous published practical approach to object segmentation from still images called SIOX: simple interactive object extraction. The basic method has been improved further and applied to a variety of applications. In the case of videos, this technique allows scale and rotation invariant real-time tracking of foreground objects including the classification of newly introduced objects. In the case of still-images, the method has been extended to cope with highly detailed textures with sub-pixel accuracy. The approach is robust in the presence of noise and can be applied to a variety of problems where objects have to be extracted, tracked and/or identified. The approach has been released as an open source framework. We discuss various applications of the algorithm and incorporated experiences and user feedback from several projects that have begun to integrate the algorithm

[1]  J. Cohen,et al.  Color Science: Concepts and Methods, Quantitative Data and Formulas , 1968 .

[2]  Maneesh Agrawala,et al.  Interactive video cutout , 2005, ACM Trans. Graph..

[3]  Harry Shum,et al.  Video object cut and paste , 2005, ACM Trans. Graph..

[4]  Patrick Pérez,et al.  Interactive Image Segmentation Using an Adaptive GMMRF Model , 2004, ECCV.

[5]  William A. Barrett,et al.  Intelligent scissors for image composition , 1995, SIGGRAPH.

[6]  Gunther Wyszecki,et al.  Color Science: Concepts and Methods, Quantitative Data and Formulae, 2nd Edition , 2000 .

[7]  Harry Shum,et al.  Lazy snapping , 2004, ACM Trans. Graph..

[8]  Andrew Blake,et al.  "GrabCut" , 2004, ACM Trans. Graph..

[9]  Vladimir Vezhnevets,et al.  “GrowCut” - Interactive Multi-Label N-D Image Segmentation By Cellular Automata , 2005 .

[10]  Kevin E. Spaulding,et al.  Color processing in digital cameras , 1998, IEEE Micro.

[11]  Liang-Gee Chen,et al.  Automatic video segmentation for MPEG-4 using predictive watershed , 2001, IEEE International Conference on Multimedia and Expo, 2001. ICME 2001..

[12]  Marie-Pierre Jolly,et al.  Interactive graph cuts for optimal boundary & region segmentation of objects in N-D images , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[13]  Raúl Rojas,et al.  The Color and the Shape: Automatic On-Line Color Calibration for Autonomous Robots , 2005, RoboCup.

[14]  Edward H. Adelson,et al.  Representing moving images with layers , 1994, IEEE Trans. Image Process..

[15]  Jitendra Malik,et al.  A real-time computer vision system for measuring traffic parameters , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[16]  Leonidas J. Guibas,et al.  The Earth Mover's Distance as a Metric for Image Retrieval , 2000, International Journal of Computer Vision.

[17]  David Salesin,et al.  A Bayesian approach to digital matting , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[18]  Jon Louis Bentley,et al.  Multidimensional binary search trees used for associative searching , 1975, CACM.

[19]  Sven Behnke,et al.  Robust Real Time Color Tracking , 2000, RoboCup.

[20]  Yang Wang,et al.  Video segmentation based on graphical models , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[21]  Christian Breiteneder,et al.  Virtual Studios: An Overview , 1998, IEEE Multim..

[22]  Raúl Rojas,et al.  SIOX: simple interactive object extraction in still images , 2005, Seventh IEEE International Symposium on Multimedia (ISM'05).

[23]  Marie-Pierre Jolly,et al.  Interactive Graph Cuts for Optimal Boundary and Region Segmentation of Objects in N-D Images , 2001, ICCV.

[24]  S. Gibbs Virtual Studios , 1998, IEEE MultiMedia.

[25]  Larry S. Davis,et al.  W4: Real-Time Surveillance of People and Their Activities , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  G. Wyszecki,et al.  Color Science Concepts and Methods , 1982 .