BlobContours: adapting Blobworld for supervised color- and texture-based image segmentation

Extracting features is the first and one of the most crucial steps in recent image retrieval process. While the color features and the texture features of digital images can be extracted rather easily, the shape features and the layout features depend on reliable image segmentation. Unsupervised image segmentation, often used in image analysis, works on merely syntactical basis. That is, what an unsupervised segmentation algorithm can segment is only regions, but not objects. To obtain high-level objects, which is desirable in image retrieval, human assistance is needed. Supervised image segmentations schemes can improve the reliability of segmentation and segmentation refinement. In this paper we propose a novel interactive image segmentation technique that combines the reliability of a human expert with the precision of automated image segmentation. The iterative procedure can be considered a variation on the Blobworld algorithm introduced by Carson et al. from EECS Department, University of California, Berkeley. Starting with an initial segmentation as provided by the Blobworld framework, our algorithm, namely BlobContours, gradually updates it by recalculating every blob, based on the original features and the updated number of Gaussians. Since the original algorithm has hardly been designed for interactive processing we had to consider additional requirements for realizing a supervised segmentation scheme on the basis of Blobworld. Increasing transparency of the algorithm by applying usercontrolled iterative segmentation, providing different types of visualization for displaying the segmented image and decreasing computational time of segmentation are three major requirements which are discussed in detail.

[1]  Thomas S. Huang,et al.  Automated region segmentation using attraction-based grouping in spatial-color-texture space , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[2]  Jana Dittmann,et al.  Illustration watermarking: an object-based approach for digital images , 2005, IS&T/SPIE Electronic Imaging.

[3]  Tosiyasu L. Kunii,et al.  Pictorial Data-Base Systems , 1981, Computer.

[4]  Paola Campadelli,et al.  Quantitative evaluation of color image segmentation results , 1998, Pattern Recognit. Lett..

[5]  Theodosios Pavlidis Contour filling in raster graphics , 1981, SIGGRAPH '81.

[6]  B. S. Manjunath,et al.  Unsupervised Segmentation of Color-Texture Regions in Images and Video , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Ning-San Chang,et al.  A Relational Database System for Images , 1980, Pictorial Information Systems.

[8]  Shi-Kuo Chang,et al.  Image Information Systems: Where Do We Go From Here? , 1992, IEEE Trans. Knowl. Data Eng..

[9]  Thierry Pun,et al.  Interactive segmentation with hidden object-based annotations: toward smart media , 2003, IS&T/SPIE Electronic Imaging.

[10]  John R. Smith,et al.  Color for Image Retrieval , 2002 .

[11]  Jitendra Malik,et al.  A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[12]  Patty Kostkova,et al.  Special Issue on Digital Libraries , 2006, Health Informatics J..

[13]  Shi-Kuo Chang,et al.  An Intelligent Image Database System , 1988, IEEE Trans. Software Eng..

[14]  King-Sun Fu,et al.  Query-by-Pictorial-Example , 1980, IEEE Trans. Software Eng..

[15]  Ramin Samadani,et al.  Computer-assisted extraction of boundaries from images , 1993, Electronic Imaging.

[16]  Jitendra Malik,et al.  Blobworld: A System for Region-Based Image Indexing and Retrieval , 1999, VISUAL.

[17]  Ioannis Pitas,et al.  Region-based image watermarking , 2001, IEEE Trans. Image Process..

[18]  Shih-Fu Chang,et al.  Image Retrieval: Current Techniques, Promising Directions, and Open Issues , 1999, J. Vis. Commun. Image Represent..

[19]  Matthew Lybanon,et al.  Segmentation of diverse image types using opening and closing , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[20]  W. Irwin "Where do we go from here?". , 1951, Radiography.

[21]  H. D. Cheng,et al.  A fuzzy logic approach to image segmentation , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[22]  A. Desai Narasimhalu,et al.  Special section on content-based retrieval , 1995, Multimedia Systems.

[23]  Jia-Ping Wang,et al.  Stochastic Relaxation on Partitions With Connected Components and Its Application to Image Segmentation , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  Bo Zhang,et al.  Unsupervised image segmentation using local homogeneity analysis , 2003, Proceedings of the 2003 International Symposium on Circuits and Systems, 2003. ISCAS '03..

[25]  C.-C. Jay Kuo,et al.  Digital Image Watermarking in Regions of Interest , 1999, PICS.

[26]  W. Clem Karl,et al.  A curve evolution approach for image segmentation using adaptive flows , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[27]  Theo Gevers,et al.  Image segmentation by directed region subdivision , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[28]  Hideyuki Tamura,et al.  Image database systems: A survey , 1984, Pattern Recognit..

[29]  Freddy Fierens,et al.  Interactive outlining: an improved approach using active contours , 1993, Electronic Imaging.

[30]  Thomas S. Huang,et al.  Segmentation of road scenes using color and fractal-based texture classification , 1994, Proceedings of 1st International Conference on Image Processing.

[31]  Hsinchun Chen,et al.  Building Large-Scale Digital Libraries - Guest Editors' Introduction , 1996, Computer.

[32]  Jitendra Malik,et al.  Color- and texture-based image segmentation using EM and its application to content-based image retrieval , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[33]  Jitendra Malik,et al.  Blobworld: Image Segmentation Using Expectation-Maximization and Its Application to Image Querying , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[34]  Thomas S. Huang,et al.  Modified Fourier Descriptors for Shape Representation - A Practical Approach , 1996 .

[35]  William E. Higgins,et al.  Watershed-driven relaxation labeling for image segmentation , 1994, Proceedings of 1st International Conference on Image Processing.

[36]  B. S. Manjunath,et al.  Edge flow: A framework of boundary detection and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[37]  Michael G. Strintzis,et al.  Segmentation and Content-Based Watermarking for Color Image and Image Region Indexing and Retrieval , 2002, EURASIP J. Adv. Signal Process..

[38]  Godfried T. Toussaint,et al.  The use of context in pattern recognition , 1978, Pattern Recognit..