Segmentation of Natural Image Based on Colour Cohesion and Spatial Criteria

Segmenting a natural image is a complex task. Different semantic units may share similar visual features. On the other hand, such features can have variations even within a single unit. Proposed methodology relies on colour cohesion and spatial relationship between the components with cohesive colour. At first image colour space is clustered to map the original colour to a reduced set. Number of cluster is automatically detected by analyzing the intensity histograms of the colour channels. Based on the similarity in terms of mapped colours, pixels are grouped. Subsequently, the spatial inclusiveness criteria is considered to merge the pixels groups where one group is contained within another. Finally, an attempt is made to merge the adjacent regions based on colour gradient. Colour cohesion is conceptualized by the process of colour space clustering, grouping of pixels in terms of colour similarity and region merging based on colour gradient. The spatial criteria is taken into account in terms of spatial inclusiveness at intermediate level and adjacency at final stage. Proposed methodology is tested on Berkley segmentation dataset. Performance comparison with few other methodologies indicates the effectiveness of proposed methodology.

[1]  Jonathan T. Barron,et al.  Multiscale Combinatorial Grouping for Image Segmentation and Object Proposal Generation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Daniel P. Huttenlocher,et al.  Efficient Graph-Based Image Segmentation , 2004, International Journal of Computer Vision.

[3]  Yuhui Zheng,et al.  Image segmentation by generalized hierarchical fuzzy C-means algorithm , 2015, J. Intell. Fuzzy Syst..

[4]  Antonio Torralba,et al.  Statistics of natural image categories , 2003, Network.

[5]  Shitong Wang,et al.  New insight at level set & Gaussian mixture model for natural image segmentation , 2013, Signal Image Video Process..

[6]  Jitendra Malik,et al.  Normalized cuts and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[7]  Yan Wang,et al.  DeepContour: A deep convolutional feature learned by positive-sharing loss for contour detection , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Iasonas Kokkinos,et al.  DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Jitendra Malik,et al.  Learning to detect natural image boundaries using local brightness, color, and texture cues , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Sebastian Nowozin,et al.  Image Segmentation UsingHigher-Order Correlation Clustering , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  George Papandreou,et al.  Weakly- and Semi-Supervised Learning of a DCNN for Semantic Image Segmentation , 2015, ArXiv.

[12]  Christoph Schnörr,et al.  Natural Image Statistics for Natural Image Segmentation , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[13]  Georgios Tziritas,et al.  Natural Image Segmentation Based on Tree Equipartition, Bayesian Flooding and Region Merging , 2011, IEEE Transactions on Image Processing.

[14]  Noah Snavely,et al.  Material recognition in the wild with the Materials in Context Database , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Jean-Michel Morel,et al.  Non-Local Means Denoising , 2011, Image Process. Line.

[16]  Hai Jin,et al.  Color Image Segmentation Based on Mean Shift and Normalized Cuts , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[17]  Hossein Mobahi,et al.  Natural Image Segmentation with Adaptive Texture and Boundary Encoding , 2009, ACCV.

[18]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Jitendra Malik,et al.  A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[20]  Charless C. Fowlkes,et al.  Contour Detection and Hierarchical Image Segmentation , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Ronen Basri,et al.  Image Segmentation by Probabilistic Bottom-Up Aggregation and Cue Integration , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[22]  한보형,et al.  Learning Deconvolution Network for Semantic Segmentation , 2015 .