SEEK: A Framework of Superpixel Learning with CNN Features for Unsupervised Segmentation

Supervised semantic segmentation algorithms have been a hot area of exploration recently, but now the attention is being drawn towards completely unsupervised semantic segmentation. In an unsupervised framework, neither the targets nor the ground truth labels are provided to the network. That being said, the network is unaware about any class instance or object present in the given data sample. So, we propose a convolutional neural network (CNN) based architecture for unsupervised segmentation. We used the squeeze and excitation network, due to its peculiar ability to capture the features’ interdependencies, which increases the network’s sensitivity to more salient features. We iteratively enable our CNN architecture to learn the target generated by a graph-based segmentation method, while simultaneously preventing our network from falling into the pit of over-segmentation. Along with this CNN architecture, image enhancement and refinement techniques are exploited to improve the segmentation results. Our proposed algorithm produces improved segmented regions that meet the human level segmentation results. In addition, we evaluate our approach using different metrics to show the quantitative outperformance.

[1]  Huanxin Zou,et al.  Deep Convolutional Highway Unit Network for SAR Target Classification With Limited Labeled Training Data , 2017, IEEE Geoscience and Remote Sensing Letters.

[2]  Yair Weiss,et al.  Segmentation using eigenvectors: a unifying view , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[3]  Gursangeet Kaur,et al.  MRI Brain Tumor Segmentation Methods- A Review , 2017 .

[4]  Jun Zhu,et al.  Learning From Weakly Supervised Data by The Expectation Loss SVM (e-SVM) algorithm , 2014, NIPS.

[5]  Wei Wang,et al.  Superpixel-Based Segmentation of Polarimetric SAR Images through Two-Stage Merging , 2019, Remote. Sens..

[6]  Vladlen Koltun,et al.  Efficient Inference in Fully Connected CRFs with Gaussian Edge Potentials , 2011, NIPS.

[7]  Hironobu Fujiyoshi,et al.  Deep learning-based image recognition for autonomous driving , 2019, IATSS Research.

[8]  Cem Direkoglu,et al.  Review of MRI-based Brain Tumor Image Segmentation Using Deep Learning Methods , 2016 .

[9]  Yen-Yu Lin,et al.  Multiple Structured-Instance Learning for Semantic Segmentation with Uncertain Training Data , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Sebastian Ramos,et al.  The Cityscapes Dataset for Semantic Urban Scene Understanding , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Xiaohong Jia,et al.  Adaptive Morphological Reconstruction for Seeded Image Segmentation , 2019, IEEE Transactions on Image Processing.

[12]  Dorin Comaniciu,et al.  Robust analysis of feature spaces: color image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[13]  Mohammed Bennamoun,et al.  An Improved Approach to Weakly Supervised Semantic Segmentation , 2019, ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[14]  Eugenio Culurciello,et al.  LinkNet: Exploiting encoder representations for efficient semantic segmentation , 2017, 2017 IEEE Visual Communications and Image Processing (VCIP).

[15]  Marina Meila,et al.  Comparing clusterings: an axiomatic view , 2005, ICML.

[16]  Eugenio Culurciello,et al.  ENet: A Deep Neural Network Architecture for Real-Time Semantic Segmentation , 2016, ArXiv.

[17]  Brian Kulis,et al.  W-Net: A Deep Model for Fully Unsupervised Image Segmentation , 2017, ArXiv.

[18]  Jitendra Malik,et al.  A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[19]  Mooi Choo Chuah,et al.  A Strawberry Detection System Using Convolutional Neural Networks , 2018, 2018 IEEE International Conference on Big Data (Big Data).

[20]  Charless C. Fowlkes,et al.  Contour Detection and Hierarchical Image Segmentation , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Ming Yang,et al.  Bi-Directional Cascade Network for Perceptual Edge Detection , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[22]  Mohammad I. Daoud,et al.  Automatic superpixel-based segmentation method for breast ultrasound images , 2019, Expert Syst. Appl..

[23]  Nima Tajbakhsh,et al.  Models Genesis: Generic Autodidactic Models for 3D Medical Image Analysis , 2019, MICCAI.

[24]  M. P. Sebastian,et al.  Improving the Accuracy and Efficiency of the k-means Clustering Algorithm , 2009 .

[25]  Li Cheng-hua,et al.  Color image segmentation method based on statistical pattern recognition for plant disease diagnose , 2004 .

[26]  Won Suk Lee,et al.  Strawberry Yield Prediction Based on a Deep Neural Network Using High-Resolution Aerial Orthoimages , 2019, Remote. Sens..

[27]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[28]  Asako Kanezaki,et al.  Unsupervised Image Segmentation by Backpropagation , 2018, 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[29]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[30]  Takeyoshi Imai Legal regulation of autonomous driving technology: Current conditions and issues in Japan , 2019 .

[31]  Dieter Schmalstieg,et al.  Discrete-Continuous Gradient Orientation Estimation for Faster Image Segmentation , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[32]  James Patrick Underwood,et al.  Image Segmentation for Fruit Detection and Yield Estimation in Apple Orchards , 2016, J. Field Robotics.

[33]  Lin Yang,et al.  SPDA: Superpixel-based Data Augmentation for Biomedical Image Segmentation , 2019, MIDL.

[34]  Christopher M. Gifford,et al.  Improved Image Segmentation via Cost Minimization of Multiple Hypotheses , 2018, BMVC.

[35]  Sepp Hochreiter,et al.  Visual Scene Understanding for Autonomous Driving Using Semantic Segmentation , 2019, Explainable AI.

[36]  Xin Zheng,et al.  Image segmentation based on adaptive K-means algorithm , 2018, EURASIP Journal on Image and Video Processing.

[37]  Bernard De Baets,et al.  Superpixel Segmentation Based on Anisotropic Edge Strength , 2019, J. Imaging.

[38]  Marina Meila,et al.  Comparing Clusterings by the Variation of Information , 2003, COLT.

[39]  Mohan M. Trivedi,et al.  Deep Learning for Assistive Computer Vision , 2018, ECCV Workshops.

[40]  智一 吉田,et al.  Efficient Graph-Based Image Segmentationを用いた圃場図自動作成手法の検討 , 2014 .

[41]  Xiang Fu,et al.  Robust Image Segmentation Using Contour-Guided Color Palettes , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[42]  Jonathan T. Barron,et al.  Multiscale Combinatorial Grouping for Image Segmentation and Object Proposal Generation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[43]  Yihong Gong,et al.  Superpixel Hierarchy , 2016, IEEE Transactions on Image Processing.

[44]  Hanping Mao,et al.  Segmentation Methods of Fruit Image and Comparative Experiments , 2008, 2008 International Conference on Computer Science and Software Engineering.

[45]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[46]  Alex Pappachen James,et al.  Automated image segmentation for detecting cell spreading for metastasizing assessments of cancer development , 2017, 2017 International Conference on Advances in Computing, Communications and Informatics (ICACCI).

[47]  Pascal Fua,et al.  SLIC Superpixels Compared to State-of-the-Art Superpixel Methods , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[48]  Seunghoon Hong,et al.  Learning Deconvolution Network for Semantic Segmentation , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[49]  Xiaogang Wang,et al.  Pyramid Scene Parsing Network , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[50]  J. Llahí Color Constancy and Image Segmentation Techniques for Applications to Mobile Robotics , 2005 .

[51]  A. Seal,et al.  Divergence based SLIC , 2019, Electronics Letters.

[52]  Pierre Soille,et al.  Morphological Texture Features for Unsupervised and Supervised Segmentations of Natural Landscapes , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[53]  Ian D. Reid,et al.  RefineNet: Multi-path Refinement Networks for High-Resolution Semantic Segmentation , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[54]  Xiangyu Zhang,et al.  Large Kernel Matters — Improve Semantic Segmentation by Global Convolutional Network , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[55]  Graham W. Taylor,et al.  Batch Normalization is a Cause of Adversarial Vulnerability , 2019, ArXiv.

[56]  Madhu Yedla,et al.  Enhancing K-means Clustering Algorithm with Improved Initial Center , 2010 .

[57]  Iasonas Kokkinos,et al.  Semantic Image Segmentation with Deep Convolutional Nets and Fully Connected CRFs , 2014, ICLR.

[58]  Vibhav Vineet,et al.  Conditional Random Fields as Recurrent Neural Networks , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[59]  Enhua Wu,et al.  Squeeze-and-Excitation Networks , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[60]  Guang Yang,et al.  Automated brain tumour detection and segmentation using superpixel-based extremely randomized trees in FLAIR MRI , 2016, International Journal of Computer Assisted Radiology and Surgery.

[61]  Yongchao Xu,et al.  Hierarchical Segmentation Using Tree-Based Shape Spaces , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[62]  Zongxu Pan,et al.  Transfer Learning with Deep Convolutional Neural Network for SAR Target Classification with Limited Labeled Data , 2017, Remote. Sens..

[63]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[64]  Hai Zhao,et al.  Integrating unsupervised and supervised word segmentation: The role of goodness measures , 2011, Inf. Sci..