BACA: Superpixel Segmentation with Boundary Awareness and Content Adaptation

Superpixels could aggregate pixels with similar properties, thus reducing the number of image primitives for subsequent advanced computer vision tasks. Nevertheless, existing algorithms are not effective enough to tackle computing redundancy and inaccurate segmentation. To this end, an optimized superpixel generation framework termed Boundary Awareness and Content Adaptation (BACA) is presented. Firstly, an adaptive seed sampling method based on content complexity is proposed in the initialization stage. Different from the conventional uniform mesh initialization, it takes content differentiation into consideration to incipiently eliminate the redundancy of seed distribution. In addition to the efficient initialization strategy, this work also leverages contour prior information to strengthen the boundary adherence from whole to part. During the similarity calculation of inspecting the unlabeled pixels in the non-iterative clustering framework, a multi-feature associated measurement is put forward to ameliorate the misclassification of boundary pixels. Experimental results indicate that the two optimizations could generate a synergistic effect. The integrated BACA achieves an outstanding under-segmentation error (3.34%) on the BSD dataset over the state-of-the-art performances with a minimum number of superpixels (345). Furthermore, it is not limited to image segmentation and can be facilitated by remote sensing imaging analysis.

[1]  Deren Li,et al.  A Global Context-aware and Batch-independent Network for road extraction from VHR satellite imagery , 2021 .

[2]  Bao-Long Guo,et al.  GRID: GRID Resample by Information Distribution , 2020, Symmetry.

[3]  Yan Zheng,et al.  NICE: Superpixel Segmentation Using Non-Iterative Clustering with Efficiency , 2020, Applied Sciences.

[4]  Zihan Zhou,et al.  Superpixel Segmentation With Fully Convolutional Networks , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Xiaohui Yuan,et al.  Superpixel generation for polarimetric SAR using Hierarchical Energy maximization , 2020, Comput. Geosci..

[6]  S. Arivazhagan,et al.  Significance based Ship Detection from SAR Imagery , 2019, 2019 1st International Conference on Innovations in Information and Communication Technology (ICIICT).

[7]  Anlong Ming,et al.  Dynamic Random Walk for Superpixel Segmentation , 2020, IEEE Transactions on Image Processing.

[8]  Pascal Fua,et al.  Scale-Adaptive Superpixels , 2018, CIC.

[9]  Ding Yuan,et al.  Superpixel-Based Depth Estimation for Multiple View Stereo , 2018, 2018 IEEE International Conference on Real-time Computing and Robotics (RCAR).

[10]  Yunsong Li,et al.  Minimum barrier superpixel segmentation , 2018, Image Vis. Comput..

[11]  Nicolas Papadakis,et al.  Robust superpixels using color and contour features along linear path , 2018, Comput. Vis. Image Underst..

[12]  Jiebo Luo,et al.  DOTA: A Large-Scale Dataset for Object Detection in Aerial Images , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[13]  Nicolas Papadakis,et al.  Superpixel-based color transfer , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[14]  Xiao Ma,et al.  Superpixel segmentation: A benchmark , 2017, Signal Process. Image Commun..

[15]  Sabine Süsstrunk,et al.  Superpixels and Polygons Using Simple Non-iterative Clustering , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  Yicong Zhou,et al.  Adaptive superpixel segmentation aggregating local contour and texture features , 2017, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[17]  Yang Xu,et al.  Weakly supervised semantic segmentation with superpixel embedding , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[18]  Huanxin Zou,et al.  A Likelihood-Based SLIC Superpixel Algorithm for SAR Images Using Generalized Gamma Distribution , 2016, Sensors.

[19]  Feng Jin,et al.  A dense depth estimation method using superpixels , 2015, 2015 12th International Computer Conference on Wavelet Active Media Technology and Information Processing (ICCWAMTIP).

[20]  Junwei Han,et al.  Multi-class geospatial object detection and geographic image classification based on collection of part detectors , 2014 .

[21]  Peer Neubert,et al.  Compact Watershed and Preemptive SLIC: On Improving Trade-offs of Superpixel Segmentation Algorithms , 2014, 2014 22nd International Conference on Pattern Recognition.

[22]  Yi-Yu Hsieh,et al.  Incorporating texture information into region-based unsupervised image segmentation using textural superpixels , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[23]  Cheng-Chang Lien,et al.  Blur image segmentation using iterative super-pixels grouping method , 2013, 2013 International Conference on Machine Learning and Cybernetics.

[24]  Luc Van Gool,et al.  SEEDS: Superpixels Extracted Via Energy-Driven Sampling , 2012, International Journal of Computer Vision.

[25]  Rama Chellappa,et al.  Entropy rate superpixel segmentation , 2011, CVPR 2011.

[26]  Stefano Soatto,et al.  Class segmentation and object localization with superpixel neighborhoods , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[27]  Jitendra Malik,et al.  Learning a classification model for segmentation , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[28]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[29]  Bao-Long Guo,et al.  CONIC: Contour Optimized Non-Iterative Clustering Superpixel Segmentation , 2021, Remote. Sens..