Combining Multi-level Contexts of Superpixel using Convolutional Neural Networks to perform Natural Scene Labeling

Modern deep learning algorithms have triggered various image segmentation approaches. However, most of them deal with pixel-based segmentation. Superpixels, on the other hand, provide a certain degree of contextual information while reducing computation cost. In our approach, we have performed superpixel-level semantic segmentation considering three various levels as neighbors for semantic contexts. Furthermore, we have enlisted a number of ensemble approaches like max-voting and weighted average. We have also used the Dempster–Shafer theory of uncertainty to analyze confusion among various classes. Our method has proved to be superior to a number of different modern approaches on the same dataset.

[1]  Ying Liu,et al.  A survey of content-based image retrieval with high-level semantics , 2007, Pattern Recognit..

[2]  Svetlana Lazebnik,et al.  Superparsing - Scalable Nonparametric Image Parsing with Superpixels , 2010, International Journal of Computer Vision.

[3]  Jitendra Malik,et al.  Shape matching and object recognition using shape contexts , 2010, 2010 3rd International Conference on Computer Science and Information Technology.

[4]  Sankar K. Pal,et al.  A review on image segmentation techniques , 1993, Pattern Recognit..

[5]  Kari Sentz,et al.  Combination of Evidence in Dempster-Shafer Theory , 2002 .

[6]  Martial Hebert,et al.  Stacked Hierarchical Labeling , 2010, ECCV.

[7]  Glenn Shafer,et al.  A Mathematical Theory of Evidence , 2020, A Mathematical Theory of Evidence.

[8]  Yue Min Zhu,et al.  Study of Dempster-Shafer theory for image segmentation applications , 2002, Image Vis. Comput..

[9]  Stephen Gould,et al.  Decomposing a scene into geometric and semantically consistent regions , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[10]  Pascal Fua,et al.  SLIC Superpixels Compared to State-of-the-Art Superpixel Methods , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Camille Couprie,et al.  Learning Hierarchical Features for Scene Labeling , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Patrick J. Flynn,et al.  A Survey Of Free-Form Object Representation and Recognition Techniques , 2001, Comput. Vis. Image Underst..

[13]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Paul F. Whelan,et al.  Image segmentation based on the integration of colour-texture descriptors - A review , 2011, Pattern Recognit..

[15]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Wojciech Pieczynski,et al.  Multisensor image segmentation using Dempster-Shafer fusion in Markov fields context , 2001, IEEE Trans. Geosci. Remote. Sens..