Tree-Wise Discriminative Subtree Selection for Texture Image Labeling

In this paper, we propose a method for texture image labeling that works with a small number of training images. Our method is based on a tree of shapes and histogram features computed on the tree structure. Labeling results could be obtained by simply classifying the histogram features of all nodes in a tree of shapes. However, it is difficult to obtain satisfactory results, because features of smaller nodes are not sufficiently discriminative. Consequently, our method selects optimal discriminative subtrees for image labeling. We model an objective function that includes the parameters of a classifier and a set of thresholds for each training image to be used to select optimal subtrees. Then, labeling is performed by mapping the classification results of selected subtrees into corresponding blobs in the image. Experimental results with synthetic and real data sets that we created for evaluation show that the proposed method performs qualitatively and quantitatively much better than the existing methods.

[1]  Dong Chen,et al.  Local Topographic Shape Patterns for Texture Description , 2015, IEEE Signal Processing Letters.

[2]  Chih-Jen Lin,et al.  LIBLINEAR: A Library for Large Linear Classification , 2008, J. Mach. Learn. Res..

[3]  Daniel P. Huttenlocher,et al.  Efficient Graph-Based Image Segmentation , 2004, International Journal of Computer Vision.

[4]  Seunghoon Hong,et al.  Learning Deconvolution Network for Semantic Segmentation , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[5]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Wilson S. Geisler,et al.  Multichannel Texture Analysis Using Localized Spatial Filters , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Svetlana Lazebnik,et al.  Superparsing , 2010, International Journal of Computer Vision.

[9]  Michel Couprie,et al.  Building the Component Tree in Quasi-Linear Time , 2006, IEEE Transactions on Image Processing.

[10]  Ron Kikinis,et al.  Markov random field segmentation of brain MR images , 1997, IEEE Transactions on Medical Imaging.

[11]  Shinji Tanaka,et al.  Discriminative Subtree Selection for NBI Endoscopic Image Labeling , 2016, ACCV Workshops.

[12]  Ronald Jones,et al.  Connected Filtering and Segmentation Using Component Trees , 1999, Comput. Vis. Image Underst..

[13]  Thierry Géraud,et al.  MToS: A Tree of Shapes for Multivariate Images , 2015, IEEE Transactions on Image Processing.

[14]  S. Mallat Multiresolution approximations and wavelet orthonormal bases of L^2(R) , 1989 .

[15]  Stephen M. Smith,et al.  Segmentation of brain MR images through a hidden Markov random field model and the expectation-maximization algorithm , 2001, IEEE Transactions on Medical Imaging.

[16]  Cordelia Schmid,et al.  A sparse texture representation using local affine regions , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Shimon Ullman,et al.  Combining Top-Down and Bottom-Up Segmentation , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[18]  Jitendra Malik,et al.  Representing and Recognizing the Visual Appearance of Materials using Three-dimensional Textons , 2001, International Journal of Computer Vision.

[19]  Stéphane Mallat,et al.  A Theory for Multiresolution Signal Decomposition: The Wavelet Representation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Luciano Alparone,et al.  SAR Image Classification Through Information-Theoretic Textural Features, MRF Segmentation, and Object-Oriented Learning Vector Quantization , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[21]  Vladlen Koltun,et al.  Efficient Inference in Fully Connected CRFs with Gaussian Edge Potentials , 2011, NIPS.

[22]  Julie Delon,et al.  Shape-based Invariant Texture Indexing , 2010, International Journal of Computer Vision.

[23]  Antonio Criminisi,et al.  TextonBoost for Image Understanding: Multi-Class Object Recognition and Segmentation by Jointly Modeling Texture, Layout, and Context , 2007, International Journal of Computer Vision.

[24]  Tianli Yu,et al.  Kernelized structural SVM learning for supervised object segmentation , 2011, CVPR 2011.

[25]  Pascal Monasse,et al.  Scale-Space from a Level Lines Tree , 2000, J. Vis. Commun. Image Represent..

[26]  Gabriele Moser,et al.  Classification of Very High Resolution SAR Images of Urban Areas Using Copulas and Texture in a Hierarchical Markov Random Field Model , 2013, IEEE Geoscience and Remote Sensing Letters.

[27]  L. R. Dice Measures of the Amount of Ecologic Association Between Species , 1945 .

[28]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  Guosheng Lin,et al.  CRF Learning with CNN Features for Image Segmentation , 2015, Pattern Recognit..

[30]  Jean Serra,et al.  Image Analysis and Mathematical Morphology , 1983 .

[31]  智一 吉田,et al.  Efficient Graph-Based Image Segmentationを用いた圃場図自動作成手法の検討 , 2014 .

[32]  Andrew Zisserman,et al.  Delving deeper into the whorl of flower segmentation , 2010, Image Vis. Comput..

[33]  Jean Cousty,et al.  Incremental Algorithm for Hierarchical Minimum Spanning Forests and Saliency of Watershed Cuts , 2011, ISMM.

[34]  Philippe Salembier,et al.  Binary partition tree as an efficient representation for image processing, segmentation, and information retrieval , 2000, IEEE Trans. Image Process..

[35]  Christophe Collet,et al.  Connected image processing with multivariate attributes: An unsupervised Markovian classification approach , 2015, Comput. Vis. Image Underst..

[36]  Wenjing Tang,et al.  An image segmentation algorithm based on improved multiscale random field model in wavelet domain , 2016, J. Ambient Intell. Humaniz. Comput..

[37]  Yongchao Xu,et al.  Two Applications of Shape-Based Morphology: Blood Vessels Segmentation and a Generalization of Constrained Connectivity , 2013, ISMM.

[38]  Hugues Talbot,et al.  Filtering and segmentation of 3D angiographic data: Advances based on mathematical morphology , 2013, Medical Image Anal..

[39]  Luc Van Gool,et al.  The Pascal Visual Object Classes (VOC) Challenge , 2010, International Journal of Computer Vision.

[40]  Laurent Najman,et al.  A Quasi-linear Algorithm to Compute the Tree of Shapes of nD Images , 2013, ISMM.

[41]  Camille Couprie,et al.  Learning Hierarchical Features for Scene Labeling , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[42]  Antonio Criminisi,et al.  TextonBoost: Joint Appearance, Shape and Context Modeling for Multi-class Object Recognition and Segmentation , 2006, ECCV.

[43]  Shinji Tanaka,et al.  SVM-MRF segmentation of colorectal NBI endoscopic images , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[44]  Zoltan Kato,et al.  A Markov random field image segmentation model for color textured images , 2006, Image Vis. Comput..

[45]  M. R. Turner,et al.  Texture discrimination by Gabor functions , 1986, Biological Cybernetics.

[46]  Gang Liu,et al.  Texture Analysis with Shape Co-occurrence Patterns , 2014, 2014 22nd International Conference on Pattern Recognition.

[47]  Antonio Torralba,et al.  Nonparametric scene parsing: Label transfer via dense scene alignment , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.