Scale-free Texture Segmentation: Expert Feature-based versus Deep Learning strategies

Texture segmentation constitutes a central task in image processing, classically based on two-step procedures consisting first in computing hand-crafted features devised from a priori expert knowledge and second in combining them into clustering algorithms. Deep learning approaches can be seen as merging these two steps into a single one with both discovering features and performing segmentation. Using fractal textures, often seen as relevant models in real-world applications, the present work compares a recently devised texture segmentation algorithm incorporating expert-driven scale-free features estimation into a Joint TV optimization framework against convolutional neural network architectures. From realistic synthetic textures, comparisons are drawn not only for segmentation performance, but also with respect to computational costs, architecture complexities and robustness against departures between training and testing datasets.

[1]  DeLiang Wang,et al.  Factorization-Based Texture Segmentation , 2015, IEEE Transactions on Image Processing.

[2]  Sharmila Majumdar,et al.  Fractal analysis of bone X-ray tomographic microscopy projections , 2001, IEEE Transactions on Medical Imaging.

[3]  Kurt J. Marfurt,et al.  Integrated seismic texture segmentation and clustering analysis to improved delineation of reservoir geometry , 2009 .

[4]  S. Mallat A wavelet tour of signal processing , 1998 .

[5]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[6]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[7]  Yann LeCun,et al.  Learning Fast Approximations of Sparse Coding , 2010, ICML.

[8]  Nelly Pustelnik,et al.  Joint Estimation of Local Variance and Local Regularity for Texture Segmentation. Application to Multiphase Flow Characterization , 2018, 2018 25th IEEE International Conference on Image Processing (ICIP).

[9]  Kai-Tai Song,et al.  Lateral Driving Assistance Using Optical Flow and Scene Analysis , 2007, 2007 IEEE Intelligent Vehicles Symposium.

[10]  Matthias Bethge,et al.  One-shot Texture Segmentation , 2018, ArXiv.

[11]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  P PentlandAlex Fractal-Based Description of Natural Scenes , 1984 .

[13]  Lance M. Kaplan Extended fractal analysis for texture classification and segmentation , 1999, IEEE Trans. Image Process..

[14]  P. Abry,et al.  Nonsmooth Convex Joint Estimation of Local Regularity and Local Variance for Fractal Texture Segmentation , 2019, 1910.05246.

[15]  Iasonas Kokkinos,et al.  Deep Filter Banks for Texture Recognition, Description, and Segmentation , 2015, International Journal of Computer Vision.

[16]  Alain Arneodo,et al.  Mammographic evidence of microenvironment changes in tumorous breasts , 2017, Medical physics.

[17]  Charless C. Fowlkes,et al.  Contour Detection and Hierarchical Image Segmentation , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Patrice Abry,et al.  When Van Gogh meets Mandelbrot: Multifractal classification of painting's texture , 2013, Signal Process..

[19]  Gabriele Steidl,et al.  Multiclass Segmentation by Iterated ROF Thresholding , 2013, EMMCVPR.

[20]  Camille Couprie,et al.  Semantic Segmentation using Adversarial Networks , 2016, NIPS 2016.

[21]  Bidyut Baran Chaudhuri,et al.  Texture Segmentation Using Fractal Dimension , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  Patrice Abry,et al.  Wavelet leaders and bootstrap for multifractal analysis of images , 2009, Signal Process..

[23]  Jitendra Malik,et al.  Hypercolumns for object segmentation and fine-grained localization , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[24]  James M. Keller,et al.  Texture description and segmentation through fractal geometry , 1989, Comput. Vis. Graph. Image Process..

[25]  A. Arneodo,et al.  A wavelet-based method for multifractal image analysis. III. Applications to high-resolution satellite images of cloud structure , 2000 .

[26]  Usman Qamar,et al.  Texture Classification Using Rotation- and Scale-Invariant Gabor Texture Features , 2013, IEEE Signal Processing Letters.

[27]  Alex Pentland,et al.  Fractal-Based Description of Natural Scenes , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Hongyuan Zha,et al.  Fractal Dimension Invariant Filtering and Its CNN-Based Implementation , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[29]  S C Chapman,et al.  Scale-free texture of the fast solar wind. , 2011, Physical review. E, Statistical, nonlinear, and soft matter physics.

[30]  Xiang Zhang,et al.  OverFeat: Integrated Recognition, Localization and Detection using Convolutional Networks , 2013, ICLR.

[31]  Paul F. Whelan,et al.  Texture segmentation with Fully Convolutional Networks , 2017, ArXiv.

[32]  Dinggang Shen,et al.  Joint Segmentation of Multiple Thoracic Organs in CT Images with Two Collaborative Deep Architectures , 2017, DLMIA/ML-CDS@MICCAI.

[33]  Patrice Abry,et al.  Wavelet Leader multifractal analysis for texture classification , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).