Adaptive segmentation of traditional cultural pattern based on superpixel Log-Euclidean Gaussian metric

Abstract In order to improve the accuracy of objects similarity measurement of traditional cultural pattern segmentation and adaptively determine the number of segmentations, we propose an adaptive segmentation algorithm based on a new superpixel Log-Euclidean Gaussian metric (SLEGM) in this paper. We first propose to use the SLEGM to effectively characterize superpixels for more accurate measurement of their similarity. Because the space of Gaussians sample covariance matrix distribution is not a linear space but a Riemannian manifold, we map this manifold via matrix logarithm into a linear space, which enables us to handle Gaussians with Euclidean operations. Under the SLEGM framework, we develop an improved spectral clustering algorithm that can adaptively determine the number of clusters to achieve the adaptive segmentation for the traditional culture pattern. Extensive evaluations on the Berkeley Segmentation Data Set (BSDS500) benchmark verify that our algorithm outperforms the state-of-the-art techniques of the same category under four evaluation metrics, achieving 74.3% F-measure, 13.52% under segmentation error, 83.4% boundary recall and 97.79% achievable segmentation accuracy. Further experiments on our challenging Traditional Cultural Pattern Database (TCPD) indicate the effectiveness of our algorithm for segmenting the complex patterns.

[1]  Brijesh Verma,et al.  Roadside vegetation segmentation with Adaptive Texton Clustering Model , 2019, Eng. Appl. Artif. Intell..

[2]  Lei Zhang,et al.  Local Log-Euclidean Multivariate Gaussian Descriptor and Its Application to Image Classification , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Barnabás Póczos,et al.  Estimation of Renyi Entropy and Mutual Information Based on Generalized Nearest-Neighbor Graphs , 2010, NIPS.

[4]  Qi Tian,et al.  Multi-View Image Classification With Visual, Semantic and View Consistency , 2020, IEEE Transactions on Image Processing.

[5]  Witold Pedrycz,et al.  Fuzzy C-Means clustering through SSIM and patch for image segmentation , 2020, Appl. Soft Comput..

[6]  Fatih Murat Porikli,et al.  Region Covariance: A Fast Descriptor for Detection and Classification , 2006, ECCV.

[7]  Fan Zhong,et al.  Co-optimization of ethnic-pattern segmentation based on hierarchical patch matching , 2019 .

[8]  Jiulun Fan,et al.  Image thresholding segmentation method based on minimum square rough entropy , 2019, Appl. Soft Comput..

[9]  Ulrike von Luxburg,et al.  A tutorial on spectral clustering , 2007, Stat. Comput..

[10]  Rong Chen,et al.  A novel multiphoton microscopy images segmentation method based on superpixel and watershed , 2017, Journal of biophotonics.

[11]  Sébastien Lefèvre,et al.  Morphological Description of Color Images for Content-Based Image Retrieval , 2009, IEEE Transactions on Image Processing.

[12]  Jian Fan,et al.  Texture Classification by Wavelet Packet Signatures , 1993, MVA.

[13]  Fuyong Xing,et al.  Revisiting graph construction for fast image segmentation , 2018, Pattern Recognit..

[14]  Ren Bo,et al.  FLIC: Fast linear iterative clustering with active search , 2016, Computational Visual Media.

[15]  Jacob Goldberger,et al.  Hierarchical Image Segmentation Using Correlation Clustering , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[16]  Zhenzhou Wang,et al.  A non-iterative clustering based soft segmentation approach for a class of fuzzy images , 2017, Appl. Soft Comput..

[17]  Yong-Jin Liu,et al.  Intrinsic Manifold SLIC: A Simple and Efficient Method for Computing Content-Sensitive Superpixels , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[19]  Qilong Wang,et al.  Local Log-Euclidean Covariance Matrix (L2ECM) for Image Representation and Its Applications , 2012, ECCV.

[20]  Alessandro Laio,et al.  Clustering by fast search and find of density peaks , 2014, Science.

[21]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[22]  Jitendra Malik,et al.  Normalized Cuts and Image Segmentation , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  Charless C. Fowlkes,et al.  Contour Detection and Hierarchical Image Segmentation , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Jonathan T. Barron,et al.  Multiscale Combinatorial Grouping for Image Segmentation and Object Proposal Generation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Daniel P. Huttenlocher,et al.  Efficient Graph-Based Image Segmentation , 2004, International Journal of Computer Vision.

[26]  Licheng Jiao,et al.  Non-overlapping classification of hyperspectral imagery with superpixel segmentation , 2019, Appl. Soft Comput..

[27]  Sven J. Dickinson,et al.  TurboPixels: Fast Superpixels Using Geometric Flows , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[29]  Amit Verma,et al.  Deep learning based enhanced tumor segmentation approach for MR brain images , 2019, Appl. Soft Comput..

[30]  Pascal Fua,et al.  SLIC Superpixels Compared to State-of-the-Art Superpixel Methods , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  Stefan Roth,et al.  Tree-Structured Models for Efficient Multi-Cue Scene Labeling , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[32]  Takahiro Okabe,et al.  Hierarchical Gaussian Descriptors with Application to Person Re-Identification , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.