Fast multi-feature image segmentation

Abstract Multi-feature segmentation has demonstrated its superiority against one-dimensional feature approaches based on only grayscale information. Mean shift (MS) is an algorithm that has been used commonly for multi-feature segmentation. In spite of its interesting results, MS maintains a computational cost that is prohibitive for segmentation scenarios where the feature map consists of multi-dimensional features. In this paper, a new competitive segmentation algorithm for grayscale images is introduced. The proposed approach considers a two-dimensional feature map that includes the grayscale value and the local variance for each pixel in the image. To reduce the computational cost, the Mean shift (MS) algorithm is modified to operate with a very limited number of points from all available data. Under such conditions, two sets of elements are differentiated: involved data (the reduced dataset considered in the MS operation) and not involved data (the rest of the available data). Different from the classical MS, which employs Gaussian functions, in our approach, the process of estimating the feature map is carried out using a more accurate approach such as the Epanechnikov kernel function. Once the MS results are obtained, they are generalized to include the not involved data. Therefore, each unused element is assigned to the same cluster of the closest used data. Finally, clusters with the fewest elements are fused with other neighboring clusters. The proposed segmentation method has been compared with other state-of-art algorithms considering the full number of images from the Berkeley dataset. Experimental results confirm that the proposed scheme produces segmented images with a 50% better quality of visual perception approximately two times (≈ 1.8 − 2) faster than its competitors.

[1]  A. Nakib,et al.  Fast brain MRI segmentation based on two-dimensional survival exponential entropy and particle swarm optimization , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[2]  Jian Hou,et al.  A robust 2D Otsu's thresholding method in image segmentation , 2016, J. Vis. Commun. Image Represent..

[3]  Max Mignotte,et al.  A Label Field Fusion Bayesian Model and Its Penalized Maximum Rand Estimator for Image Segmentation , 2010, IEEE Transactions on Image Processing.

[4]  Tarn Duong,et al.  ks: Kernel Density Estimation and Kernel Discriminant Analysis for Multivariate Data in R , 2007 .

[5]  Yizong Cheng,et al.  Mean Shift, Mode Seeking, and Clustering , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  L. Coelho,et al.  Differential evolution optimization combined with chaotic sequences for image contrast enhancement , 2009 .

[7]  Xin-She Yang,et al.  Nature-Inspired Optimization Algorithms: Challenges and Open Problems , 2020, J. Comput. Sci..

[8]  Jitendra Malik,et al.  Normalized cuts and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[9]  Sun Fengjie,et al.  2D Otsu Segmentation Algorithm Based on Simulated Annealing Genetic Algorithm for Iced-Cable Images , 2009, 2009 International Forum on Information Technology and Applications.

[10]  José E. Chacón,et al.  Data‐driven choice of the smoothing parametrization for kernel density estimators , 2009 .

[11]  Xiangchu Feng,et al.  Variational and PCA based natural image segmentation , 2013, Pattern Recognit..

[12]  Wei Li,et al.  A multilevel image thresholding segmentation algorithm based on two-dimensional K-L divergence and modified particle swarm optimization , 2016, Appl. Soft Comput..

[13]  Asoke K. Nandi,et al.  Significantly Fast and Robust Fuzzy C-Means Clustering Algorithm Based on Morphological Reconstruction and Membership Filtering , 2018, IEEE Transactions on Fuzzy Systems.

[14]  Heng-Da Cheng,et al.  Color image segmentation based on homogram thresholding and region merging , 2002, Pattern Recognit..

[15]  Amer Draa,et al.  An artificial bee colony algorithm for image contrast enhancement , 2014, Swarm Evol. Comput..

[16]  Oscar C. Au,et al.  An adaptive unsupervised approach toward pixel clustering and color image segmentation , 2010, Pattern Recognit..

[17]  V. A. Epanechnikov Non-Parametric Estimation of a Multivariate Probability Density , 1969 .

[18]  Min Li,et al.  Sparse and Low-Rank Coupling Image Segmentation Model Via Nonconvex Regularization , 2015, Int. J. Pattern Recognit. Artif. Intell..

[19]  Agostinho C. Rosa,et al.  Gray-scale image enhancement as an automatic process driven by evolution , 2004, IEEE Trans. Syst. Man Cybern. Part B.

[20]  Xiao-Feng Li,et al.  Infrared Image Segmentation Based on AAFSA and 2D-Renyi Entropy Threshold Selection , 2017 .

[21]  Patrick Siarry,et al.  Fast multilevel thresholding for image segmentation through a multiphase level set method , 2013, Signal Process..

[22]  Wang Xue-guang,et al.  An Improved Image Segmentation Algorithm Based on Two- Dimensional Otsu Method , 2012 .

[23]  Hui Zhang,et al.  Image segmentation evaluation: A survey of unsupervised methods , 2008, Comput. Vis. Image Underst..

[24]  Artur Gramacki,et al.  Nonparametric Kernel Density Estimation and Its Computational Aspects , 2017 .

[25]  A. D. Brink Thresholding of digital images using two-dimensional entropies , 1992, Pattern Recognit..

[26]  Gonzalo Pajares,et al.  A Multilevel Thresholding algorithm using electromagnetism optimization , 2014, Neurocomputing.

[27]  Ahmed S. Abutableb Automatic thresholding of gray-level pictures using two-dimensional entropy , 1989 .

[28]  Ioannis Pitas,et al.  Color Texture Segmentation Based on the Modal Energy of Deformable Surfaces , 2009, IEEE Transactions on Image Processing.

[29]  Rajib Kumar Jha,et al.  A fast technique for image segmentation based on two Meta-heuristic algorithms , 2020, Multimedia Tools and Applications.

[30]  Amir Nakib,et al.  Image thresholding based on Pareto multiobjective optimization , 2010, Eng. Appl. Artif. Intell..

[31]  Erik Cuevas,et al.  Multi-level Image Thresholding Segmentation Using 2D Histogram Non-local Means and Metaheuristics Algorithms , 2020 .

[32]  B. Vinoth Kumar,et al.  A Decennary Survey on Artificial Intelligence Methods for Image Segmentation , 2019, Advanced Engineering Optimization Through Intelligent Techniques.

[33]  Xiaohong Shen,et al.  An Improved Two-Dimensional Entropic Thresholding Method Based on Ant Colony Genetic Algorithm , 2009, 2009 WRI Global Congress on Intelligent Systems.

[34]  Ke Zhang,et al.  Multi-Parameter-Setting Based on Data Original Distribution for DENCLUE Optimization , 2018, IEEE Access.

[35]  Jonghyun Park,et al.  Color image segmentation using adaptive mean shift and statistical model-based methods , 2009, Comput. Math. Appl..

[36]  Shui Yu,et al.  Learning Complementary Saliency Priors for Foreground Object Segmentation in Complex Scenes , 2014, International Journal of Computer Vision.

[37]  David W. Scott,et al.  Scott's rule , 2010 .

[38]  Guan Xinping Fast image segmentation based on particle swarm optimization and two-dimension Otsu method , 2007 .

[39]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[40]  Anis Ben Ishak,et al.  Choosing parameters for Rényi and Tsallis entropies within a two-dimensional multilevel image segmentation framework , 2017 .

[41]  Jean-Michel Morel,et al.  A non-local algorithm for image denoising , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[42]  Xiujuan Lei,et al.  Two-Dimensional Maximum Entropy Image Segmentation Method Based on Quantum-Behaved Particle Swarm Optimization Algorithm , 2008, 2008 Fourth International Conference on Natural Computation.

[43]  H. D. Cheng,et al.  Thresholding using two-dimensional histogram and fuzzy entropy principle , 2000, IEEE Trans. Image Process..

[44]  Chengming Qi,et al.  Maximum Entropy for Image Segmentation based on an Adaptive Particle Swarm Optimization , 2014 .

[45]  Erkki Oja,et al.  A new curve detection method: Randomized Hough transform (RHT) , 1990, Pattern Recognit. Lett..

[46]  Horst Bischof,et al.  Fast 3D Mean Shift Filter for CT Images , 2003, SCIA.

[47]  Yanhui Guo,et al.  An effective color image segmentation approach using neutrosophic adaptive mean shift clustering , 2018 .

[48]  Himanshu Mittal,et al.  An optimum multi-level image thresholding segmentation using non-local means 2D histogram and exponential Kbest gravitational search algorithm , 2018, Eng. Appl. Artif. Intell..

[49]  Yambem Jina Chanu,et al.  An image segmentation approach based on fuzzy c-means and dynamic particle swarm optimization algorithm , 2020, Multimedia Tools and Applications.

[50]  Jin Liu,et al.  Unified mean shift segmentation and graph region merging algorithm for infrared ship target segmentation , 2007 .

[51]  Charless C. Fowlkes,et al.  Contour Detection and Hierarchical Image Segmentation , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[52]  Bülent Sankur,et al.  Survey over image thresholding techniques and quantitative performance evaluation , 2004, J. Electronic Imaging.

[53]  Tarun Kumar Sharma,et al.  Adaptive Artificial Bee Colony for Segmentation of CT lung Images , 2012 .

[54]  Yan Chen,et al.  Adaptive entropy weighted picture fuzzy clustering algorithm with spatial information for image segmentation , 2020, Appl. Soft Comput..

[55]  Alaa F. Sheta,et al.  Particle swarm optimisation enhancement approach for improving image quality , 2007 .

[56]  Ajith Abraham,et al.  An evolutionary gray gradient algorithm for multilevel thresholding of brain MR images using soft computing techniques , 2017, Appl. Soft Comput..

[57]  Nor Ashidi Mat Isa,et al.  Color image segmentation using histogram thresholding - Fuzzy C-means hybrid approach , 2011, Pattern Recognit..

[58]  Qi Li,et al.  Nonparametric Econometrics: Theory and Practice , 2006 .

[59]  Daniel P. Huttenlocher,et al.  Efficient Graph-Based Image Segmentation , 2004, International Journal of Computer Vision.

[60]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[61]  Siu Kai Choy,et al.  Unsupervised fuzzy model-based image segmentation , 2020, Signal Process..

[62]  Swagatam Das,et al.  Multilevel Image Thresholding Based on 2D Histogram and Maximum Tsallis Entropy— A Differential Evolution Approach , 2013, IEEE Transactions on Image Processing.