Combining information from thresholding techniques through an evolutionary Bayesian network algorithm

Abstract Segmentation is an important task in image processing because it could affect the performance of other steps in image analysis. One of the most used methods for segmentation is thresholding which can be formulated as an optimization problem, and evolutionary algorithms (EAs) are alternatives commonly applied to solve it. Estimation of Distribution Algorithms (EDAs) is a branch of EAs that explores the search space by building a probabilistic model, such as Bayesian Networks (BNs). In this article is proposed a BN-based EDA for multilevel image segmentation called BNMTH . The proposed approach iteratively selects the combination of thresholding techniques that permits to find the best configuration of thresholds for a digital image, exploring the inter-dependencies between the decision variables (thresholds) and the different techniques. BNMTH is applied over a set of benchmark images and the results of the segmentation are qualitatively analyzed by using the Peak Signal-to-Noise Ratio (PSNR), the Structure Similarity Index (SSIM) and the Feature Similarity Index (FSIM). Besides, a statistical analysis is provided to compare BNMTH with other state-of-the-art optimization algorithms. The results show that BNMTH is a competitive approach for image segmentation, providing accurate results in almost all the cases. Moreover, the segmented images and the histograms show that the classes are accurately generated even in complex conditions.

[1]  Ashish Kumar Bhandari,et al.  A novel color image multilevel thresholding based segmentation using nature inspired optimization algorithms , 2016, Expert Syst. Appl..

[2]  Mehmet Çunkas,et al.  Color image segmentation based on multiobjective artificial bee colony optimization , 2015, Appl. Soft Comput..

[3]  Jon Atli Benediktsson,et al.  An efficient method for segmentation of images based on fractional calculus and natural selection , 2012, Expert Syst. Appl..

[4]  Janez Brest,et al.  A hybrid differential evolution for optimal multilevel image thresholding , 2016, Expert Syst. Appl..

[5]  Jiulun Fan,et al.  Image thresholding segmentation method based on minimum square rough entropy , 2019, Appl. Soft Comput..

[6]  Bahriye Akay,et al.  A study on particle swarm optimization and artificial bee colony algorithms for multilevel thresholding , 2013, Appl. Soft Comput..

[7]  Haniza Yazid,et al.  Performance analysis of image thresholding: Otsu technique , 2018 .

[8]  D. Goldberg,et al.  BOA: the Bayesian optimization algorithm , 1999 .

[9]  Mohamed Batouche,et al.  A study on differential evolution and cellular differential evolution for multilevel color image segmentation , 2017, 2017 Intelligent Systems and Computer Vision (ISCV).

[10]  Provas Kumar Roy,et al.  Oppositional symbiotic organisms search optimization for multilevel thresholding of color image , 2019, Appl. Soft Comput..

[11]  Nir Friedman,et al.  Probabilistic Graphical Models - Principles and Techniques , 2009 .

[12]  G. Casella,et al.  Statistical Inference , 2003, Encyclopedia of Social Network Analysis and Mining.

[13]  Korris Fu-Lai Chung,et al.  Robust fuzzy clustering-based image segmentation , 2009, Appl. Soft Comput..

[14]  W. J. Conover,et al.  Practical Nonparametric Statistics , 1972 .

[15]  Gurdial Arora,et al.  A thresholding method based on two-dimensional Renyi's entropy , 2004, Pattern Recognit..

[16]  Yu Xue,et al.  Partitioned-cooperative quantum-behaved particle swarm optimization based on multilevel thresholding applied to medical image segmentation , 2017, Appl. Soft Comput..

[17]  Anupama Namburu,et al.  Soft fuzzy rough set-based MR brain image segmentation , 2017, Appl. Soft Comput..

[18]  J. A. Lozano,et al.  Estimation of Distribution Algorithms: A New Tool for Evolutionary Computation , 2001 .

[19]  Ming-Huwi Horng,et al.  Multilevel thresholding selection based on the artificial bee colony algorithm for image segmentation , 2011, Expert Syst. Appl..

[20]  Qiang Ji,et al.  A Bayesian Network Model for Automatic and Interactive Image Segmentation , 2011, IEEE Transactions on Image Processing.

[21]  K. G. Srinivasagan,et al.  Multilevel thresholding for segmentation of medical brain images using real coded genetic algorithm , 2014 .

[22]  Swagatam Das,et al.  A multilevel color image thresholding scheme based on minimum cross entropy and differential evolution , 2015, Pattern Recognit. Lett..

[23]  Qinghua Huang,et al.  Breast ultrasound image segmentation: a survey , 2017, International Journal of Computer Assisted Radiology and Surgery.

[24]  David E. Goldberg,et al.  Genetic algorithms and Machine Learning , 1988, Machine Learning.

[25]  Ming-Huwi Horng,et al.  Multilevel minimum cross entropy threshold selection based on the honey bee mating optimization , 2009, Expert Syst. Appl..

[26]  Swagatam Das,et al.  Hyper-spectral image segmentation using Rényi entropy based multi-level thresholding aided with differential evolution , 2016, Expert Syst. Appl..

[27]  David Zhang,et al.  FSIM: A Feature Similarity Index for Image Quality Assessment , 2011, IEEE Transactions on Image Processing.

[28]  C. H. Li,et al.  An iterative algorithm for minimum cross entropy thresholding , 1998, Pattern Recognit. Lett..

[29]  Gonzalo Pajares,et al.  Real-time video thresholding using evolutionary techniques and cross entropy , 2018, 2018 IEEE Conference on Evolving and Adaptive Intelligent Systems (EAIS).

[30]  Bijaya K. Panigrahi,et al.  Tsallis entropy based optimal multilevel thresholding using cuckoo search algorithm , 2013, Swarm Evol. Comput..

[31]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[32]  Hui-Fuang Ng Automatic thresholding for defect detection , 2006, Pattern Recognit. Lett..

[33]  Diego Colombo,et al.  Order-independent constraint-based causal structure learning , 2012, J. Mach. Learn. Res..

[34]  Concha Bielza,et al.  Multiobjective Estimation of Distribution Algorithm Based on Joint Modeling of Objectives and Variables , 2014, IEEE Transactions on Evolutionary Computation.

[35]  Gonzalo Pajares,et al.  Unassisted thresholding based on multi-objective evolutionary algorithms , 2018, Knowl. Based Syst..

[36]  Xin-She Yang,et al.  A New Metaheuristic Bat-Inspired Algorithm , 2010, NICSO.

[37]  Hossein Nezamabadi-pour,et al.  GSA: A Gravitational Search Algorithm , 2009, Inf. Sci..

[38]  Linda G. Shapiro,et al.  Image Segmentation Techniques , 1984, Other Conferences.

[39]  Nikhil R. Pal,et al.  On minimum cross-entropy thresholding , 1996, Pattern Recognit..

[40]  Kevin B. Korb,et al.  Bayesian Artificial Intelligence , 2004, Computer science and data analysis series.

[41]  Ashish Kumar Bhandari,et al.  Cuckoo search algorithm and wind driven optimization based study of satellite image segmentation for multilevel thresholding using Kapur's entropy , 2014, Expert Syst. Appl..

[42]  Tao Zhang,et al.  Interactive graph cut based segmentation with shape priors , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[43]  Changhe Yuan,et al.  Learning Optimal Bayesian Networks: A Shortest Path Perspective , 2013, J. Artif. Intell. Res..

[44]  Márcio Portes de Albuquerque,et al.  Image thresholding using Tsallis entropy , 2004, Pattern Recognit. Lett..

[45]  Gregory F. Cooper,et al.  A Bayesian method for the induction of probabilistic networks from data , 1992, Machine Learning.

[46]  Chun-hung Li,et al.  Minimum cross entropy thresholding , 1993, Pattern Recognit..

[47]  Ming-Huwi Horng,et al.  Multilevel minimum cross entropy threshold selection based on the firefly algorithm , 2011, Expert Syst. Appl..

[48]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[49]  Heming Jia,et al.  Kapur’s Entropy for Color Image Segmentation Based on a Hybrid Whale Optimization Algorithm , 2019, Entropy.

[50]  R. Kayalvizhi,et al.  Modified bacterial foraging algorithm based multilevel thresholding for image segmentation , 2011, Eng. Appl. Artif. Intell..

[51]  Anthony J. Yezzi,et al.  Information-Theoretic Active Polygons for Unsupervised Texture Segmentation , 2005, International Journal of Computer Vision.

[52]  Erik Valdemar Cuevas Jiménez,et al.  Entropy-based imagery segmentation for breast histology using the Stochastic Fractal Search , 2018, Neurocomputing.

[53]  Jitendra Malik,et al.  Normalized Cuts and Image Segmentation , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[54]  Jim Q. Smith,et al.  On the robustness of Bayesian networks to learning from non-conjugate sampling , 2010, Int. J. Approx. Reason..

[55]  R. Kayalvizhi,et al.  Comparison of intelligent techniques for multilevel thresholding problem , 2012 .

[56]  Djemel Ziou,et al.  Image Quality Metrics: PSNR vs. SSIM , 2010, 2010 20th International Conference on Pattern Recognition.

[57]  Martin Pelikan,et al.  Hierarchical Bayesian optimization algorithm: toward a new generation of evolutionary algorithms , 2010, SICE 2003 Annual Conference (IEEE Cat. No.03TH8734).

[58]  Daniel P. Huttenlocher,et al.  Efficient Graph-Based Image Segmentation , 2004, International Journal of Computer Vision.

[59]  Eric N. Mortensen,et al.  Real-Time Semi-Automatic Segmentation Using a Bayesian Network , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[60]  Marie-Pierre Jolly,et al.  Interactive graph cuts for optimal boundary & region segmentation of objects in N-D images , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[61]  Luis M. de Campos,et al.  Combining content-based and collaborative recommendations: A hybrid approach based on Bayesian networks , 2010, Int. J. Approx. Reason..

[62]  Constantin F. Aliferis,et al.  The max-min hill-climbing Bayesian network structure learning algorithm , 2006, Machine Learning.

[63]  Carolina P. de Almeida,et al.  Exploring the probabilistic graphic model of a hybrid multi-objective Bayesian estimation of distribution algorithm , 2018, Appl. Soft Comput..

[64]  Qiang Chen,et al.  Fuzzy c-means clustering with weighted image patch for image segmentation , 2012, Appl. Soft Comput..

[65]  Diego Oliva,et al.  Image segmentation via multilevel thresholding using hybrid optimization algorithms , 2018, J. Electronic Imaging.

[66]  Solomon Kullback,et al.  Information Theory and Statistics , 1960 .

[67]  Chun Yuan,et al.  Image segmentation based on Bayesian network-Markov random field model and its application to in vivo plaque composition , 2006, 3rd IEEE International Symposium on Biomedical Imaging: Nano to Macro, 2006..

[68]  Tony F. Chan,et al.  An Active Contour Model without Edges , 1999, Scale-Space.

[69]  Concha Bielza,et al.  A review on probabilistic graphical models in evolutionary computation , 2012, Journal of Heuristics.

[70]  Michael I. Jordan,et al.  Graphical Models, Exponential Families, and Variational Inference , 2008, Found. Trends Mach. Learn..

[71]  Lianghai Jin,et al.  Characteristic analysis of Otsu threshold and its applications , 2011, Pattern Recognit. Lett..

[72]  Peng Huang,et al.  An artificial ant colonies approach to medical image segmentation , 2008, Comput. Methods Programs Biomed..

[73]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[74]  Sankar K. Pal,et al.  A review on image segmentation techniques , 1993, Pattern Recognit..

[75]  Francisco Herrera,et al.  A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms , 2011, Swarm Evol. Comput..

[76]  Erik Valdemar Cuevas Jiménez,et al.  A novel multi-threshold segmentation approach based on differential evolution optimization , 2010, Expert Syst. Appl..

[77]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[78]  Jitender Kumar Chhabra,et al.  Kapur's entropy based optimal multilevel image segmentation using Crow Search Algorithm , 2020, Appl. Soft Comput..

[79]  Constantin F. Aliferis,et al.  Algorithms for Large Scale Markov Blanket Discovery , 2003, FLAIRS.

[80]  Daniel M. Kane,et al.  Robust Learning of Fixed-Structure Bayesian Networks , 2016, NeurIPS.

[81]  Erik Valdemar Cuevas Jiménez,et al.  Image segmentation by minimum cross entropy using evolutionary methods , 2017, Soft Computing.

[82]  Andrew K. C. Wong,et al.  A new method for gray-level picture thresholding using the entropy of the histogram , 1985, Comput. Vis. Graph. Image Process..

[83]  Jing Li Wang,et al.  Color image segmentation: advances and prospects , 2001, Pattern Recognit..

[84]  Gonzalo Pajares,et al.  Multilevel Thresholding Segmentation Based on Harmony Search Optimization , 2013, J. Appl. Math..

[85]  Jitendra Malik,et al.  A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.