Performance evaluation of image segmentation algorithms on microscopic image data

In our paper, we present a performance evaluation of image segmentation algorithms on microscopic image data. In spite of the existence of many algorithms for image data partitioning, there is no universal and ‘the best’ method yet. Moreover, images of microscopic samples can be of various character and quality which can negatively influence the performance of image segmentation algorithms. Thus, the issue of selecting suitable method for a given set of image data is of big interest. We carried out a large number of experiments with a variety of segmentation methods to evaluate the behaviour of individual approaches on the testing set of microscopic images (cross‐section images taken in three different modalities from the field of art restoration). The segmentation results were assessed by several indices used for measuring the output quality of image segmentation algorithms. In the end, the benefit of segmentation combination approach is studied and applicability of achieved results on another representatives of microscopic data category – biological samples – is shown.

[1]  Bram van Ginneken,et al.  Toward automated segmentation of the pathological lung in CT , 2005, IEEE Transactions on Medical Imaging.

[2]  Richard W. Hamming,et al.  Error detecting and error correcting codes , 1950 .

[3]  Qian Huang,et al.  Quantitative methods of evaluating image segmentation , 1995, Proceedings., International Conference on Image Processing.

[4]  F. Wilcoxon.  Individual Comparisons by Ranking Methods , 1945 .

[5]  Xiaoyi Jiang,et al.  Segmentation Ensemble via Kernels , 2011, The First Asian Conference on Pattern Recognition.

[6]  Sandro Vega-Pons,et al.  A Survey of Clustering Ensemble Algorithms , 2011, Int. J. Pattern Recognit. Artif. Intell..

[7]  Frank Y. Shih,et al.  Image Segmentation , 2007, Encyclopedia of Biometrics.

[8]  James Bailey,et al.  Information theoretic measures for clusterings comparison: is a correction for chance necessary? , 2009, ICML '09.

[9]  Josef Kittler,et al.  Minimum error thresholding , 1986, Pattern Recognit..

[10]  Jitendra Malik,et al.  A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[11]  Charless C. Fowlkes,et al.  Contour Detection and Hierarchical Image Segmentation , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Andrew Blake,et al.  "GrabCut" , 2004, ACM Trans. Graph..

[13]  Carlos Ortiz-de-Solorzano,et al.  Combination Strategies in Multi-Atlas Image Segmentation: Application to Brain MR Data , 2009, IEEE Transactions on Medical Imaging.

[14]  Andrew K. C. Wong,et al.  A new method for gray-level picture thresholding using the entropy of the histogram , 1985, Comput. Vis. Graph. Image Process..

[15]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Jitendra Malik,et al.  Normalized cuts and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[17]  W. Pratt.  Digital Image Processing: Piks Scientific Inside , 1978 .

[18]  C. Mallows,et al.  A Method for Comparing Two Hierarchical Clusterings , 1983 .

[19]  Pushmeet Kohli,et al.  Robust Higher Order Potentials for Enforcing Label Consistency , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[20]  Hui Zhang,et al.  Image segmentation evaluation: A survey of unsupervised methods , 2008, Comput. Vis. Image Underst..

[21]  Chris A. Glasbey,et al.  An Analysis of Histogram-Based Thresholding Algorithms , 1993, CVGIP Graph. Model. Image Process..

[22]  C. H. Li,et al.  An iterative algorithm for minimum cross entropy thresholding , 1998, Pattern Recognit. Lett..

[23]  Alexander Dekhtyar,et al.  Information Retrieval , 2018, Lecture Notes in Computer Science.

[24]  Xavier Cufí,et al.  Yet Another Survey on Image Segmentation: Region and Boundary Information Integration , 2002, ECCV.

[25]  Xiaoyi Jiang,et al.  Image Segmentation Fusion Using General Ensemble Clustering Methods , 2010, ACCV.

[26]  Boris Mirkin,et al.  Mathematical Classification and Clustering , 1996 .

[27]  Amanda J. C. Sharkey,et al.  On Combining Artificial Neural Nets , 1996, Connect. Sci..

[28]  智一 吉田,et al.  Efficient Graph-Based Image Segmentationを用いた圃場図自動作成手法の検討 , 2014 .

[29]  Sankar K. Pal,et al.  A review on image segmentation techniques , 1993, Pattern Recognit..

[30]  Shyang Chang,et al.  A new criterion for automatic multilevel thresholding , 1995, IEEE Trans. Image Process..

[31]  N. Otsu.  A threshold selection method from gray level histograms , 1979 .

[32]  R. Deriche,et al.  A variational framework for active and adaptative segmentation of vector valued images , 2002, Workshop on Motion and Video Computing, 2002. Proceedings..

[33]  Jiri Matas,et al.  On Combining Classifiers , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[34]  Hai Jin,et al.  Image Thresholding Using Graph Cuts , 2008, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[35]  L. R. Dice.  Measures of the Amount of Ecologic Association Between Species , 1945 .

[36]  M L Mendelsohn,et al.  THE ANALYSIS OF CELL IMAGES * , 1966, Annals of the New York Academy of Sciences.

[37]  Torsten Rohlfing,et al.  Quo Vadis, Atlas-Based Segmentation? , 2005 .

[38]  T. W. Ridler,et al.  Picture thresholding using an iterative selection method. , 1978 .

[39]  Abhijit G. Shanbhag,et al.  Utilization of Information Measure as a Means of Image Thresholding , 1994, CVGIP Graph. Model. Image Process..

[40]  Yogesh Rathi,et al.  A Graph Cut Approach to Image Segmentation in Tensor Space , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[41]  Moni Naor,et al.  Rank aggregation methods for the Web , 2001, WWW '01.

[42]  Mao-Jiun J. Wang,et al.  Image thresholding by minimizing the measures of fuzzines , 1995, Pattern Recognit..

[43]  Jacob Cohen.  A Coefficient of Agreement for Nominal Scales , 1960 .

[44]  D. Obradovic,et al.  Combining Artificial Neural Nets , 1999, Perspectives in Neural Computing.

[45]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[46]  M. Meilă.  Comparing clusterings---an information based distance , 2007 .

[47]  William M. Wells,et al.  Simultaneous truth and performance level estimation (STAPLE): an algorithm for the validation of image segmentation , 2004, IEEE Transactions on Medical Imaging.

[48]  Jianbo Shi,et al.  Spectral segmentation with multiscale graph decomposition , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[49]  Y. Zhang,et al.  A REVIEW ON IMAGE SEGMENTATION TECHNIQUES WITH REMOTE SENSING PERSPECTIVE , 2010 .

[50]  M. Cugmas,et al.  On comparing partitions , 2015 .

[51]  P. Sivakumar,et al.  A REVIEW ON IMAGE SEGMENTATION TECHNIQUES , 2016 .

[52]  William M. Rand,et al.  Objective Criteria for the Evaluation of Clustering Methods , 1971 .

[53]  Ludmila I. Kuncheva,et al.  Experimental Comparison of Cluster Ensemble Methods , 2006, 2006 9th International Conference on Information Fusion.

[54]  Leo Grady,et al.  Random Walks for Image Segmentation , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[55]  Wen-Hsiang Tsai,et al.  Moment-preserving thresolding: A new approach , 1985, Comput. Vis. Graph. Image Process..

[56]  Worthie Doyle,et al.  Operations Useful for Similarity-Invariant Pattern Recognition , 1962, JACM.

[57]  G. Zack,et al.  Automatic measurement of sister chromatid exchange frequency. , 1977, The journal of histochemistry and cytochemistry : official journal of the Histochemistry Society.

[58]  Azriel Rosenfeld,et al.  Histogram concavity analysis as an aid in threshold selection , 1983, IEEE Transactions on Systems, Man, and Cybernetics.

[59]  Tony F. Chan,et al.  Active contours without edges , 2001, IEEE Trans. Image Process..

[60]  Matthijs J. Warrens,et al.  On the Equivalence of Cohen’s Kappa and the Hubert-Arabie Adjusted Rand Index , 2008, J. Classif..

[61]  Jan Blazek,et al.  Removing the artifacts from artwork cross-section images , 2011, 2011 18th IEEE International Conference on Image Processing.

[62]  P. Jaccard.  THE DISTRIBUTION OF THE FLORA IN THE ALPINE ZONE.1 , 1912 .

[63]  Vasyl Pihur,et al.  RankAggreg, an R package for weighted rank aggregation , 2009, BMC Bioinformatics.

[64]  J. MacQueen.  Some methods for classification and analysis of multivariate observations , 1967 .

[65]  Joydeep Ghosh,et al.  Cluster Ensembles --- A Knowledge Reuse Framework for Combining Multiple Partitions , 2002, J. Mach. Learn. Res..