A General and Balanced Region-Based Metric for Evaluating Medical Image Segmentation Algorithms

Evaluating medical imaging segmentation is a very complex problem. Several papers proposed methodologies and different metrics pursuing more reliable and unbiased procedures. In this paper, we propose a novel accuracy metric which is more balanced than the well known Dice and Jaccard coefficients. We also prove mathematically that the proposed metric generalizes Dice, Jaccard and the previously proposed Balanced Dice and Balanced Jaccard coefficients. Our experiments show that significant changes in brain tissue segmentation evaluation results are noticed as we applied our new metric.

[1]  Stephen M. Smith,et al.  Segmentation of brain MR images through a hidden Markov random field model and the expectation-maximization algorithm , 2001, IEEE Transactions on Medical Imaging.

[2]  Don Zagier,et al.  The Bloch-Wigner-Ramakrishnan polylogarithm function , 1990 .

[3]  Suyash P. Awate,et al.  Adaptive, Nonparametric Markov Modeling for Unsupervised, MRI Brain-Tissue Classification , 2006 .

[4]  Jayaram K. Udupa,et al.  Brain tissue MR-image segmentation via optimum-path forest clustering , 2012, Comput. Vis. Image Underst..

[5]  Paulo André Vechiatto Miranda,et al.  A case analysis of the impact of prior center of gravity estimation over skull-stripping algorithms in MR images , 2013, 2013 IEEE International Conference on Image Processing.

[6]  R. Leahy,et al.  Magnetic Resonance Image Tissue Classification Using a Partial Volume Model , 2001, NeuroImage.

[7]  George Hripcsak,et al.  Measuring agreement in medical informatics reliability studies , 2002, J. Biomed. Informatics.

[8]  Alexandre X. Falcão,et al.  Unraveling the Compromise between Skull Stripping and Inhomogeneity Correction in 3T MR Images , 2012, 2012 25th SIBGRAPI Conference on Graphics, Patterns and Images.

[9]  Daniel P. Huttenlocher,et al.  Comparing Images Using the Hausdorff Distance , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Brian B. Avants,et al.  N4ITK: Improved N3 Bias Correction , 2010, IEEE Transactions on Medical Imaging.

[11]  P. Jaccard,et al.  Etude comparative de la distribution florale dans une portion des Alpes et des Jura , 1901 .

[12]  Gregory G. Brown,et al.  Quantitative evaluation of automated skull‐stripping methods applied to contemporary and legacy images: Effects of diagnosis, bias correction, and slice location , 2006, Human brain mapping.

[13]  Syed Muhammad Anwar,et al.  Deep Learning in Medical Image Analysis , 2017 .

[14]  Jayaram K. Udupa,et al.  A critical analysis of the methods of evaluating MRI brain segmentation algorithms , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[15]  Guy B. Williams,et al.  The impact of skull-stripping and radio-frequency bias correction on grey-matter segmentation for voxel-based morphometry , 2008, NeuroImage.

[16]  L. R. Dice Measures of the Amount of Ecologic Association Between Species , 1945 .

[17]  Jayaram K. Udupa,et al.  A framework for evaluating image segmentation algorithms , 2006, Comput. Medical Imaging Graph..