Correlation between image quality metrics of magnetic resonance images and the neural network segmentation accuracy

Deep neural networks with multilevel connections process input data in complex ways to learn the information. A network’s learning efficiency depends not only on the complex neural network architecture but also on the input training images. Medical image segmentation with deep neural networks for skull stripping or tumor segmentation from magnetic resonance (MR) images enables learning both global and local features of the images. Though medical images are collected in a controlled environment, there may be artifacts or equipment-based variance that cause inherent bias in the input set. In this study, we investigated the correlation between the image quality metrics (IQM) of MR images with the neural network segmentation accuracy. For that we have used the 3D DenseNet architecture and let the network trained on the same input but applying different methodologies to select the training data set based on the IQM values. The difference in the segmentation accuracy between models based on the random training inputs with IQM based training inputs shed light on the role of image quality metrics on segmentation accuracy. By running the image quality metrics to choose the training inputs, further we may tune the learning efficiency of the network and the segmentation accuracy.

[1]  Huiyan Jiang,et al.  Deep learning techniques for tumor segmentation: a review , 2021, The Journal of Supercomputing.

[2]  Xingsheng Gu,et al.  Dual‐pathway DenseNets with fully lateral connections for multimodal brain tumor segmentation , 2020, Int. J. Imaging Syst. Technol..

[3]  John P. Dickerson,et al.  Just How Toxic is Data Poisoning? A Unified Benchmark for Backdoor and Data Poisoning Attacks , 2020, ICML.

[4]  Anant Madabhushi,et al.  MRQy: An Open-Source Tool for Quality Control of MR Imaging Data , 2020, ArXiv.

[5]  Boqiang Liu,et al.  Multi‐Scale 3D U‐Nets: An approach to automatic segmentation of brain tumor , 2020, Int. J. Imaging Syst. Technol..

[6]  P. Rizkallah,et al.  Association of Fluorescent Protein Pairs and Its Significant Impact on Fluorescence and Energy Transfer , 2020, Advanced science.

[7]  David Alonso-Caneiro,et al.  Effect of Altered OCT Image Quality on Deep Learning Boundary Segmentation , 2020, IEEE Access.

[8]  N. McVicar,et al.  Comparing Deep Learning-based Auto-segmentation of Organs at Risk and Clinical Target Volumes to Expert Inter-Observer Variability in Radiotherapy Planning , 2019, International Journal of Radiation Oncology*Biology*Physics.

[9]  Hui Liu,et al.  MMAN: Multi-modality aggregation network for brain segmentation from MR images , 2019, Neurocomputing.

[10]  Richard Frayne,et al.  Convolutional neural networks for skull-stripping in brain MR imaging using silver standard masks , 2019, Artif. Intell. Medicine.

[11]  David Bonekamp,et al.  Automated brain extraction of multisequence MRI using artificial neural networks , 2019, Human brain mapping.

[12]  Jing Yuan,et al.  HyperDense-Net: A Hyper-Densely Connected CNN for Multi-Modal Image Segmentation , 2018, IEEE Transactions on Medical Imaging.

[13]  Nima Tajbakhsh,et al.  UNet++: A Nested U-Net Architecture for Medical Image Segmentation , 2018, DLMIA/ML-CDS@MICCAI.

[14]  R. Gillies,et al.  Repeatability and Reproducibility of Radiomic Features: A Systematic Review , 2018, International journal of radiation oncology, biology, physics.

[15]  Ben Glocker,et al.  Multi-modal Learning from Unpaired Images: Application to Multi-organ Segmentation in CT and MRI , 2018, 2018 IEEE Winter Conference on Applications of Computer Vision (WACV).

[16]  Chenliang Xu,et al.  MRI tumor segmentation with densely connected 3D CNN , 2018, Medical Imaging.

[17]  Krzysztof J. Gorgolewski,et al.  MRIQC: Advancing the automatic prediction of image quality in MRI from unseen sites , 2016, bioRxiv.

[18]  Thomas Brox,et al.  Universal Adversarial Perturbations Against Semantic Image Segmentation , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[19]  Deniz Erdogmus,et al.  Auto-Context Convolutional Neural Network (Auto-Net) for Brain Extraction in Magnetic Resonance Imaging , 2017, IEEE Transactions on Medical Imaging.

[20]  Thomas Brox,et al.  Adversarial Examples for Semantic Image Segmentation , 2017, ICLR.

[21]  Vince D. Calhoun,et al.  End-to-end learning of brain tissue segmentation from imperfect labeling , 2016, 2017 International Joint Conference on Neural Networks (IJCNN).

[22]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[23]  Ye Zhang,et al.  A Sensitivity Analysis of (and Practitioners’ Guide to) Convolutional Neural Networks for Sentence Classification , 2015, IJCNLP.

[24]  Humera Tariq,et al.  OTSU ’ S SEGMENTATION : REVIEW , VISUALIZATION AND ANALYSIS IN CONTEXT OF AXIAL BRAIN MR SLICES , 2017 .

[25]  R Cameron Craddock,et al.  The preprocessed connectomes project repository of manually corrected skull-stripped T1-weighted anatomical MRI data , 2016, bioRxiv.

[26]  Thomas Brox,et al.  3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation , 2016, MICCAI.

[27]  Lina J. Karam,et al.  Understanding how image quality affects deep neural networks , 2016, 2016 Eighth International Conference on Quality of Multimedia Experience (QoMEX).

[28]  Yaozong Gao,et al.  Fully convolutional networks for multi-modality isointense infant brain image segmentation , 2016, 2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI).

[29]  Klaus H. Maier-Hein,et al.  Deep MRI brain extraction: A 3D convolutional neural network for skull stripping , 2016, NeuroImage.

[30]  Brian B. Avants,et al.  The Multimodal Brain Tumor Image Segmentation Benchmark (BRATS) , 2015, IEEE Transactions on Medical Imaging.

[31]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[32]  Anjan Biswas,et al.  Robust Skull-Stripping Segmentation Based on Irrational Mask for Magnetic Resonance Brain Images , 2015, Journal of Digital Imaging.

[33]  P. Lambin,et al.  Robust Radiomics Feature Quantification Using Semiautomatic Volumetric Segmentation , 2014, PloS one.

[34]  P. Lambin,et al.  Decoding tumour phenotype by noninvasive imaging using a quantitative radiomics approach , 2014, Nature Communications.

[35]  Joan Bruna,et al.  Intriguing properties of neural networks , 2013, ICLR.

[36]  Luis Ibáñez,et al.  The Design of SimpleITK , 2013, Front. Neuroinform..

[37]  Bilwaj Gaonkar,et al.  Multi-atlas skull-stripping. , 2013, Academic radiology.

[38]  Stephen M. Moore,et al.  The Cancer Imaging Archive (TCIA): Maintaining and Operating a Public Information Repository , 2013, Journal of Digital Imaging.

[39]  Nitish Srivastava,et al.  Multimodal learning with deep Boltzmann machines , 2012, J. Mach. Learn. Res..

[40]  Claudio A. Perez,et al.  An accurate skull stripping method based on simplex meshes and histogram analysis for magnetic resonance images , 2012, Journal of Neuroscience Methods.

[41]  D. Louis Collins,et al.  BEaST: Brain extraction based on nonlocal segmentation technique , 2012, NeuroImage.

[42]  K. Somasundaram,et al.  Automatic brain extraction methods for T1 magnetic resonance images using region labeling and morphological operations , 2011, Comput. Biol. Medicine.

[43]  Yu Xiang Zhou,et al.  Fast algorithm for calculation of inhomogeneity gradient in magnetic resonance imaging data , 2010, Journal of magnetic resonance imaging : JMRI.

[44]  Karuppana Gounder Somasundaram,et al.  Fully automatic brain extraction algorithm for axial T2-weighted magnetic resonance images , 2010, Comput. Biol. Medicine.

[45]  Michael W. L. Chee,et al.  Skull stripping using graph cuts , 2010, NeuroImage.

[46]  Guido Gerig,et al.  User-guided 3D active contour segmentation of anatomical structures: Significantly improved efficiency and reliability , 2006, NeuroImage.

[47]  Richard M. Leahy,et al.  BrainSuite: An Automated Cortical Surface Identification Tool , 2000, MICCAI.

[48]  Heinz-Otto Peitgen,et al.  The Skull Stripping Problem in MRI Solved by a Single 3D Watershed Transform , 2000, MICCAI.

[49]  Michael I. Jordan,et al.  Advances in Neural Information Processing Systems 30 , 1995 .