High-quality segmentation of low quality cardiac MR images using k-space artefact correction

Deep learning methods have shown great success in segmenting the anatomical and pathological structures in medical images. This success is closely bounded with the quality of the images in the dataset that are being segmented. A commonly overlooked issue in the medical image analysis community is the vast amount of clinical images that have severe image artefacts. In this paper, we discuss the implications of image artefacts on cardiac MR segmentation and compare a variety of approaches for motion artefact correction with our proposed method Automap-GAN. Our method is based on the recently developed Automap reconstruction method, which directly reconstructs high quality MR images from k-space using deep learning. We propose to use a loss function that combines mean square error with structural similarity index to robustly segment poor-quality images. We train the reconstruction network to automatically correct for motion-related artefacts using synthetically corrupted CMR k-space data and uncorrected reconstructed images. In the experiments, we apply the proposed method to correct for motion artefacts on a large dataset of 1,400 subjects to improve image quality. The improvement of image quality is quantitatively assessed using segmentation accuracy as a metric. The segmentation is improved from 0.63 to 0.72 dice overlap after artefact correction. We quantitatively compare our method with a variety of techniques for recovering image quality to showcase the influence on segmentation. In addition, we qualitatively evaluate the proposed technique using k-space data containing real motion artefacts.

[1]  Lei Zhang,et al.  Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising , 2016, IEEE Transactions on Image Processing.

[2]  Ben Glocker,et al.  Automated cardiovascular magnetic resonance image analysis with fully convolutional networks , 2017, Journal of Cardiovascular Magnetic Resonance.

[3]  P. Matthews,et al.  UK Biobank’s cardiovascular magnetic resonance protocol , 2015, Journal of Cardiovascular Magnetic Resonance.

[4]  Vivek Muthurangu,et al.  Real‐time cardiovascular MR with spatio‐temporal artifact suppression using deep learning–proof of concept in congenital heart disease , 2018, Magnetic resonance in medicine.

[5]  Peng Liu,et al.  Wide Inference Network for Image Denoising , 2017, arXiv.org.

[6]  René M. Botnar,et al.  Cardiac MR Motion Artefact Correction from K-space Using Deep Learning-Based Reconstruction , 2018, MLMIR@MICCAI.

[7]  Xiang Li,et al.  Shortcomings of Ventricle Segmentation Using Deep Convolutional Networks , 2018, MLCN/DLF/iMIMIC@MICCAI.

[8]  Jan Kautz,et al.  Loss Functions for Image Restoration With Neural Networks , 2017, IEEE Transactions on Computational Imaging.

[9]  Farhood Saremi,et al.  Optimizing cardiac MR imaging: practical remedies for artifacts. , 2008, Radiographics : a review publication of the Radiological Society of North America, Inc.

[10]  Daniel C. Castro,et al.  Cardiac MR Segmentation from Undersampled k-space Using Deep Latent Representation Learning , 2018, MICCAI.

[11]  Jon-Fredrik Nielsen,et al.  Automatic correction of echo‐planar imaging (EPI) ghosting artifacts in real‐time interactive cardiac MRI using sensitivity encoding , 2008, Journal of magnetic resonance imaging : JMRI.

[12]  Jyrki Lötjönen,et al.  Correction of motion artifacts from cardiac cine magnetic resonance images. , 2005, Academic radiology.

[13]  Jong Chul Ye,et al.  ${k}$ -Space Deep Learning for Accelerated MRI , 2020, IEEE Transactions on Medical Imaging.

[14]  Bruce R. Rosen,et al.  Image reconstruction by domain-transform manifold learning , 2017, Nature.

[15]  Enhong Chen,et al.  Image Denoising and Inpainting with Deep Neural Networks , 2012, NIPS.

[16]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[17]  Daniel Rueckert,et al.  Deep Learning using K-space Based Data Augmentation for Automated Cardiac MR Motion Artefact Detection , 2018, MICCAI.

[18]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[19]  Pedro F Ferreira,et al.  Cardiovascular magnetic resonance artefacts , 2013, Journal of Cardiovascular Magnetic Resonance.

[20]  Daniel Rueckert,et al.  A Deep Cascade of Convolutional Neural Networks for Dynamic MR Image Reconstruction , 2017, IEEE Transactions on Medical Imaging.