Improving Image Resolution of Whole-Heart Coronary MRA Using Convolutional Neural Network

Whole-heart coronary magnetic resonance angiography (WHCMRA) permits the noninvasive assessment of coronary artery disease without radiation exposure. However, the image resolution of WHCMRA is limited. Recently, convolutional neural networks (CNNs) have obtained increased interest as a method for improving the resolution of medical images. The purpose of this study is to improve the resolution of WHCMRA images using a CNN. Free-breathing WHCMRA images with 512 × 512 pixels (pixel size = 0.65 mm) were acquired in 80 patients with known or suspected coronary artery disease using a 1.5 T magnetic resonance (MR) system with 32 channel coils. A CNN model was optimized by evaluating CNNs with different structures. The proposed CNN model was trained based on the relationship of signal patterns between low-resolution patches (small regions) and the corresponding high-resolution patches using a training dataset collected from 40 patients. Images with 512 × 512 pixels were restored from 256 × 256 down-sampled WHCMRA images (pixel size = 1.3 mm) with three different approaches: the proposed CNN, bicubic interpolation (BCI), and the previously reported super-resolution CNN (SRCNN). High-resolution WHCMRA images obtained using the proposed CNN model were significantly better than those of BCI and SRCNN in terms of root mean squared error, peak signal to noise ratio, and structure similarity index measure with respect to the original WHCMRA images. The proposed CNN approach can provide high-resolution WHCMRA images with better accuracy than BCI and SRCNN. The high-resolution WHCMRA obtained using the proposed CNN model will be useful for identifying coronary artery disease.

[1]  Akiyoshi Hizukuri,et al.  Computer-Aided Diagnosis Scheme for Determining Histological Classification of Breast Lesions on Ultrasonographic Images Using Convolutional Neural Network , 2018, Diagnostics.

[2]  Xiaoou Tang,et al.  Image Super-Resolution Using Deep Convolutional Networks , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Kundan Kumar,et al.  Breast cancer classification of image using convolutional neural network , 2018, 2018 4th International Conference on Recent Advances in Information Technology (RAIT).

[4]  Zheng Liu,et al.  Learning-based super resolution using kernel partial least squares , 2011, Image Vis. Comput..

[5]  Chih-Yuan Yang,et al.  Fast Direct Super-Resolution by Simple Functions , 2013, 2013 IEEE International Conference on Computer Vision.

[6]  Lee Friedman,et al.  Measurement of Signal-to-Noise and Contrast-to-Noise in the fBIRN Multicenter Imaging Study , 2006, Journal of Digital Imaging.

[7]  Victor Alves,et al.  Brain Tumor Segmentation Using Convolutional Neural Networks in MRI Images , 2016, IEEE Transactions on Medical Imaging.

[8]  Xiaoou Tang,et al.  Learning a Deep Convolutional Network for Image Super-Resolution , 2014, ECCV.

[9]  Hao Chen,et al.  Automatic Detection of Cerebral Microbleeds From MR Images via 3D Convolutional Neural Networks , 2016, IEEE Transactions on Medical Imaging.

[10]  Takanori Suzuki,et al.  Super-resolution convolutional neural network for the improvement of the image quality of magnified images in chest radiographs , 2017, Medical Imaging.

[11]  Jae Sung Lee,et al.  Computed tomography super-resolution using deep convolutional neural network , 2018, Physics in medicine and biology.

[12]  Xiaodong Yang,et al.  Hybrid Example-Based Single Image Super-Resolution , 2015, ISVC.

[13]  Joel H. Saltz,et al.  Classification of Pancreatic Cysts in Computed Tomography Images Using a Random Forest and Convolutional Neural Network Ensemble , 2017, MICCAI.

[14]  Guolan Lu,et al.  Deep convolutional neural networks for classifying head and neck cancer using hyperspectral imaging , 2017, Journal of biomedical optics.

[15]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[16]  Didem Gökçay,et al.  Evaluation of MRIS of the brain with respect to SNR, CNR and GWR in young versus old subjects , 2014, 2014 22nd Signal Processing and Communications Applications Conference (SIU).