Medical Image Computing and Computer Assisted Intervention – MICCAI 2019: 22nd International Conference, Shenzhen, China, October 13–17, 2019, Proceedings, Part III

In this work, we proposed a novel image-based MRI superresolution reconstruction (SRR) approach based on anisotropic acquisition schemes. We achieved superior reconstruction to state-of-the-art work by introducing a new multi-scale gradient field prior that guides the reconstruction of the high-resolution (HR) image. The prior improves both spatial smoothness and edge preservation. The inverse of the forward model of image formation is used to propagate the gradient guidance from the low-resolution (LR) images to the HR image space. The gradient fields over multiple scales were exploited for more accurate edge localization in the reconstruction. The proposed SRR allows inter-volume motion during the MRI scans and can incorporate with the LR images with arbitrary orientations and displacements in the frequency space, such as orthogonal and origin-shifted scans. The proposed approach was evaluated on the synthetic data as well as the data acquired on a Siemens 3T MRI scanner containing 45 MRI scans from 14 subjects. The evaluation results demonstrate that our proposed prior leads to improved SRR as compared to state-of-the-art priors, and that the proposed SRR obtains better results at lower or the same cost in scan time than direct HR acquisition. In particular, the anatomical structures of hippocampus can be clearly shown in our reconstructed images. This is a significant improvement for the in vivo studies of the hippocampus.

[1]  Ronald M. Summers,et al.  A New 2.5D Representation for Lymph Node Detection Using Random Sets of Deep Convolutional Neural Network Observations , 2014, MICCAI.

[2]  Sim Heng Ong,et al.  Regional Interactive Image Segmentation Networks , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[3]  Klaus H. Maier-Hein,et al.  Brain Tumor Segmentation and Radiomics Survival Prediction: Contribution to the BRATS 2017 Challenge , 2017, BrainLes@MICCAI.

[4]  Sébastien Ourselin,et al.  DeepIGeoS: A Deep Interactive Geodesic Framework for Medical Image Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Ning Xu,et al.  Deep Interactive Object Selection , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Dinesh Manocha,et al.  TrafficPredict: Trajectory Prediction for Heterogeneous Traffic-Agents , 2018, AAAI.

[7]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[8]  Thomas Brox,et al.  3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation , 2016, MICCAI.

[9]  Li Chen,et al.  JF-Cut: A Parallel Graph Cut Approach for Large-Scale Image and Video , 2015, IEEE Transactions on Image Processing.

[10]  Konstantinos Kamnitsas,et al.  Efficient multi‐scale 3D CNN with fully connected CRF for accurate brain lesion segmentation , 2016, Medical Image Anal..

[11]  Brian B. Avants,et al.  N4ITK: Improved N3 Bias Correction , 2010, IEEE Transactions on Medical Imaging.

[12]  W. Eric L. Grimson,et al.  Adaptive Segmentation of MRI Data , 1995, CVRMed.

[13]  Ross B. Girshick,et al.  Focal Loss for Dense Object Detection , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Nikos Paragios,et al.  Deformable Medical Image Registration: A Survey , 2013, IEEE Transactions on Medical Imaging.

[15]  Simon K. Warfield,et al.  Asymmetric Loss Functions and Deep Densely-Connected Networks for Highly-Imbalanced Medical Image Segmentation: Application to Multiple Sclerosis Lesion Detection , 2018, IEEE Access.

[16]  Koenraad Van Leemput,et al.  Automated model-based tissue classification of MR images of the brain , 1999, IEEE Transactions on Medical Imaging.

[17]  Craig H. Meyer,et al.  A Self-Adaptive Network For Multiple Sclerosis Lesion Segmentation From Multi-Contrast MRI With Various Imaging Protocols , 2018 .

[18]  Alan Connelly,et al.  MRtrix: Diffusion tractography in crossing fiber regions , 2012, Int. J. Imaging Syst. Technol..

[19]  Peter A. Calabresi,et al.  Multiple Sclerosis Lesion Segmentation from Brain MRI via Fully Convolutional Neural Networks , 2018, ArXiv.

[20]  Maria Assunta Rocca,et al.  Multi-branch convolutional neural network for multiple sclerosis lesion segmentation , 2018, NeuroImage.

[21]  Sébastien Ourselin,et al.  Interactive Medical Image Segmentation Using Deep Learning With Image-Specific Fine Tuning , 2017, IEEE Transactions on Medical Imaging.

[22]  Brian B. Avants,et al.  The Multimodal Brain Tumor Image Segmentation Benchmark (BRATS) , 2015, IEEE Transactions on Medical Imaging.

[23]  Marie-Pierre Jolly,et al.  Interactive graph cuts for optimal boundary & region segmentation of objects in N-D images , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[24]  Koenraad Van Leemput,et al.  Fast and sequence-adaptive whole-brain segmentation using parametric Bayesian modeling , 2016, NeuroImage.

[25]  Arno Klein,et al.  A reproducible evaluation of ANTs similarity metric performance in brain image registration , 2011, NeuroImage.

[26]  Max A. Viergever,et al.  A deep learning framework for unsupervised affine and deformable image registration , 2018, Medical Image Anal..

[27]  Rohit Bakshi,et al.  Dual‐Sensitivity Multiple Sclerosis Lesion and CSF Segmentation for Multichannel 3T Brain MRI , 2017, Journal of neuroimaging : official journal of the American Society of Neuroimaging.

[28]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[29]  Yoshua Bengio,et al.  The One Hundred Layers Tiramisu: Fully Convolutional DenseNets for Semantic Segmentation , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[30]  Snehashis Roy,et al.  Longitudinal multiple sclerosis lesion segmentation: Resource and challenge , 2017, NeuroImage.

[31]  Stephen M Smith,et al.  Fast robust automated brain extraction , 2002, Human brain mapping.