Physics-based network fine-tuning for robust quantitative susceptibility mapping from high-pass filtered phase

Purpose: To improve the generalization ability of convolutional neural network (CNN) based prediction of quantitative susceptibility mapping (QSM) from high-pass filtered phase (HPFP) image. Methods: The proposed network addresses two common generalization issues that arise when using a pre-trained network to predict QSM from HPFP: a) data with unseen voxel sizes, and b) data with unknown high-pass filter parameters. A network fine-tuning step based on a high-pass filtering dipole convolution forward model is proposed to reduce the generalization error of the pre-trained network. A progressive Unet architecture is proposed to improve prediction accuracy without increasing fine-tuning computational cost. Results: In retrospective studies using RMSE, PSNR, SSIM and HFEN as quality metrics, the performance of both Unet and progressive Unet was improved after physics-based fine-tuning at all voxel sizes and most high-pass filtering cutoff frequencies tested in the experiment. Progressive Unet slightly outperformed Unet both before and after fine-tuning. In a prospective study, image sharpness was improved after physics-based fine-tuning for both Unet and progressive Unet. Compared to Unet, progressive Unet had better agreement of regional susceptibility values with reference QSM. Conclusion: The proposed method shows improved robustness compared to the pre-trained network without fine-tuning when the test dataset deviates from training. Our code is available at https://github.com/Jinwei1209/SWI_to_QSM/

[1]  Yi Wang,et al.  LARO: Learned acquisition and reconstruction optimization to accelerate quantitative susceptibility mapping , 2022, NeuroImage.

[2]  C. Birkl,et al.  HFP‐QSMGAN: QSM from homodyne‐filtered phase images , 2022, Magnetic resonance in medicine.

[3]  Hongjian He,et al.  S2Q-Net: Mining the High-Pass Filtered Phase Data in Susceptibility Weighted Imaging for Quantitative Susceptibility Mapping , 2022, IEEE Journal of Biomedical and Health Informatics.

[4]  C. Birkl,et al.  Recovering SWI‐filtered phase data using deep learning , 2021, Magnetic resonance in medicine.

[5]  Stuart Crozier,et al.  Accelerating quantitative susceptibility and R2* mapping using incoherent undersampling and deep neural network reconstruction , 2021, NeuroImage.

[6]  M. Sabuncu,et al.  Temporal Feature Fusion with Sampling Pattern Optimization for Multi-echo Gradient Echo Acquisition and Image Reconstruction , 2021, MICCAI.

[7]  Hongjiang Wei,et al.  MoDL-QSM: Model-based deep learning for quantitative susceptibility mapping , 2021, NeuroImage.

[8]  Yi Wang,et al.  Efficient Folded Attention for 3D Medical Image Reconstruction and Segmentation , 2020, AAAI.

[9]  M. Sabuncu,et al.  Probabilistic dipole inversion for adaptive quantitative susceptibility mapping , 2020, Machine Learning for Biomedical Imaging.

[10]  Xu Li,et al.  Learned Proximal Networks for Quantitative Susceptibility Mapping , 2020, MICCAI.

[11]  Y. Wang,et al.  Deep neural network for water/fat separation: Supervised training, unsupervised training, and no training , 2020, Magnetic resonance in medicine.

[12]  Kawin Setsompop,et al.  Nonlinear dipole inversion (NDI) enables robust quantitative susceptibility mapping (QSM) , 2020, NMR in biomedicine.

[13]  Yi Wang,et al.  Bayesian Learning of Probabilistic Dipole Inversion for Quantitative Susceptibility Mapping , 2020, MIDL.

[14]  Yonina C. Eldar,et al.  Algorithm Unrolling: Interpretable, Efficient Deep Learning for Signal and Image Processing , 2019, IEEE Signal Processing Magazine.

[15]  Christian Langkammer,et al.  DeepQSM - using deep learning to solve the dipole inversion for quantitative susceptibility mapping , 2019, NeuroImage.

[16]  Shun Zhang,et al.  Fidelity imposed network edit (FINE) for solving ill-posed image reconstruction , 2019, NeuroImage.

[17]  Qinghua Hu,et al.  Progressive Image Deraining Networks: A Better and Simpler Baseline , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Kawin Setsompop,et al.  Quantitative susceptibility mapping using deep neural network: QSMnet , 2018, NeuroImage.

[19]  Lijun Bao,et al.  Background field removal using a region adaptive kernel for quantitative susceptibility mapping of human brain. , 2017, Journal of magnetic resonance.

[20]  Li Guo,et al.  Quantitative susceptibility mapping: Report from the 2016 reconstruction challenge , 2017, Magnetic resonance in medicine.

[21]  Thomas Brox,et al.  3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation , 2016, MICCAI.

[22]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[23]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[24]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[25]  A. Wilman,et al.  Background field removal using spherical mean value filtering and Tikhonov regularization , 2014, Magnetic resonance in medicine.

[26]  Pascal Spincemaille,et al.  Nonlinear formulation of the magnetic field to source relationship for robust quantitative susceptibility mapping , 2013, Magnetic resonance in medicine.

[27]  Yi Wang,et al.  A novel background field removal method for MRI using projection onto dipole fields (PDF) , 2011, NMR in biomedicine.

[28]  Yi Wang,et al.  Morphology enabled dipole inversion (MEDI) from a single‐angle acquisition: Comparison with COSMOS in human brain imaging , 2011, Magnetic resonance in medicine.

[29]  Ferdinand Schweser,et al.  Quantitative imaging of intrinsic magnetic tissue properties using MRI signal phase: An approach to in vivo brain iron metabolism? , 2011, NeuroImage.

[30]  Richard Bowtell,et al.  Whole-brain susceptibility mapping at high field: A comparison of multiple- and single-orientation methods , 2010, NeuroImage.

[31]  R. Bowtell,et al.  Susceptibility mapping in the human brain using threshold‐based k‐space division , 2010, Magnetic resonance in medicine.

[32]  Pascal Spincemaille,et al.  Nonlinear Regularization for Per Voxel Estimation of Magnetic Susceptibility Distributions From MRI Field Maps , 2010, IEEE Transactions on Medical Imaging.

[33]  Yi Wang,et al.  Quantitative susceptibility map reconstruction from MR phase data using bayesian regularization: Validation and application to brain imaging , 2010, Magnetic resonance in medicine.

[34]  J. Duyn,et al.  Magnetic susceptibility mapping of brain tissue in vivo using MRI phase data , 2009, Magnetic resonance in medicine.

[35]  E. Haacke,et al.  Susceptibility-Weighted Imaging: Technical Aspects and Clinical Applications, Part 1 , 2008, American Journal of Neuroradiology.

[36]  Z. Wu,et al.  Susceptibility-Weighted Imaging: Technical Aspects and Clinical Applications, Part 2 , 2008, American Journal of Neuroradiology.

[37]  Yu-Chung N. Cheng,et al.  Susceptibility weighted imaging (SWI) , 2004, Zeitschrift fur medizinische Physik.

[38]  Yi Wang,et al.  Hybrid optimization between iterative and network fine-tuning reconstructions for fast quantitative susceptibility mapping , 2021, MIDL.