Image registration in dynamic renal MRI—current status and prospects

Magnetic resonance imaging (MRI) modalities have achieved an increasingly important role in the clinical work-up of chronic kidney diseases (CKD). This comprises among others assessment of hemodynamic parameters by arterial spin labeling (ASL) or dynamic contrast-enhanced (DCE-) MRI. Especially in the latter, images or volumes of the kidney are acquired over time for up to several minutes. Therefore, they are hampered by motion, e.g., by pulsation, peristaltic, or breathing motion. This motion can hinder subsequent image analysis to estimate hemodynamic parameters like renal blood flow or glomerular filtration rate (GFR). To overcome motion artifacts in time-resolved renal MRI, a wide range of strategies have been proposed. Renal image registration approaches could be grouped into (1) image acquisition techniques, (2) post-processing methods, or (3) a combination of image acquisition and post-processing approaches. Despite decades of progress, the translation in clinical practice is still missing. The aim of the present article is to discuss the existing literature on renal image registration techniques and show today’s limitations of the proposed techniques that hinder clinical translation. This paper includes transformation, criterion function, and search types as traditional components and emerging registration technologies based on deep learning. The current trend points towards faster registrations and more accurate results. However, a standardized evaluation of image registration in renal MRI is still missing.

[1]  Marc Kachelrieß,et al.  Deep Scatter Estimation (DSE): Accurate Real-Time Scatter Estimation for X-Ray CT Using a Deep Convolutional Neural Network , 2018, Journal of Nondestructive Evaluation.

[2]  Hyunjin Park,et al.  Prospects of deep learning for medical imaging , 2018, Precision and Future Medicine.

[3]  Mark W. Woolrich,et al.  Advances in functional and structural MR image analysis and implementation as FSL , 2004, NeuroImage.

[4]  Erlend Hodneland,et al.  Use of 3D DCE-MRI for the estimation of renal perfusion and glomerular filtration rate: an intrasubject comparison of FLASH and KWIC with a comprehensive framework for evaluation. , 2015, AJR. American journal of roentgenology.

[5]  Dinggang Shen,et al.  Deformable Image Registration Using a Cue-Aware Deep Regression Network , 2018, IEEE Transactions on Biomedical Engineering.

[6]  S. Francis,et al.  Multislice perfusion of the kidneys using parallel imaging: Image acquisition and analysis strategies , 2010, Magnetic resonance in medicine.

[7]  Computer-Assisted Intervention,et al.  Medical Image Computing and Computer-Assisted Intervention – MICCAI’99 , 1999, Lecture Notes in Computer Science.

[8]  J. Hendrikse,et al.  Enabling free‐breathing background suppressed renal pCASL using fat imaging and retrospective motion correction , 2019, Magnetic resonance in medicine.

[9]  Nicolas Grenier,et al.  Diffusion-weighted magnetic resonance imaging to assess diffuse renal pathology: a systematic review and statement paper , 2018, Nephrology, dialysis, transplantation : official publication of the European Dialysis and Transplant Association - European Renal Association.

[10]  Sheng Xu,et al.  Learning deep similarity metric for 3D MR–TRUS image registration , 2018, International Journal of Computer Assisted Radiology and Surgery.

[11]  Jay B. West,et al.  The distribution of target registration error in rigid-body point-based registration , 2001, IEEE Transactions on Medical Imaging.

[12]  A. Lundervold,et al.  Quantitative assessment of kidney function using dynamic contrast enhanced MRI - steps towards an integrated software prototype , 2009, 2009 Proceedings of 6th International Symposium on Image and Signal Processing and Analysis.

[13]  Shu Liao,et al.  Unsupervised Deep Feature Learning for Deformable Registration of MR Brain Images , 2013, MICCAI.

[14]  Max A. Viergever,et al.  A deep learning framework for unsupervised affine and deformable image registration , 2018, Medical Image Anal..

[15]  Peter Robinson,et al.  Learning an appearance-based gaze estimator from one million synthesised images , 2016, ETRA.

[16]  Society of magnetic resonance in medicine , 1990 .

[17]  Michael Elad,et al.  ESPIRiT—an eigenvalue approach to autocalibrating parallel MRI: Where SENSE meets GRAPPA , 2014, Magnetic resonance in medicine.

[18]  D. Noll,et al.  Improved sensitivity and temporal resolution in perfusion FMRI using velocity selective inversion ASL , 2018, Magnetic resonance in medicine.

[19]  Robert Grimm,et al.  “One-Stop Shop”: Free-Breathing Dynamic Contrast-Enhanced Magnetic Resonance Imaging of the Kidney Using Iterative Reconstruction and Continuous Golden-Angle Radial Sampling , 2016, Investigative radiology.

[20]  Sébastien Ourselin,et al.  Weakly-supervised convolutional neural networks for multimodal image registration , 2018, Medical Image Anal..

[21]  Erlend Hodneland,et al.  In Vivo Detection of Chronic Kidney Disease Using Tissue Deformation Fields From Dynamic MR Imaging , 2019, IEEE Transactions on Biomedical Engineering.

[22]  Jue Zhang,et al.  Quantitative assessment of acute kidney injury by noninvasive arterial spin labeling perfusion MRI: a pilot study , 2013, Science China Life Sciences.

[23]  Luigi Landini,et al.  Automatic 2D registration of renal perfusion image sequences by mutual information and adaptive prediction , 2013, Magnetic Resonance Materials in Physics, Biology and Medicine.

[24]  Geoff J M Parker,et al.  Comparison of the performance of tracer kinetic model-driven registration for dynamic contrast enhanced MRI using different models of contrast enhancement. , 2006, Academic radiology.

[25]  Eldad Haber,et al.  Intensity Gradient Based Registration and Fusion of Multi-modal Images , 2006, MICCAI.

[26]  Andrew E Arai,et al.  Fast method for correcting image misregistration due to organ motion in time‐series MRI data , 2003, Magnetic resonance in medicine.

[27]  Mert R. Sabuncu,et al.  VoxelMorph: A Learning Framework for Deformable Medical Image Registration , 2018, IEEE Transactions on Medical Imaging.

[28]  Erlend Hodneland,et al.  Normalized gradient fields for nonlinear motion correction of DCE-MRI time series , 2014, Comput. Medical Imaging Graph..

[29]  Thomas S. Huang,et al.  DeepFont: Identify Your Font from An Image , 2015, ACM Multimedia.

[30]  Arvid Lundervold,et al.  An overview of deep learning in medical imaging focusing on MRI , 2018, Zeitschrift fur medizinische Physik.

[31]  Jakob Wasza,et al.  Article in Press G Model Computerized Medical Imaging and Graphics Segmentation of Kidneys Using a New Active Shape Model Generation Technique Based on Non-rigid Image Registration , 2022 .

[32]  Xavier Golay,et al.  Magnetic resonance imaging biomarkers for chronic kidney disease: a position paper from the European Cooperation in Science and Technology Action PARENCHIMA , 2018, Nephrology, dialysis, transplantation : official publication of the European Dialysis and Transplant Association - European Renal Association.

[33]  Lipo Wang,et al.  Deep Learning Applications in Medical Image Analysis , 2018, IEEE Access.

[34]  E. Haber,et al.  Intensity Gradient Based Registration and Fusion of Multi-modal Images , 2007, Methods of Information in Medicine.

[35]  T. Kron,et al.  An analysis of respiratory induced kidney motion on four-dimensional computed tomography and its implications for stereotactic kidney radiotherapy , 2013, Radiation oncology.

[36]  Marc Niethammer,et al.  Quicksilver: Fast predictive image registration – A deep learning approach , 2017, NeuroImage.

[37]  G. Zaharchuk,et al.  Recommended implementation of arterial spin-labeled perfusion MRI for clinical applications: A consensus of the ISMRM perfusion study group and the European consortium for ASL in dementia. , 2015, Magnetic resonance in medicine.

[38]  Dinggang Shen,et al.  BIRNet: Brain image registration using dual‐supervised fully convolutional networks , 2018, Medical Image Anal..

[39]  Peter L. Choyke,et al.  Registration of time-series contrast enhanced magnetic resonance images for renography , 2001, Proceedings 14th IEEE Symposium on Computer-Based Medical Systems. CBMS 2001.

[40]  Erlend Hodneland,et al.  Registration of Dynamic Contrast Enhanced MRI with Local Rigidity Constraint , 2012, WBIR.

[41]  Z. Jane Wang,et al.  A CNN Regression Approach for Real-Time 2D/3D Registration , 2016, IEEE Transactions on Medical Imaging.

[42]  Max A. Viergever,et al.  elastix: A Toolbox for Intensity-Based Medical Image Registration , 2010, IEEE Transactions on Medical Imaging.

[43]  J. M. Mora-Gutiérrez,et al.  Arterial spin labeling MRI is able to detect early hemodynamic changes in diabetic nephropathy , 2017, Journal of magnetic resonance imaging : JMRI.

[44]  David L. Thomas,et al.  Comparison of ASL and DCE MRI for the non-invasive measurement of renal blood flow: quantification and reproducibility , 2014, European Radiology.

[45]  Brian B. Avants,et al.  Symmetric diffeomorphic image registration with cross-correlation: Evaluating automated labeling of elderly and neurodegenerative brain , 2008, Medical Image Anal..

[46]  N. Rofsky,et al.  Volumetric Arterial Spin-labeled Perfusion Imaging of the Kidneys with a Three-dimensional Fast Spin Echo Acquisition. , 2016, Academic radiology.

[47]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[48]  Anthony Lausch,et al.  Nonrigid Registration of Dynamic Contrast-enhanced MRI Data using Motion Informed Intensity Corrections , 2011 .

[49]  X. Golay,et al.  Perfusion Imaging Using Arterial Spin Labeling , 2004, Topics in magnetic resonance imaging : TMRI.

[50]  L. Schad,et al.  Quantitative Renal Perfusion Measurements in a Rat Model of Acute Kidney Injury at 3T: Testing Inter- and Intramethodical Significance of ASL and DCE-MRI , 2013, PloS one.

[51]  Mateusz Buda,et al.  Deep learning in radiology: An overview of the concepts and a survey of the state of the art with focus on MRI , 2018, Journal of magnetic resonance imaging : JMRI.

[52]  Michael Brady,et al.  MIND: Modality independent neighbourhood descriptor for multi-modal deformable registration , 2012, Medical Image Anal..

[53]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[54]  D. O’Regan,et al.  Motion-corrected multiparametric renal arterial spin labelling at 3 T: reproducibility and effect of vasodilator challenge , 2018, European Radiology.

[55]  Erlend Hodneland,et al.  Workflow sensitivity of post-processing methods in renal DCE-MRI. , 2017, Magnetic resonance imaging.

[56]  Erlend Hodneland,et al.  Segmentation-Driven Image Registration-Application to 4D DCE-MRI Recordings of the Moving Kidneys , 2014, IEEE Transactions on Image Processing.

[57]  Ting Song,et al.  Registration and Segmentation of Dynamic Three-dimensional MR Renography Based on Fourier Representations and K- Means Clustering , 2005 .

[58]  Arvid Lundervold,et al.  A variational approach to image registration in dynamic contrast-enhanced MRI of the human kidney. , 2013, Magnetic resonance imaging.

[59]  J. Votaw,et al.  Magnetic resonance imaging evaluation of renal structure and function related to disease: Technical review of image acquisition, postprocessing, and mathematical modeling steps , 2011, Journal of magnetic resonance imaging : JMRI.

[60]  Nima Tajbakhsh,et al.  Convolutional Neural Networks for Medical Image Analysis: Full Training or Fine Tuning? , 2016, IEEE Transactions on Medical Imaging.

[61]  Ulrike I Attenberger,et al.  DCE‐MRI of the human kidney using BLADE: A feasibility study in healthy volunteers , 2012, Journal of magnetic resonance imaging : JMRI.

[62]  Yuan Yu,et al.  TensorFlow: A system for large-scale machine learning , 2016, OSDI.

[63]  Anita Banerji,et al.  Analytical validation of single-kidney glomerular filtration rate and split renal function as measured with magnetic resonance renography. , 2019, Magnetic resonance imaging.

[64]  J. Duerk,et al.  Image Segmentation, Registration and Visualization of Serial MR Images for Therapeutic Assessment of Polycystic Kidney Disease in Transgenic Mice , 2005, 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference.

[65]  L. Schad,et al.  Assessment of kidney volumes from MRI: acquisition and segmentation techniques. , 2012, AJR. American journal of roentgenology.

[66]  Angela Caunce,et al.  Tracer kinetic model–driven registration for dynamic contrast‐enhanced MRI time‐series data , 2007, Magnetic resonance in medicine.

[67]  H. Michaely,et al.  Untersuchung von selbstnavigierenden MR-Sequenzen für die Perfusionsbildgebung der Nieren , 2010 .

[68]  Fei Yang,et al.  Automatic Renal Cortex Segmentation Using Implicit Shape Registration and Novel Multiple Surfaces Graph Search , 2012, IEEE Transactions on Medical Imaging.

[69]  Alexei A. Efros,et al.  Unpaired Image-to-Image Translation Using Cycle-Consistent Adversarial Networks , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[70]  Karen Davies,et al.  Tracer Kinetic Model-Driven Registration for Dynamic Contrast Enhanced MRI Time Series , 2005, MICCAI.

[71]  José M. F. Moura,et al.  Integrated registration of dynamic renal perfusion MR images , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[72]  Allan Hanbury,et al.  Metrics for evaluating 3D medical image segmentation: analysis, selection, and tool , 2015, BMC Medical Imaging.

[73]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[74]  Alena-Kathrin Schnurr,et al.  Synthesis of CT images from digital body phantoms using CycleGAN , 2019, International Journal of Computer Assisted Radiology and Surgery.

[75]  Li Zhang,et al.  Deep similarity learning for multimodal medical images , 2018, Comput. methods Biomech. Biomed. Eng. Imaging Vis..

[76]  Nicholas Ayache,et al.  The Correlation Ratio as a New Similarity Measure for Multimodal Image Registration , 1998, MICCAI.

[77]  J. Pipe Motion correction with PROPELLER MRI: Application to head motion and free‐breathing cardiac imaging , 1999, Magnetic resonance in medicine.

[78]  Ulrike I Attenberger,et al.  Retrospective respiratory triggering renal perfusion MRI , 2010, Acta radiologica.

[79]  Mark W. Woolrich,et al.  FSL , 2012, NeuroImage.

[80]  Ninon Burgos,et al.  New advances in the Clinica software platform for clinical neuroimaging studies , 2019 .

[81]  Tobias Schaeffter,et al.  Nonrigid Motion Modeling of the Liver From 3-D Undersampled Self-Gated Golden-Radial Phase Encoded MRI , 2012, IEEE Transactions on Medical Imaging.

[82]  Xiaoying Wang,et al.  Respiratory motion correction for free-breathing 3D abdominal MRI using CNN-based image registration: a feasibility study. , 2018, The British journal of radiology.

[83]  David L. Thomas,et al.  Repeatability of renal arterial spin labelling MRI in healthy subjects , 2012, Magnetic Resonance Materials in Physics, Biology and Medicine.

[84]  A. Lundervold,et al.  Motion correction of contrast-enhanced MRI time series of kidney , 2007 .

[85]  S Ourselin,et al.  The effect of motion correction on pharmacokinetic parameter estimation in dynamic-contrast-enhanced MRI. , 2011, Physics in medicine and biology.

[86]  Nikos Komodakis,et al.  A Deep Metric for Multimodal Registration , 2016, MICCAI.

[87]  Max A. Viergever,et al.  A survey of medical image registration - under review , 2016, Medical Image Anal..

[88]  David L. Thomas,et al.  Non-Invasive Renal Perfusion Imaging Using Arterial Spin Labeling MRI: Challenges and Opportunities , 2018, Diagnostics.

[89]  Vikas Gulani,et al.  Quantitative High-Resolution Renal Perfusion Imaging Using 3-Dimensional Through-Time Radial Generalized Autocalibrating Partially Parallel Acquisition , 2014, Investigative radiology.

[90]  Jue Zhang,et al.  Hemodynamic effects of furosemide on renal perfusion as evaluated by ASL-MRI. , 2012, Academic radiology.

[91]  Arvid Lundervold,et al.  ssessment of 3 D DCE-MRI of the kidneys using non-rigid image registration nd segmentation of voxel time courses rank , 2009 .

[92]  E. Vink,et al.  Modified dixon‐based renal dynamic contrast‐enhanced MRI facilitates automated registration and perfusion analysis , 2017, Magnetic resonance in medicine.

[93]  A Hasman,et al.  Movement correction of the kidney in dynamic MRI scans using FFT phase difference movement detection , 2001, Journal of magnetic resonance imaging : JMRI.

[94]  Sébastien Roujol,et al.  Improvement of MRI‐functional measurement with automatic movement correction in native and transplanted kidneys , 2008, Journal of magnetic resonance imaging : JMRI.

[95]  Ender Konukoglu,et al.  Generative Adversarial Networks for MR-CT Deformable Image Registration , 2018, ArXiv.

[96]  Guido Gerig,et al.  Performance of an efficient image‐registration algorithm in processing MR renography data , 2016, Journal of magnetic resonance imaging : JMRI.

[97]  拓海 杉山,et al.  “Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks”の学習報告 , 2017 .

[98]  Steven Sourbron,et al.  The Akaike information criterion in DCE-MRI: Does it improve the haemodynamic parameter estimates? , 2012, Physics in medicine and biology.

[99]  Nobuhiko Hata,et al.  Impact of nonrigid motion correction technique on pixel‐wise pharmacokinetic analysis of free‐breathing pulmonary dynamic contrast‐enhanced MR imaging , 2011, Journal of magnetic resonance imaging : JMRI.

[100]  M. Su,et al.  Renal perfusion 3-T MR imaging: a comparative study of arterial spin labeling and dynamic contrast-enhanced techniques. , 2011, Radiology.

[101]  M. Uder,et al.  Reproducibility of Kidney Perfusion Measurements With Arterial Spin Labeling at 1.5 Tesla MRI Combined With Semiautomatic Segmentation for Differential Cortical and Medullary Assessment , 2016, Medicine.

[102]  Fabio Nery,et al.  Arterial spin labelling MRI to measure renal perfusion: a systematic review and statement paper , 2018, Nephrology, dialysis, transplantation : official publication of the European Dialysis and Transplant Association - European Renal Association.

[103]  T. Grist,et al.  Reproducibility of renal perfusion MR imaging in native and transplanted kidneys using non‐contrast arterial spin labeling , 2011, Journal of magnetic resonance imaging : JMRI.

[104]  Nassir Navab,et al.  Automatic alignment of renal DCE-MRI image series for improvement of quantitative tracer kinetic studies , 2008, SPIE Medical Imaging.

[105]  A. Santos,et al.  Alignment of 3D DCE-MRI Abdominal Series for Optimal Quantification of Kidney Function , 2007, 2007 5th International Symposium on Image and Signal Processing and Analysis.

[106]  John T. Guibas,et al.  Synthetic Medical Images from Dual Generative Adversarial Networks , 2017, ArXiv.