Learning Deformable Registration of Medical Images with Anatomical Constraints

Deformable image registration is a fundamental problem in the field of medical image analysis. During the last years, we have witnessed the advent of deep learning-based image registration methods which achieve state-of-the-art performance, and drastically reduce the required computational time. However, little work has been done regarding how can we encourage our models to produce not only accurate, but also anatomically plausible results, which is still an open question in the field. In this work, we argue that incorporating anatomical priors in the form of global constraints into the learning process of these models, will further improve their performance and boost the realism of the warped images after registration. We learn global non-linear representations of image anatomy using segmentation masks, and employ them to constraint the registration process. The proposed AC-RegNet architecture is evaluated in the context of chest X-ray image registration using three different datasets, where the high anatomical variability makes the task extremely challenging. Our experiments show that the proposed anatomically constrained registration model produces more realistic and accurate results than state-of-the-art methods, demonstrating the potential of this approach.

[1]  Marc Niethammer,et al.  Quicksilver: Fast predictive image registration – A deep learning approach , 2017, NeuroImage.

[2]  Clement J. McDonald,et al.  Automatic Tuberculosis Screening Using Chest Radiographs , 2014, IEEE Transactions on Medical Imaging.

[3]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[4]  Nikos Paragios,et al.  Deformable Medical Image Registration: A Survey , 2013, IEEE Transactions on Medical Imaging.

[5]  Enzo Ferrante,et al.  Anatomical Priors for Image Segmentation via Post-Processing with Denoising Autoencoders , 2019, MICCAI.

[6]  Clement J. McDonald,et al.  Lung Segmentation in Chest Radiographs Using Anatomical Atlases With Nonrigid Registration , 2014, IEEE Transactions on Medical Imaging.

[7]  Ben Glocker,et al.  On the Adaptability of Unsupervised CNN-Based Deformable Image Registration to Unseen Image Domains , 2018, MLMI@MICCAI.

[8]  Konstantinos Kamnitsas,et al.  Reverse Classification Accuracy: Predicting Segmentation Performance in the Absence of Ground Truth , 2017, IEEE Transactions on Medical Imaging.

[9]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[10]  Thomas Brox,et al.  FlowNet: Learning Optical Flow with Convolutional Networks , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[11]  Yong Fan,et al.  Non-rigid image registration using self-supervised fully convolutional networks without training data , 2018, 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018).

[12]  Boudewijn P. F. Lelieveldt,et al.  Nonrigid Image Registration Using Multi-scale 3D Convolutional Neural Networks , 2017, MICCAI.

[13]  Nikos Paragios,et al.  Slice-to-volume medical image registration: a survey , 2017, Medical Image Anal..

[14]  Iasonas Kokkinos,et al.  Prior-Based Coregistration and Cosegmentation , 2016, MICCAI.

[15]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[16]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[17]  Max A. Viergever,et al.  End-to-End Unsupervised Deformable Image Registration with a Convolutional Neural Network , 2017, DLMIA/ML-CDS@MICCAI.

[18]  Paul Suetens,et al.  Non-rigid brain image registration using a statistical deformation model , 2006, SPIE Medical Imaging.

[19]  M. Doblaré,et al.  A finite element model to accurately predict real deformations of the breast. , 2008, Medical engineering & physics.

[20]  Stefan Klein,et al.  SimpleElastix: A User-Friendly, Multi-lingual Library for Medical Image Registration , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[21]  Nikos Komodakis,et al.  (Hyper)-graphical models in biomedical image analysis , 2016, Medical Image Anal..

[22]  K. Doi,et al.  Development of a digital image database for chest radiographs with and without a lung nodule: receiver operating characteristic analysis of radiologists' detection of pulmonary nodules. , 2000, AJR. American journal of roentgenology.

[23]  Siyong Kim,et al.  Deformable image registration in radiation therapy , 2017, Radiation oncology journal.

[24]  Nikos Paragios,et al.  U-ReSNet: Ultimate Coupling of Registration and Segmentation with Deep Nets , 2019, MICCAI.

[25]  Max A. Viergever,et al.  A deep learning framework for unsupervised affine and deformable image registration , 2018, Medical Image Anal..

[26]  L. R. Dice Measures of the Amount of Ecologic Association Between Species , 1945 .

[27]  Enzo Ferrante,et al.  Segmentación multi-atlas de imágenes médicas con selección de atlas inteligente y control de calidad automático , 2018 .

[28]  Maxime Sermesant,et al.  SVF-Net: Learning Deformable Image Registration Using Shape Matching , 2017, MICCAI.

[29]  Sébastien Ourselin,et al.  Weakly-supervised convolutional neural networks for multimodal image registration , 2018, Medical Image Anal..

[30]  Michael T. Mullen,et al.  Cardiothoracic ratio from postero-anterior chest radiographs: a simple, reproducible and independent marker of disease severity and outcome in adults with congenital heart disease. , 2013, International journal of cardiology.

[31]  Pascal Vincent,et al.  Stacked Denoising Autoencoders: Learning Useful Representations in a Deep Network with a Local Denoising Criterion , 2010, J. Mach. Learn. Res..

[32]  Andrew Zisserman,et al.  Spatial Transformer Networks , 2015, NIPS.

[33]  Nikos Paragios,et al.  Linear and Deformable Image Registration with 3D Convolutional Neural Networks , 2018, RAMBO+BIA+TIA@MICCAI.

[34]  Nassir Navab,et al.  Dense Registration with Deformation Priors , 2009, IPMI.

[35]  Konstantinos Kamnitsas,et al.  Anatomically Constrained Neural Networks (ACNNs): Application to Cardiac Image Enhancement and Segmentation , 2017, IEEE Transactions on Medical Imaging.

[36]  Bingbing Ni,et al.  Unsupervised Deep Learning for Optical Flow Estimation , 2017, AAAI.

[37]  Mert R. Sabuncu,et al.  Unsupervised Learning for Fast Probabilistic Diffeomorphic Registration , 2018, MICCAI.

[38]  Chen Chen,et al.  Automatic Cardiothoracic Ratio Calculation With Deep Learning , 2019, IEEE Access.

[39]  Mert R. Sabuncu,et al.  Multi-atlas segmentation of biomedical images: A survey , 2014, Medical Image Anal..

[40]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[41]  Ronald M. Summers,et al.  ChestX-ray: Hospital-Scale Chest X-ray Database and Benchmarks on Weakly Supervised Classification and Localization of Common Thorax Diseases , 2019, Deep Learning and Convolutional Neural Networks for Medical Imaging and Clinical Informatics.

[42]  Sema Candemir,et al.  A review on lung boundary detection in chest X-rays , 2019, International Journal of Computer Assisted Radiology and Surgery.

[43]  Mert R. Sabuncu,et al.  An Unsupervised Learning Model for Deformable Medical Image Registration , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[44]  Mert R. Sabuncu,et al.  VoxelMorph: A Learning Framework for Deformable Medical Image Registration , 2018, IEEE Transactions on Medical Imaging.

[45]  Nikos Paragios,et al.  Deformable Registration Through Learning of Context-Specific Metric Aggregation , 2017, MLMI@MICCAI.

[46]  Christian Gaser,et al.  Structural MRI: Morphometry , 2016 .

[47]  Max A. Viergever,et al.  A survey of medical image registration - under review , 2016, Medical Image Anal..

[48]  Nikos Paragios,et al.  Weakly Supervised Learning of Metric Aggregations for Deformable Image Registration , 2018, IEEE Journal of Biomedical and Health Informatics.