Invnet: A Deep Learning Approach To Invert Complex Deformation Fields

Inverting a deformation field is a crucial part for numerous image registration methods and has an important impact on the final registration results. There are methods that work well for small and relatively simple deformations. However, a problem arises when the deformation field consists of complex and large deformations, potentially including folding. For such cases, the state-of-the-art methods fail and the inversion results are unpredictable. In this article, we propose a deep network using the encoder-decoder architecture to improve the inverse calculation. The network is trained using deformations randomly generated using various transformation models and their compositions, with a symmetric inverse consistency error as the cost function. The results are validated using synthetic deformations resembling real ones, as well as deformation fields calculated during registration of real histology data. We show that the proposed method provides an approximate inverse with a lower error than the current state-of-the-art methods.

[1]  Ullrich Köthe,et al.  Analyzing Inverse Problems with Invertible Neural Networks , 2018, ICLR.

[2]  Spyridon Bakas,et al.  ANHIR: Automatic Non-Rigid Histological Image Registration Challenge , 2020, IEEE Transactions on Medical Imaging.

[3]  Stephan Antholzer,et al.  NETT: solving inverse problems with deep neural networks , 2018, Inverse Problems.

[4]  Michael Unser,et al.  Deep Convolutional Neural Network for Inverse Problems in Imaging , 2016, IEEE Transactions on Image Processing.

[5]  Gary E. Christensen,et al.  Consistent image registration , 2001, IEEE Transactions on Medical Imaging.

[6]  Jan Kybic,et al.  Benchmarking of Image Registration Methods for Differently Stained Histological Slides , 2018, 2018 25th IEEE International Conference on Image Processing (ICIP).

[7]  Weiguo Lu,et al.  A simple fixed-point approach to invert a deformation field. , 2007, Medical physics.

[8]  Jerry L. Prince,et al.  MIND Demons: Symmetric Diffeomorphic Deformable Registration of MR and CT for Image-Guided Spine Surgery , 2016, IEEE Transactions on Medical Imaging.

[9]  Xu Han,et al.  Networks for Joint Affine and Non-Parametric Image Registration , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Albert C. S. Chung,et al.  Fast Symmetric Diffeomorphic Image Registration with Convolutional Neural Networks , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Jian Sun,et al.  Identity Mappings in Deep Residual Networks , 2016, ECCV.

[12]  Jun Zhang,et al.  Inverse-Consistent Deep Networks for Unsupervised Deformable Image Registration , 2018, ArXiv.

[13]  Terry M Peters,et al.  Generalized 3D nonlinear transformations for medical imaging: an object-oriented implementation in VTK. , 2003, Computerized medical imaging and graphics : the official journal of the Computerized Medical Imaging Society.

[14]  Sebastian Schafer,et al.  Extra-dimensional Demons: a method for incorporating missing tissue in deformable image registration. , 2012, Medical physics.