3D nonrigid registration via optimal mass transport on the GPU

In this paper, we present a new computationally efficient numerical scheme for the minimizing flow approach for optimal mass transport (OMT) with applications to non-rigid 3D image registration. The approach utilizes all of the gray-scale data in both images, and the optimal mapping from image A to image B is the inverse of the optimal mapping from B to A. Further, no landmarks need to be specified, and the minimizer of the distance functional involved is unique. Our implementation also employs multigrid, and parallel methodologies on a consumer graphics processing unit (GPU) for fast computation. Although computing the optimal map has been shown to be computationally expensive in the past, we show that our approach is orders of magnitude faster then previous work and is capable of finding transport maps with optimality measures (mean curl) previously unattainable by other works (which directly influences the accuracy of registration). We give results where the algorithm was used to compute non-rigid registrations of 3D synthetic data as well as intra-patient pre-operative and post-operative 3D brain MRI datasets.

[1]  Allen R. Tannenbaum,et al.  Multigrid optimal mass transport for image registration and morphing , 2007, Electronic Imaging.

[2]  J. Moser On the volume elements on a manifold , 1965 .

[3]  Lei Zhu,et al.  Optimal Mass Transport for Registration and Warping , 2004, International Journal of Computer Vision.

[4]  Stephen J. Wright,et al.  Numerical Optimization , 2018, Fundamental Statistical Inference.

[5]  D. Hill,et al.  Non-rigid image registration: theory and practice. , 2004, The British journal of radiology.

[6]  Terry S. Yoo,et al.  Insight into Images: Principles and Practice for Segmentation, Registration, and Image Analysis , 2004 .

[7]  Yann Brenier,et al.  A computational fluid mechanics solution to the Monge-Kantorovich mass transfer problem , 2000, Numerische Mathematik.

[8]  W. Gangbo,et al.  The geometry of optimal transportation , 1996 .

[9]  Max A. Viergever,et al.  A survey of medical image registration , 1998, Medical Image Anal..

[10]  A. Ardeshir Goshtasby,et al.  2-D and 3-D Image Registration: for Medical, Remote Sensing, and Industrial Applications , 2005 .

[11]  Steven Haker,et al.  Minimizing Flows for the Monge-Kantorovich Problem , 2003, SIAM J. Math. Anal..

[12]  William L. Briggs,et al.  A multigrid tutorial , 1987 .

[13]  L. Ambrosio Lecture Notes on Optimal Transport Problems , 2003 .

[14]  Lisa M. Brown,et al.  A survey of image registration techniques , 1992, CSUR.

[15]  Y. Brenier Polar Factorization and Monotone Rearrangement of Vector-Valued Functions , 1991 .

[16]  Eitan Grinspun,et al.  Sparse matrix solvers on the GPU: conjugate gradients and multigrid , 2003, SIGGRAPH Courses.

[17]  Ron Kikinis,et al.  Mass Preserving Mappings and Image Registration , 2001, MICCAI.

[18]  Greg Humphreys,et al.  A multigrid solver for boundary value problems using programmable graphics hardware , 2003, HWWS '03.

[19]  Murli M. Gupta,et al.  High accuracy multigrid solution of the 3D convection-diffusion equation , 2000, Appl. Math. Comput..

[20]  L. Kantorovich On a Problem of Monge , 2006 .

[21]  D. Hill,et al.  Medical image registration , 2001, Physics in medicine and biology.