Hybrid Multimodal Deformable Registration with a Data-Driven Deformation Prior

Deformable registration for images with different contrast-enhancement and hence different structure appearance is extremely challenging due to the ill-posed nature of the problem. Utilizing prior anatomical knowledge is thus necessary to eliminate implausible deformations. Landmark constraints and statistically constrained models have shown encouraging results. However, these methods do not utilize the segmentation information that may be readily available. In this paper, we explore the possibility of utilizing such information. We propose to generate an anatomical correlation-regularized deformation field prior by registration of point sets using mixture of Gaussians based on a thin-plate spline parametric model. The point sets are extracted from the segmented object surface and no explicit landmark matching is required. The prior is then incorporated with an intensity-based similarity measure in the deformable registration process using the variational framework. The proposed prior does not require any training data set thus excluding any inter-subject variations compared to learning-based methods. In the experiments, we show that our method increases the registration robustness and accuracy on 12 sets of TAVI patient data, 8 myocardial perfusion MRI sequences, and one simulated pre- and post- tumor resection MRI.

[1]  Michael Unser,et al.  Elastic registration of biological images using vector-spline regularization , 2005, IEEE Transactions on Biomedical Engineering.

[2]  Lawrence H. Staib,et al.  Physical model-based non-rigid registration incorporating statistical shape information , 2000, Medical Image Anal..

[3]  Olivier D. Faugeras,et al.  Variational Methods for Multimodal Image Matching , 2002, International Journal of Computer Vision.

[4]  Brian B. Avants,et al.  Evaluation of Registration Methods on Thoracic CT: The EMPIRE10 Challenge , 2011, IEEE Transactions on Medical Imaging.

[5]  Sim Heng Ong,et al.  Registration of Pre-Operative CT and Non-Contrast-Enhanced C-Arm CT: An Application to Trans-Catheter Aortic Valve Implantation (TAVI) , 2012, ACCV.

[6]  Jürgen Weese,et al.  Landmark-based elastic registration using approximating thin-plate splines , 2001, IEEE Transactions on Medical Imaging.

[7]  Dinggang Shen,et al.  Statistical representation of high-dimensional deformation fields with application to statistically constrained 3D warping , 2006, Medical Image Anal..

[8]  Vittorio Ferrari,et al.  Appearance Sharing for Collective Human Pose Estimation , 2012, ACCV.

[9]  Gabor Fichtinger,et al.  Medical Image Computing and Computer-Assisted Intervention - MICCAI 2008, 11th International Conference, New York, NY, USA, September 6-10, 2008, Proceedings, Part I , 2008, International Conference on Medical Image Computing and Computer-Assisted Intervention.

[10]  Pierre Hellier,et al.  Level Set Methods in an EM Framework for Shape Classification and Estimation , 2004, International Conference on Medical Image Computing and Computer-Assisted Intervention.

[11]  Alejandro F Frangi,et al.  Automatic construction of 3-D statistical deformation models of the brain using nonrigid registration , 2003, IEEE Transactions on Medical Imaging.

[12]  Fred L. Bookstein,et al.  Principal Warps: Thin-Plate Splines and the Decomposition of Deformations , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Chao Li,et al.  Improved semi-automated segmentation of cardiac CT and MR images , 2009, 2009 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[14]  Robert T. Schultz,et al.  Integrated Intensity and Point-Feature Nonrigid Registration. , 2001 .

[15]  Olivier D. Faugeras,et al.  Flows of diffeomorphisms for multimodal image registration , 2002, Proceedings IEEE International Symposium on Biomedical Imaging.

[16]  Baba C. Vemuri,et al.  A robust algorithm for point set registration using mixture of Gaussians , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[17]  Chao Liu,et al.  Efficient 3D Tracking for Motion Compensation in Beating Heart Surgery , 2008, MICCAI.

[18]  Qiang Li,et al.  Automated segmentation of lungs with severe interstitial lung disease in CT. , 2009, Medical physics.

[19]  Desire Sidibé,et al.  A spline-based non-linear diffeomorphism for multimodal prostate registration , 2012, Medical Image Anal..

[20]  Fabrice Mériaudeau,et al.  A Non-Linear Diffeomorphic Framework for Prostate Multimodal Registration , 2011, 2011 International Conference on Digital Image Computing: Techniques and Applications.

[21]  Rui Liao,et al.  Toward smart utilization of two X-ray images for 2-D/3-D registration applied to abdominal aortic aneurysm interventions , 2013, Comput. Electr. Eng..