Lung registration using automatically detected landmarks.

OBJECTIVES Accurate registration of lung CT images is inevitable for numerous clinical applications. Usually, nonlinear intensity-based methods are used. Their accuracy is typically evaluated using corresponding anatomical points (landmarks; e.g. bifurcations of bronchial and vessel trees) annotated by medical experts in the images to register. As image registration can be interpreted as correspondence finding problem, these corresponding landmarks can also be used in feature-based registration techniques. Recently, approaches for automated identification of such landmark correspondences in lung CT images have been presented. In this work, a novel combination of variational nonlinear intensity-based registration with an approach for automated landmark correspondence detection in lung CT pairs is presented and evaluated. METHODS The main blocks of the proposed hybrid intensity- and feature-based registration scheme are a two-step landmark correspondence detection and the so-called CoLD (Combining Landmarks and Distance Measures) framework. The landmark correspondence identification starts with feature detection in one image followed by a blockmatching-based transfer of the features to the other image. The established correspondences are used to compute a thin-plate spline (TPS) transformation. Within CoLD, the TPS transformation is improved by minimization of an objective function consisting of a Normalized Gradient Field distance measure and a curvature regularizer; the landmark correspondences are guaranteed to be preserved by optimization on the kernel of the discretized landmark constraints. RESULTS Based on ten publicly available end-inspiration/expiration CT scan pairs with anatomical landmark sets annotated by medical experts from the DIR-Lab database, it is shown that the hybrid registration approach is superior in terms of accuracy: The mean distance of expert landmarks is decreased from 8.46 mm before to 1.15 mm after registration, outperforming both the TPS transformation (1.68 mm) and a nonlinear registration without usage of automatically detected landmarks (2.44 mm). The improvement is statistically significant in eight of ten datasets in comparison to TPS and in nine of ten datasets in comparison to the intensity-based registration. Furthermore, CoLD globally estimates the breathing-induced lung volume change well and results in smooth and physiologically plausible motion fields of the lungs. CONCLUSIONS We demonstrated that our novel landmark-based registration pipeline outperforms both TPS and the underlying nonlinear intensity-based registration without landmark usage. This highlights the potential of automatic landmark correspondence detection for improvement of lung CT registration accuracy.

[1]  Brian B. Avants,et al.  Evaluation of Registration Methods on Thoracic CT: The EMPIRE10 Challenge , 2011, IEEE Transactions on Medical Imaging.

[2]  Gary E. Christensen,et al.  Consistent landmark and intensity-based image registration , 2002, IEEE Transactions on Medical Imaging.

[3]  R. Castillo,et al.  A framework for evaluation of deformable image registration spatial accuracy using large landmark point sets , 2009, Physics in medicine and biology.

[4]  Robert T. Schultz,et al.  Integrated Intensity and Point-Feature Nonrigid Registration , 2004, MICCAI.

[5]  Jan Modersitzky,et al.  FAIR - Flexible Algorithms for Image Registration , 2009, Fundamentals of algorithms.

[6]  Karl Rohr,et al.  Landmark-Based Image Analysis , 2001, Computational Imaging and Vision.

[7]  R. Castillo,et al.  Four-dimensional deformable image registration using trajectory modeling , 2010, Physics in medicine and biology.

[8]  D K Smith,et al.  Numerical Optimization , 2001, J. Oper. Res. Soc..

[9]  Ella A. Kazerooni,et al.  CT-based Biomarker Provides Unique Signature for Diagnosis of COPD Phenotypes and Disease Progression , 2012, Nature Medicine.

[10]  Heinz Handels,et al.  Assessing accuracy of non-linear registration in 4D image data using automatically detected landmark correspondences , 2013, Medical Imaging.

[11]  J. Rojo,et al.  Least median of squares filtering of locally optimal point matches for compressible flow image registration , 2012, Physics in medicine and biology.

[12]  Stefan Heldmann,et al.  A Scale-Space Approach to Landmark Constrained Image Registration , 2009, SSVM.

[13]  Max A. Viergever,et al.  Semi-automatic construction of reference standards for evaluation of image registration , 2011, Medical Image Anal..

[14]  Thomas Lange,et al.  Landmark Constrained Non-rigid Image Registration with Anisotropic Tolerances , 2009 .

[15]  Heinz Handels,et al.  Landmark-driven parameter optimization for non-linear image registration , 2011, Medical Imaging.

[16]  Jan Modersitzki,et al.  Numerical Methods for Image Registration , 2004 .

[17]  G Baroni,et al.  Regularization in deformable registration of biomedical images based on divergence and curl operators. , 2014, Methods of information in medicine.

[18]  J. Modersitzki,et al.  Combining landmark and intensity driven registrations , 2003 .

[19]  Jan Rühaak,et al.  Combining Automatic Landmark Detection and Variational Methods for Lung CT Registration , 2013 .

[20]  Jan Modersitzki,et al.  Curvature Based Image Registration , 2004, Journal of Mathematical Imaging and Vision.

[21]  Edward Ho Yu Tat World Congress of Medical Physics and Biomedical Engineering. , 2012 .

[22]  Joe Y. Chang,et al.  Validation of an accelerated ‘demons’ algorithm for deformable image registration in radiation therapy , 2005, Physics in medicine and biology.

[23]  Thomas Lange,et al.  Matching CT and ultrasound data of the liver by landmark constrained image registration , 2009, Medical Imaging.

[24]  Michael Unser,et al.  Fast parametric elastic image registration , 2003, IEEE Trans. Image Process..

[25]  Stephen J. Wright,et al.  Numerical Optimization , 2018, Fundamental Statistical Inference.

[26]  Pierre Hellier,et al.  Coupling dense and landmark-based approaches for nonrigid registration , 2003, IEEE Transactions on Medical Imaging.

[27]  Thomas Lange,et al.  Landmark Constrained Non-parametric Image Registration with Isotropic Tolerances , 2009, Bildverarbeitung für die Medizin.

[28]  B Likar,et al.  Automatic extraction of corresponding points for the registration of medical images. , 1999, Medical physics.

[29]  Jan Rühaak,et al.  Highly accurate fast lung CT registration , 2013, Medical Imaging.

[30]  E. Haber,et al.  Intensity Gradient Based Registration and Fusion of Multi-modal Images , 2007, Methods of Information in Medicine.

[31]  H. Peitgen,et al.  Lung and Lung Lobe Segmentation Methods at Fraunhofer MEVIS , 2011 .

[32]  Cristian Lorenz,et al.  Evaluation of 4D-CT Lung Registration , 2009, MICCAI.