Quantification of organ motion based on an adaptive image-based scale invariant feature method.

PURPOSE The availability of corresponding landmarks in IGRT image series allows quantifying the inter and intrafractional motion of internal organs. In this study, an approach for the automatic localization of anatomical landmarks is presented, with the aim of describing the nonrigid motion of anatomo-pathological structures in radiotherapy treatments according to local image contrast. METHODS An adaptive scale invariant feature transform (SIFT) was developed from the integration of a standard 3D SIFT approach with a local image-based contrast definition. The robustness and invariance of the proposed method to shape-preserving and deformable transforms were analyzed in a CT phantom study. The application of contrast transforms to the phantom images was also tested, in order to verify the variation of the local adaptive measure in relation to the modification of image contrast. The method was also applied to a lung 4D CT dataset, relying on manual feature identification by an expert user as ground truth. The 3D residual distance between matches obtained in adaptive-SIFT was then computed to verify the internal motion quantification with respect to the expert user. Extracted corresponding features in the lungs were used as regularization landmarks in a multistage deformable image registration (DIR) mapping the inhale vs exhale phase. The residual distances between the warped manual landmarks and their reference position in the inhale phase were evaluated, in order to provide a quantitative indication of the registration performed with the three different point sets. RESULTS The phantom study confirmed the method invariance and robustness properties to shape-preserving and deformable transforms, showing residual matching errors below the voxel dimension. The adapted SIFT algorithm on the 4D CT dataset provided automated and accurate motion detection of peak to peak breathing motion. The proposed method resulted in reduced residual errors with respect to standard SIFT, providing a motion description comparable to expert manual identification, as confirmed by DIR. CONCLUSIONS The application of the method to a 4D lung CT patient dataset demonstrated adaptive-SIFT potential as an automatic tool to detect landmarks for DIR regularization and internal motion quantification. Future works should include the optimization of the computational cost and the application of the method to other anatomical sites and image modalities.

[1]  A. J. Ahumada,et al.  43.1: A Simple Vision Model for Inhomogeneous Image-Quality Assessment , 1998 .

[2]  Patrick Clarysse,et al.  A Comparison Framework for Breathing Motion Estimation Methods From 4-D Imaging , 2007, IEEE Transactions on Medical Imaging.

[3]  Andrew P. Witkin,et al.  Scale-Space Filtering , 1983, IJCAI.

[4]  F. Wilcoxon Individual Comparisons by Ranking Methods , 1945 .

[5]  Max A. Viergever,et al.  Comparison of Feature-Based Matching of CT and MR Brain Images , 1995, CVRMed.

[6]  Marco Riboldi,et al.  Scale Invariant Feature Transform as feature tracking method in 4D imaging: A feasibility study , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[7]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[8]  William M. Wells,et al.  Efficient and robust model-to-image alignment using 3D scale-invariant features , 2013, Medical Image Anal..

[9]  Marco Riboldi,et al.  Real-time tumour tracking in particle therapy: technological developments and future perspectives. , 2012, The Lancet. Oncology.

[10]  D. Hill,et al.  Registration of MR and CT images for skull base surgery using point-like anatomical features. , 1991, The British journal of radiology.

[11]  Jon Y. Hardeberg,et al.  Measuring perceptual contrast in digital images , 2012, J. Vis. Commun. Image Represent..

[12]  T. Lindeberg Scale-Space Theory : A Basic Tool for Analysing Structures at Different Scales , 1994 .

[13]  Charles A. Poynton,et al.  Gamma and Its Disguises : The Nonlinear Mappings of Intensity in Perception, CRTs, Film, and Video , 1993 .

[14]  Stanley J. Rosenthal,et al.  Moving targets: detection and tracking of internal organ motion for treatment planning and patient set-up. , 2004, Radiotherapy and oncology : journal of the European Society for Therapeutic Radiology and Oncology.

[15]  Vladimir Pekar,et al.  Full orientation invariance and improved feature selectivity of 3D SIFT with application to medical image analysis , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[16]  Terry Caelli,et al.  Encoding Visual Information Using Anisotropic Transformations , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Yaoqin Xie,et al.  Deformable image registration of liver with consideration of lung sliding motion. , 2011, Medical physics.

[18]  M van Herk,et al.  Quantification of organ motion during conformal radiotherapy of the prostate by three dimensional image registration. , 1995, International journal of radiation oncology, biology, physics.

[19]  D. Jaffray Image-guided radiotherapy: from current concept to future perspectives , 2012, Nature Reviews Clinical Oncology.

[20]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[21]  H. B. Mann,et al.  On a Test of Whether one of Two Random Variables is Stochastically Larger than the Other , 1947 .

[22]  Christian Barillot,et al.  Using local extremum curvatures to extract anatomical markers from medical images , 1993 .

[23]  Michael B Sharpe,et al.  Image-guided radiotherapy: rationale, benefits, and limitations. , 2006, The Lancet. Oncology.

[24]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[25]  Andrew P. Witkin,et al.  Uniqueness of the Gaussian Kernel for Scale-Space Filtering , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  D. Tolhurst,et al.  Calculating the contrasts that retinal ganglion cells and LGN neurones encounter in natural scenes , 2000, Vision Research.

[27]  Alessandro Rizzi,et al.  A proposal for Contrast Measure in Digital Images , 2004, CGIV.

[28]  Rachid Deriche,et al.  A Robust Technique for Matching two Uncalibrated Images Through the Recovery of the Unknown Epipolar Geometry , 1995, Artif. Intell..

[29]  David Sarrut,et al.  Deformable registration for image-guided radiation therapy. , 2006, Zeitschrift fur medizinische Physik.

[30]  Hans P. Moravec Rover Visual Obstacle Avoidance , 1981, IJCAI.

[31]  R. Castillo,et al.  A framework for evaluation of deformable image registration spatial accuracy using large landmark point sets , 2009, Physics in medicine and biology.

[32]  Yoshimi Anzai,et al.  FDG‐PET/CT–guided intensity modulated head and neck radiotherapy: A pilot investigation , 2005, Head & neck.

[33]  L. Xing,et al.  Feature-based rectal contour propagation from planning CT to cone beam CT. , 2008, Medical physics.

[34]  Milan Sonka,et al.  Registration of 3D spectral OCT volumes using 3D SIFT feature point matching , 2009, Medical Imaging.

[35]  Marc Kessler,et al.  STRUCTURE TRANSFER BETWEEN SETS OF THREE DIMENSIONAL MEDICAL IMAGING DATA. , 1985 .

[36]  Yaoqin Xie,et al.  Image-based modeling of tumor shrinkage in head and neck radiation therapy. , 2010, Medical physics.

[37]  Ghassan Hamarneh,et al.  n -SIFT: n -Dimensional Scale Invariant Feature Transform , 2009, IEEE Trans. Image Process..

[38]  Gregory Sharp,et al.  Analytic regularization for landmark-based image registration , 2012, Physics in medicine and biology.

[39]  Miguel Arias-Estrada,et al.  Iterative Closest SIFT Formulation for Robust Feature Matching , 2006, ISVC.

[40]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[41]  Matthew A. Brown,et al.  Invariant Features from Interest Point Groups , 2002, BMVC.

[42]  Gregory C Sharp,et al.  Scale invariant feature transform in adaptive radiation therapy: a tool for deformable image registration assessment and re-planning indication , 2013, Physics in medicine and biology.

[43]  Xavier Geets,et al.  Adaptive functional image-guided IMRT in pharyngo-laryngeal squamous cell carcinoma: is the gain in dose distribution worth the effort? , 2011, Radiotherapy and oncology : journal of the European Society for Therapeutic Radiology and Oncology.

[44]  Hans P. Moravec Visual Mapping by a Robot Rover , 1979, IJCAI.

[45]  Azriel Rosenfeld,et al.  Gray-level corner detection , 1982, Pattern Recognit. Lett..

[46]  Quynh-Thu Le,et al.  Intensity-modulated and image-guided radiation therapy for head and neck cancers. , 2011, Frontiers of radiation therapy and oncology.

[47]  Quan Chen,et al.  Objective assessment of deformable image registration in radiotherapy: A multi-institution study , 2008 .

[48]  Karl Rohr,et al.  Localization of anatomical point landmarks in 3D medical images by fitting 3D parametric intensity models , 2006, Medical Image Anal..

[49]  Adam Baumberg,et al.  Reliable feature matching across widely separated views , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[50]  Cordelia Schmid,et al.  An Affine Invariant Interest Point Detector , 2002, ECCV.