Non-rigid registration of multi-phase liver CT data using fully automated landmark detection and TPS deformation

In case of the complicated anatomical structure of the liver, landmark points on a three dimensional (3D) liver surface is hardly distinguished as corresponding pairs visually and automated landmark placing will be extremely time saving for liver registration. This paper presents a fully automated landmark detection method to register livers on multi-phase computed tomography (CT) images. Edge texture features and Support Vector Machine (SVM) are applied to detect the discriminated landmarks of the liver, including both surface and internal points. Using the information of liver shape, 3D gray level co-occurrence matrix is calculated into texture features, from which the most informatics there features are selected by our optimization algorithm for choosing a sub-set of features from a high dimensional feature set. Then automated landmarks detection begins at scanning surface points on the pre-contrast and portal venous phase images, where positive outputs of the SVM classifier are regarded as initial candidates and final candidates are obtained by eliminating false positives (FPs). Finally, relied on the detected landmarks, thin plate splines (TPS) algorithm is used to register livers. Five surface landmarks, together with internal landmarks of the liver center from every 25 mm slice interval, can be detected automatically with sensitivity of 88.33% and accuracy of 98.5%. Surface-based mean error (SME) is decreased from 3.80 to 2.87 mm on average, while SME value has increased 32.4 and 8.0% on average respectively when comparing with the rigid and B-spline methods. The results demonstrate that edge textures and SVM classifier are effective in the automated landmark detection. Together with TPS algorithm, fully automated liver registration is able to be achieved on multi-phase CT images.

[1]  D. Louis Collins,et al.  Warping of a computerized 3-D atlas to match brain image volumes for quantitative neuroanatomical and functional analysis , 1991, Medical Imaging.

[2]  Hayit Greenspan,et al.  Multi-phase liver lesions classification using relevant visual words based on mutual information , 2015, 2015 IEEE 12th International Symposium on Biomedical Imaging (ISBI).

[3]  Richard M. Leahy,et al.  Comparison of landmark-based and automatic methods for cortical surface registration , 2010, NeuroImage.

[4]  Chiara Gianoli,et al.  A tool for validating MRI-guided strategies: a digital breathing CT/MRI phantom of the abdominal site , 2017, Medical & Biological Engineering & Computing.

[5]  Karl Rohr,et al.  Image Registration Based on Thin-Plate Splines and Local Estimates of Anisotropic Landmark Localization Uncertainties , 1998, MICCAI.

[6]  Benoit M. Dawant,et al.  Semiautomatic Registration of Pre- and Postbrain Tumor Resection Laser Range Data: Method and Validation , 2009, IEEE Transactions on Biomedical Engineering.

[7]  Maryam Rezvani,et al.  Utility of dual phase liver CT for metastatic melanoma staging and surveillance. , 2013, European journal of radiology.

[8]  Jonathan S. Lewin,et al.  Semiautomatic 3-D image registration as applied to interventional MRI liver cancer treatment , 2000, IEEE Transactions on Medical Imaging.

[9]  Sébastien Ourselin,et al.  Locally rigid, vessel-based registration for laparoscopic liver surgery , 2015, International Journal of Computer Assisted Radiology and Surgery.

[10]  Villie Morocho,et al.  Hepatic Steatosis detection using the co-occurrence matrix in tomography and ultrasound images , 2015, 2015 20th Symposium on Signal Processing, Images and Computer Vision (STSIVA).

[11]  D. Hill,et al.  Medical image registration , 2001, Physics in medicine and biology.

[12]  David J. Hawkes,et al.  Registration of freehand 3D ultrasound and magnetic resonance liver images , 2004, Medical Image Anal..

[13]  Sébastien Ourselin,et al.  Evaluation of Six Registration Methods for the Human Abdomen on Clinically Acquired CT , 2016, IEEE Transactions on Biomedical Engineering.

[14]  Yoshitaka Masutani,et al.  A unified framework for concurrent detection of anatomical landmarks for medical image understanding , 2011, Medical Imaging.

[15]  William Puech,et al.  Assessing the Classification of Liver Focal Lesions by Using Multi-phase Computer Tomography Scans , 2012, MCBR-CDS.

[16]  Yongtian Wang,et al.  MR-guided liver cancer surgery by nonrigid registration , 2010, 2010 International Conference of Medical Image Analysis and Clinical Application.

[17]  Luis Ibanez,et al.  The ITK Software Guide Book 1: Introduction and Development Guidelines (Volume 1) , 2015 .

[18]  H. Won,et al.  Automatic detection method of hepatocellular carcinomas using the non-rigid registration method of multi-phase liver CT images. , 2015, Journal of X-ray science and technology.

[19]  Fred L. Bookstein,et al.  Principal Warps: Thin-Plate Splines and the Decomposition of Deformations , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  William Robson Schwartz,et al.  Multi-scale gray level co-occurrence matrices for texture description , 2013, Neurocomputing.

[21]  William M. Wells,et al.  Efficient and robust model-to-image alignment using 3D scale-invariant features , 2013, Medical Image Anal..

[22]  Wieslaw Lucjan Nowinski,et al.  A Model-Based, Semi-Global Segmentation Approach for Automatic 3-D Point Landmark Localization in Neuroimages , 2008, IEEE Transactions on Medical Imaging.

[23]  Yufei Chen,et al.  Semi-Automatic Anatomical Tree Matching for Landmark-Based Elastic Registration of Liver Volumes , 2010 .

[24]  Fabrice Mériaudeau,et al.  A Thin-Plate Spline Based Multimodal Prostate Registration with Optimal Correspondences , 2010, 2010 Sixth International Conference on Signal-Image Technology and Internet Based Systems.

[25]  Michael Brady,et al.  Textural mutual information based on cluster trees for multimodal deformable registration , 2012, 2012 9th IEEE International Symposium on Biomedical Imaging (ISBI).

[26]  Duhgoon Lee,et al.  Position tracking of moving liver lesion based on real-time registration between 2D ultrasound and 3D preoperative images. , 2015, Medical physics.

[27]  Frank Lindseth,et al.  Real-Time Automatic Artery Segmentation, Reconstruction and Registration for Ultrasound-Guided Regional Anaesthesia of the Femoral Nerve , 2016, IEEE Transactions on Medical Imaging.

[28]  Nikos Paragios,et al.  Deformable Medical Image Registration: A Survey , 2013, IEEE Transactions on Medical Imaging.

[29]  Amir Hossein Foruzan,et al.  Multimodality liver registration of Open-MR and CT scans , 2014, International Journal of Computer Assisted Radiology and Surgery.

[30]  Xiangrong Zhou,et al.  Segmentation of liver region with tumorous tissues , 2007, SPIE Medical Imaging.

[31]  Georgios Sakas,et al.  Automatic shape based deformable registration of multiphase contrast enhanced liver CT volumes , 2011, Medical Imaging.

[32]  Y. Bentoutou,et al.  Automatic extraction of control points for digital subtraction angiography image enhancement , 2003, 2003 IEEE Nuclear Science Symposium. Conference Record (IEEE Cat. No.03CH37515).

[33]  Purang Abolmaesumi,et al.  Statistical Biomechanical Surface Registration: Application to MR-TRUS Fusion for Prostate Interventions , 2015, IEEE Transactions on Medical Imaging.

[34]  Ming-Syan Chen,et al.  On the Design and Analysis of the Privacy-Preserving SVM Classifier , 2011, IEEE Transactions on Knowledge and Data Engineering.

[35]  Vladimir Pekar,et al.  Full orientation invariance and improved feature selectivity of 3D SIFT with application to medical image analysis , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[36]  Jürgen Weese,et al.  Landmark-based elastic registration using approximating thin-plate splines , 2001, IEEE Transactions on Medical Imaging.

[37]  Gregory C Sharp,et al.  Scale invariant feature transform in adaptive radiation therapy: a tool for deformable image registration assessment and re-planning indication , 2013, Physics in medicine and biology.

[38]  Wen Yan,et al.  Effective staging of fibrosis by the selected texture features of liver: Which one is better, CT or MR imaging? , 2015, Comput. Medical Imaging Graph..

[39]  Xiangrong Zhou,et al.  Deep learning of the sectional appearances of 3D CT images for anatomical structure segmentation based on an FCN voting method , 2017, Medical physics.

[40]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[41]  Ma,et al.  Selection of Optimal Shape Features for Staging Hepatic Fibrosis on CT Image , 2015 .

[42]  Thomas Lange,et al.  3D ultrasound-CT registration of the liver using combined landmark-intensity information , 2008, International Journal of Computer Assisted Radiology and Surgery.

[43]  Yu Kun Huang,et al.  Computer Aided Interpretation of Fibrous Texture in Hepatic Magnetic Resonance Images , 2013 .

[44]  João Manuel R S Tavares,et al.  Medical image registration: a review , 2014, Computer methods in biomechanics and biomedical engineering.

[45]  Zhijian Wu,et al.  CT-MR image registration in liver treatment by maximization of mutual information , 2008, 2008 IEEE International Symposium on IT in Medicine and Education.

[46]  Guy Marchal,et al.  Multimodality image registration by maximization of mutual information , 1997, IEEE Transactions on Medical Imaging.