3D-SIFT-Flow for atlas-based CT liver image segmentation.

PURPOSE In this paper, the authors proposed a new 3D registration algorithm, 3D-scale invariant feature transform (SIFT)-Flow, for multiatlas-based liver segmentation in computed tomography (CT) images. METHODS In the registration work, the authors developed a new registration method that takes advantage of dense correspondence using the informative and robust SIFT feature. The authors computed the dense SIFT features for the source image and the target image and designed an objective function to obtain the correspondence between these two images. Labeling of the source image was then mapped to the target image according to the former correspondence, resulting in accurate segmentation. In the fusion work, the 2D-based nonparametric label transfer method was extended to 3D for fusing the registered 3D atlases. RESULTS Compared with existing registration algorithms, 3D-SIFT-Flow has its particular advantage in matching anatomical structures (such as the liver) that observe large variation/deformation. The authors observed consistent improvement over widely adopted state-of-the-art registration methods such as ELASTIX, ANTS, and multiatlas fusion methods such as joint label fusion. Experimental results of liver segmentation on the MICCAI 2007 Grand Challenge are encouraging, e.g., Dice overlap ratio 96.27% ± 0.96% by our method compared with the previous state-of-the-art result of 94.90% ± 2.86%. CONCLUSIONS Experimental results show that 3D-SIFT-Flow is robust for segmenting the liver from CT images, which has large tissue deformation and blurry boundary, and 3D label transfer is effective and efficient for improving the registration accuracy.

[1]  Pamela C. Cosman,et al.  Tracking Epithelial Cell Junctions in C. elegans Embryogenesis With Active Contours Guided by SIFT Flow , 2015, IEEE Transactions on Biomedical Engineering.

[2]  Mert R. Sabuncu,et al.  Multi-atlas segmentation of biomedical images: A survey , 2014, Medical Image Anal..

[3]  Carlos Platero,et al.  A Multiatlas Segmentation Using Graph Cuts with Applications to Liver Segmentation in CT Scans , 2014, Comput. Math. Methods Medicine.

[4]  K. Rosenzweig,et al.  SU-C-18A-06: Tracking Fuzzy Border Using Geodesic Curve and Its Application to Liver Segmentation On Planning CT. , 2014, Medical physics.

[5]  Denis Kouame,et al.  New Estimators and Guidelines for Better Use of Fetal Heart Rate Estimators with Doppler Ultrasound Devices , 2014, Comput. Math. Methods Medicine.

[6]  Daniel Rueckert,et al.  A Probabilistic Patch-Based Label Fusion Model for Multi-Atlas Segmentation With Registration Refinement: Application to Cardiac MR Images , 2013, IEEE Transactions on Medical Imaging.

[7]  Paul A. Yushkevich,et al.  Multi-Atlas Segmentation with Joint Label Fusion , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Bennett A Landman,et al.  Non-local statistical label fusion for multi-atlas segmentation , 2013, Medical Image Anal..

[9]  D. Selvathi,et al.  Survey on segmentation of liver from CT images , 2012, 2012 IEEE International Conference on Advanced Communication Control and Computing Technologies (ICACCCT).

[10]  Ronald M. Summers,et al.  Tumor Burden Analysis on Computed Tomography by Automated Liver and Tumor Segmentation , 2012, IEEE Transactions on Medical Imaging.

[11]  Aurel Vlaicu,et al.  3D DCT supervised segmentation applied on liver volumes , 2012, 2012 35th International Conference on Telecommunications and Signal Processing (TSP).

[12]  Shang-Hong Lai,et al.  3D Liver Segmentation and Model Reconstruction from CT Images , 2012, 2012 International Conference on Biomedical Engineering and Biotechnology.

[13]  Tianzi Jiang,et al.  Iterative multi-atlas based segmentation with multi-channel image registration and Jackknife Context Model , 2012, 2012 9th IEEE International Symposium on Biomedical Imaging (ISBI).

[14]  Ahmed M. Mharib,et al.  Survey on liver CT image segmentation methods , 2012, Artificial Intelligence Review.

[15]  Antonio Torralba,et al.  Nonparametric Scene Parsing via Label Transfer , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Petia Radeva,et al.  Non-rigid Multi-modal Registration of Coronary Arteries Using SIFTflow , 2011, IbPRIA.

[17]  Antonio Torralba,et al.  SIFT Flow: Dense Correspondence across Scenes and Its Applications , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Nicolas Cherbuin,et al.  Optimal weights for local multi-atlas fusion using supervised learning and dynamic information (SuperDyn): Validation on hippocampus segmentation , 2011, NeuroImage.

[19]  Arno Klein,et al.  A reproducible evaluation of ANTs similarity metric performance in brain image registration , 2011, NeuroImage.

[20]  Xing Zhang,et al.  Automatic Liver Segmentation Using a Statistical Shape Model With Optimal Surface Detection , 2010, IEEE Transactions on Biomedical Engineering.

[21]  Jordi Vitrià,et al.  Aligning endoluminal scene sequences in wireless capsule endoscopy , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.

[22]  J. Sandberg,et al.  Automated segmentation and quantification of liver and spleen from CT images using normalized probabilistic atlases and enhancement estimation. , 2010, Medical physics.

[23]  R. Woods,et al.  Evaluation of 14 nonlinear deformation algorithms applied to human brain MRI registration , 2009, NeuroImage.

[24]  Carlos Ortiz-de-Solorzano,et al.  Combination Strategies in Multi-Atlas Image Segmentation: Application to Brain MR Data , 2009, IEEE Transactions on Medical Imaging.

[25]  Martin Styner,et al.  Comparison and Evaluation of Methods for Liver Segmentation From CT Datasets , 2009, IEEE Transactions on Medical Imaging.

[26]  Vladimir Pekar,et al.  Full orientation invariance and improved feature selectivity of 3D SIFT with application to medical image analysis , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[27]  Paul M. Thompson,et al.  Brain Anatomical Structure Segmentation by Hybrid Discriminative/Generative Models , 2008, IEEE Transactions on Medical Imaging.

[28]  Mubarak Shah,et al.  A 3-dimensional sift descriptor and its application to action recognition , 2007, ACM Multimedia.

[29]  Daniel Rueckert,et al.  Automatic anatomical brain MRI segmentation combining label propagation and decision fusion , 2006, NeuroImage.

[30]  Guido Gerig,et al.  User-guided 3D active contour segmentation of anatomical structures: Significantly improved efficiency and reliability , 2006, NeuroImage.

[31]  Cordelia Schmid,et al.  Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[32]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[33]  James S. Duncan,et al.  Neighbor-constrained segmentation with level set based 3-D deformable models , 2004, IEEE Transactions on Medical Imaging.

[34]  William M. Wells,et al.  Simultaneous truth and performance level estimation (STAPLE): an algorithm for the validation of image segmentation , 2004, IEEE Transactions on Medical Imaging.

[35]  Torsten Rohlfing,et al.  Evaluation of atlas selection strategies for atlas-based image segmentation with application to confocal microscopy images of bee brains , 2004, NeuroImage.

[36]  Luigi Solbiati,et al.  Treatment of focal liver tumors with percutaneous radio-frequency ablation: complications encountered in a multicenter study. , 2003, Radiology.

[37]  Dinggang Shen,et al.  HAMMER: hierarchical attribute matching mechanism for elastic registration , 2002, IEEE Transactions on Medical Imaging.

[38]  James J. Little,et al.  Vision-based mobile robot localization and mapping using scale-invariant features , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[39]  Jyh-Horng Chen,et al.  3D motion analysis of MR imaging using optical flow method , 1995, Proceedings of 17th International Conference of the Engineering in Medicine and Biology Society.

[40]  J. Michael Fitzpatrick The existence of geometrical density-image transformations corresponding to object motion , 1988, Comput. Vis. Graph. Image Process..

[41]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[42]  Armando Barreto,et al.  A 3-D Liver Segmentation Method with Parallel Computing for Selective Internal Radiation Therapy , 2012, IEEE Transactions on Information Technology in Biomedicine.

[43]  Liana G. Apostolova,et al.  Comparison of AdaBoost and Support Vector Machines for Detecting Alzheimer's Disease Through Automated Hippocampal Segmentation , 2010, IEEE Transactions on Medical Imaging.

[44]  Max A. Viergever,et al.  elastix: A Toolbox for Intensity-Based Medical Image Registration , 2010, IEEE Transactions on Medical Imaging.

[45]  Thomas Lange,et al.  Shape Constrained Automatic Segmentation of the Liver based on a Heuristic Intensity Model , 2007 .

[46]  Hans-Peter Meinzer,et al.  A Statistical Deformable Model for the Segmentation of Liver CT Volumes , 2007 .

[47]  Fernando Bello,et al.  A Discussion on the Evaluation of A New Automatic Liver Volume Segmentation Method for Specified CT Image Datasets , 2007 .

[48]  Benoit M. Dawant,et al.  Morphometric analysis of white matter lesions in MR images: method and validation , 1994, IEEE Trans. Medical Imaging.