Detection and location of 127 anatomical landmarks in diverse CT datasets

The automatic detection and localization of anatomical landmarks has wide application, including intra and interpatient registration, study location and navigation, and the targeting of specialized algorithms. In this paper, we demonstrate the automatic detection and localization of 127 anatomically defined landmarks distributed throughout the body, excluding arms. Landmarks are defined on the skeleton, vasculature and major organs. Our approach builds on the classification forests method,1 using this classifier with simple image features which can be efficiently computed. For the training and validation of the method we have used 369 CT volumes on which radiographers and anatomists have marked ground truth (GT) - that is the locations of all defined landmarks occurring in that volume. A particular challenge is to deal with the wide diversity of datasets encountered in radiology practice. These include data from all major scanner manufacturers, different extents covering single and multiple body compartments, truncated cardiac acquisitions, with and without contrast. Cases with stents and catheters are also represented. Validation is by a leave-one-out method, which we show can be efficiently implemented in the context of decision forest methods. Mean location accuracy of detected landmarks is 13.45mm overall; execution time averages 7s per volume on a modern server machine. We also present localization ROC analysis to characterize detection accuracy - that is to decide if a landmark is or is not present in a given dataset.

[1]  J. Ross Quinlan,et al.  C4.5: Programs for Machine Learning , 1992 .

[2]  Timo Kohlberger,et al.  Automatic Multi-organ Segmentation Using Learning-Based Segmentation and Level Set Optimization , 2011, MICCAI.

[3]  Nathan Lay,et al.  Rapid Multi-organ Segmentation Using Context Integration and Discriminative Models , 2013, IPMI.

[4]  T. Ikegami,et al.  Simultaneous extraction of multiple organs from abdominal CT , 2006 .

[5]  Antonio Criminisi,et al.  Decision Forests with Long-Range Spatial Context for Organ Localization in CT Volumes , 2009 .

[6]  Zhuowen Tu,et al.  Combining Generative and Discriminative Models for Semantic Segmentation of CT Scans via Active Learning , 2011, IPMI.

[7]  Günther Platsch,et al.  Improved Anatomical Landmark Localization in Medical Images Using Dense Matching of Graphical Models , 2010, BMVC.

[8]  Chengwen Chu,et al.  Multi-organ Segmentation Based on Spatially-Divided Probabilistic Atlas from 3D Abdominal CT Images , 2013, MICCAI.

[9]  Shaohua Kevin Zhou,et al.  Anatomical Landmark Detection Using Nearest Neighbor Matching and Submodular Optimization , 2012, MICCAI.

[10]  Karl Rohr,et al.  Localization of anatomical point landmarks in 3D medical images by fitting 3D parametric intensity models , 2006, Medical Image Anal..

[11]  Akinobu Shimizu,et al.  Segmentation of multiple organs in non-contrast 3D abdominal CT images , 2007, International Journal of Computer Assisted Radiology and Surgery.

[12]  Ronald M. Summers,et al.  Multi-organ Segmentation from Multi-phase Abdominal CT via 4D Graphs Using Enhancement, Shape and Location Optimization , 2010, MICCAI.

[13]  Ronald M. Summers,et al.  Abdominal Multi-organ CT Segmentation Using Organ Correlation Graph and Prediction-Based Shape and Location Priors , 2013, MICCAI.

[14]  Akinobu Shimizu,et al.  Probabilistic Atlas-guided Eigen-organ Method for Simultaneous Bounding Box Estimation of Multiple Organs in Volumetric CT Images , 2006 .

[15]  Horst Bischof,et al.  Global localization of 3D anatomical structures by pre-filtered Hough Forests and discrete optimization , 2013, Medical Image Anal..

[16]  Antonio Criminisi,et al.  Medical Computer Vision. Recognition Techniques and Applications in Medical Imaging , 2010, Lecture Notes in Computer Science.

[17]  Dimitris N. Metaxas,et al.  Entangled Decision Forests and Their Application for Semantic Segmentation of CT Images , 2011, IPMI.

[18]  Antonio Criminisi,et al.  Fast Multiple Organ Detection and Localization in Whole-Body MR Dixon Sequences , 2011, MICCAI.

[19]  Antonio Criminisi,et al.  Regression Forests for Efficient Anatomy Detection and Localization in CT Studies , 2010, MCV.

[20]  Dorin Comaniciu,et al.  Search strategies for multiple landmark detection by submodular maximization , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.