Regression Forests for Efficient Anatomy Detection and Localization in CT Studies

This paper proposes multi-class random regression forests as an algorithm for the efficient, automatic detection and localization of anatomical structures within three-dimensional CT scans. Regression forests are similar to the more popular classification forests, but trained to predict continuous outputs. We introduce a new, continuous parametrization of the anatomy localization task which is effectively addressed by regression forests. This is shown to be a more natural approach than classification. A single pass of our probabilistic algorithm enables the direct mapping from voxels to organ location and size; with training focusing on maximizing the confidence of output predictions. As a by-product, our method produces salient anatomical landmarks; i.e. automatically selected "anchor" regions which help localize organs of interest with high confidence. Quantitative validation is performed on a database of 100 highly variable CT scans. Localization errors are shown to be lower (and more stable) than those from global affine registration approaches. The regressor's parallelism and the simplicity of its context-rich visual features yield typical runtimes of only 1s. Applications include semantic visual navigation, image tagging for retrieval, and initializing organ-specific processing.

[1]  Leo Breiman,et al.  Classification and Regression Trees , 1984 .

[2]  W. Härdle Applied Nonparametric Regression: Introduction , 1990 .

[3]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[4]  J. Friedman Greedy function approximation: A gradient boosting machine. , 2001 .

[5]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[6]  Akinobu Shimizu,et al.  Simultaneous segmentation of multi-organ in three dimensional abdominal CT images , 2005 .

[7]  Dorin Comaniciu,et al.  Image based regression using boosting method , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[8]  Multi-organ segmentation in three dimensional abdominal CT images , 2006 .

[9]  Antonio Criminisi,et al.  TextonBoost for Image Understanding: Multi-Class Object Recognition and Segmentation by Jointly Modeling Texture, Layout, and Context , 2007, International Journal of Computer Vision.

[10]  Irfan A. Essa,et al.  Tree-based Classifiers for Bilayer Video Segmentation , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[11]  Dorin Comaniciu,et al.  A boosting regression approach to medical anatomy detection , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[12]  Antonio Torralba,et al.  Sharing Visual Features for Multiclass and Multiview Object Detection , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Gabor Fichtinger,et al.  Medical Image Computing and Computer-Assisted Intervention - MICCAI 2008, 11th International Conference, New York, NY, USA, September 6-10, 2008, Proceedings, Part I , 2008, International Conference on Medical Image Computing and Computer-Assisted Intervention.

[14]  Matthias Fenchel,et al.  Automatic Labeling of Anatomical Structures in MR FastView Images Using a Statistical Atlas , 2008, MICCAI.

[15]  Yiqiang Zhan,et al.  Active Scheduling of Organ Detection and Segmentation in Whole-Body Medical Images , 2008, MICCAI.

[16]  Juergen Gall,et al.  Class-specific Hough forests for object detection , 2009, CVPR.

[17]  Haibin Ling,et al.  Age regression from faces using random forests , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[18]  Dorin Comaniciu,et al.  Hierarchical parsing and semantic navigation of full body CT data , 2009, Medical Imaging.

[19]  Antonio Criminisi,et al.  Decision Forests with Long-Range Spatial Context for Organ Localization in CT Volumes , 2009 .

[20]  Max A. Viergever,et al.  Multi-Atlas-Based Segmentation With Local Decision Fusion—Application to Cardiac and Aortic Segmentation in CT Scans , 2009, IEEE Transactions on Medical Imaging.