Vertebrae Localization in Pathological Spine CT via Dense Classification from Sparse Annotations

Accurate localization and identification of vertebrae in spinal imaging is crucial for the clinical tasks of diagnosis, surgical planning, and post-operative assessment. The main difficulties for automatic methods arise from the frequent presence of abnormal spine curvature, small field of view, and image artifacts caused by surgical implants. Many previous methods rely on parametric models of appearance and shape whose performance can substantially degrade for pathological cases. We propose a robust localization and identification algorithm which builds upon supervised classification forests and avoids an explicit parametric model of appearance. We overcome the tedious requirement for dense annotations by a semi-automatic labeling strategy. Sparse centroid annotations are transformed into dense probabilistic labels which capture the inherent identification uncertainty. Using the dense labels, we learn a discriminative centroid classifier based on local and contextual intensity features which is robust to typical characteristics of spinal pathologies and image artifacts. Extensive evaluation is performed on a challenging dataset of 224 spine CT scans of patients with varying pathologies including high-grade scoliosis, kyphosis, and presence of surgical implants. Additionally, we test our method on a heterogeneous dataset of another 200, mostly abdominal, CTs. Quantitative evaluation is carried out with respect to localization errors and identification rates, and compared to a recently proposed method. Our approach is efficient and outperforms state-of-the-art on pathological cases.

[1]  Sebastian P. M. Dries,et al.  Spine Detection and Labeling Using a Parts-Based Graphical Model , 2007, IPMI.

[2]  Dorin Comaniciu,et al.  Detection of 3D Spinal Geometry Using Iterated Marginal Space Learning , 2010, MCV.

[3]  Mark Jenkinson,et al.  Non-local Shape Descriptor: A New Similarity Metric for Deformable Multi-modal Registration , 2011, MICCAI.

[4]  Ben Glocker,et al.  Automatic Localization and Identification of Vertebrae in Arbitrary Field-of-View CT Scans , 2012, MICCAI.

[5]  Rich Caruana,et al.  An empirical evaluation of supervised learning in high dimensions , 2008, ICML '08.

[6]  Kumaradevan Punithakumar,et al.  Vertebral Body Segmentation in MRI via Convex Relaxation and Distribution Matching , 2012, MICCAI.

[7]  Ronald M. Summers,et al.  Detection of Vertebral Body Fractures Based on Cortical Shell Unwrapping , 2012, MICCAI.

[8]  Stefan Wesarg,et al.  Automated Skeleton Based Multi-modal Deformable Registration of Head&Neck Datasets , 2012, MICCAI.

[9]  Ayse Betül Oktay,et al.  Localization of the Lumbar Discs Using Machine Learning and Exact Probabilistic Inference , 2011, MICCAI.

[10]  Cristian Lorenz,et al.  Automated model-based vertebra detection, identification, and segmentation in CT images , 2009, Medical Image Anal..

[11]  Yiqiang Zhan,et al.  Robust MR Spine Detection Using Hierarchical Learning and Local Articulated Model , 2012, MICCAI.

[12]  John Hsiang,et al.  Wrong-level surgery: A unique problem in spine surgery , 2011, Surgical neurology international.

[13]  Georg Langs,et al.  Medical Computer Vision , 2011 .

[14]  Antonio Criminisi,et al.  Decision Forests with Long-Range Spatial Context for Organ Localization in CT Volumes , 2009 .

[15]  Yizong Cheng,et al.  Mean Shift, Mode Seeking, and Clustering , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Shang-Hong Lai,et al.  Learning-Based Vertebra Detection and Iterative Normalized-Cut Segmentation for Spinal MRI , 2009, IEEE Transactions on Medical Imaging.

[17]  Mohammed Benjelloun,et al.  Fast 3D Spine Reconstruction of Postoperative Patients Using a Multilevel Statistical Model , 2012, MICCAI.

[18]  Nassir Navab,et al.  Medical Image Computing and Computer-Assisted Intervention - MICCAI 2010, 13th International Conference, Beijing, China, September 20-24, 2010, Proceedings, Part III , 2010, MICCAI.

[19]  Hervé Delingette,et al.  Medical Image Computing and Computer-Assisted Intervention – MICCAI 2012 , 2012, Lecture Notes in Computer Science.

[20]  Jun Ma,et al.  Hierarchical segmentation and identification of thoracic vertebra using learning-based edge detection and coarse-to-fine deformable model , 2010, Comput. Vis. Image Underst..

[21]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.