Automatic localization of vertebrae based on convolutional neural networks

Localization of the vertebrae is of importance in many medical applications. For example, the vertebrae can serve as the landmarks in image registration. They can also provide a reference coordinate system to facilitate the localization of other organs in the chest. In this paper, we propose a new vertebrae localization method using convolutional neural networks (CNN). The main advantage of the proposed method is the removal of hand-crafted features. We construct two training sets to train two CNNs that share the same architecture. One is used to distinguish the vertebrae from other tissues in the chest, and the other is aimed at detecting the centers of the vertebrae. The architecture contains two convolutional layers, both of which are followed by a max-pooling layer. Then the output feature vector from the maxpooling layer is fed into a multilayer perceptron (MLP) classifier which has one hidden layer. Experiments were performed on ten chest CT images. We used leave-one-out strategy to train and test the proposed method. Quantitative comparison between the predict centers and ground truth shows that our convolutional neural networks can achieve promising localization accuracy without hand-crafted features.

[1]  Ronald M. Summers,et al.  A New 2.5D Representation for Lymph Node Detection Using Random Sets of Deep Convolutional Neural Network Observations , 2014, MICCAI.

[2]  Cristian Lorenz,et al.  Spine Segmentation Using Articulated Shape Models , 2008, MICCAI.

[3]  Ben Glocker,et al.  Automatic Localization and Identification of Vertebrae in Arbitrary Field-of-View CT Scans , 2012, MICCAI.

[4]  Ajay Mittal,et al.  A survey on techniques of vertebrae localization , 2014, 2014 Recent Advances in Engineering and Computational Sciences (RAECS).

[5]  Luca Maria Gambardella,et al.  Deep Neural Networks Segment Neuronal Membranes in Electron Microscopy Images , 2012, NIPS.

[6]  Nikos Paragios,et al.  Automatic inference of articulated spine models in CT images using high-order Markov Random Fields , 2011, Medical Image Anal..

[7]  Mohammed Benjelloun,et al.  Fully automatic vertebra detection in x-ray images based on multi-class SVM , 2012, Medical Imaging.

[8]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[9]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[10]  H. Labelle,et al.  Spine Segmentation in Medical Images Using Manifold Embeddings and Higher-Order MRFs , 2013, IEEE Transactions on Medical Imaging.

[11]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[12]  Jun Ma,et al.  Hierarchical segmentation and identification of thoracic vertebra using learning-based edge detection and coarse-to-fine deformable model , 2010, Comput. Vis. Image Underst..

[13]  Dirk H. J. Poot,et al.  Adaptive noise filtering for accurate and precise diffusion estimation in fiber crossings - MICCAI 2010 , 2010, MICCAI 2010.

[14]  Zhenghao Chen,et al.  On Random Weights and Unsupervised Feature Learning , 2011, ICML.

[15]  Gabor Fichtinger,et al.  Medical Image Computing and Computer-Assisted Intervention - MICCAI 2008, 11th International Conference, New York, NY, USA, September 6-10, 2008, Proceedings, Part I , 2008, International Conference on Medical Image Computing and Computer-Assisted Intervention.

[16]  Ayse Betül Oktay,et al.  Simultaneous Localization of Lumbar Vertebrae and Intervertebral Discs With SVM-Based MRF , 2013, IEEE Transactions on Biomedical Engineering.

[17]  Ronald M. Summers,et al.  Detection of Sclerotic Spine Metastases via Random Aggregation of Deep Convolutional Neural Network Classifications , 2014, ArXiv.