Automatic segmentation of the lumbar spine from medical images

Segmentation of the lumbar spine in 3D is a necessary step in numerous medical applications, but remains a challenging problem for computational methods due to the complex and varied shape of the anatomy and the noise and other artefacts often present in the images. While manual annotation of anatomical objects such as vertebrae is often carried out with the aid of specialised software, obtaining even a single example can be extremely time-consuming. Automating the segmentation process is the only feasible way to obtain accurate and reliable segmentations on any large scale. This thesis describes an approach for automatic segmentation of the lumbar spine from medical images; specifically those acquired using magnetic resonance imaging (MRI) and computed tomography (CT). The segmentation problem is formulated as one of assigning class labels to local clustered regions of an image (called superpixels in 2D or supervoxels in 3D). Features are introduced in 2D and 3D which can be used to train a classifier for estimating the class labels of the superpixels or supervoxels. Spatial context is introduced by incorporating the class estimates into a conditional random field along with a learned pairwise metric. Inference over the resulting model can be carried out very efficiently, enabling an accurate pixelor voxel-level segmentation to be recovered from the labelled regions. In contrast to most previous work in the literature, the approach does not rely on explicit prior shape information. It therefore avoids many of the problems associated with these methods, such as the need to construct a representative prior model of anatomical shape from training data and the approximate nature of the optimisation. The general-purpose nature of the proposed method means that it can be used to accurately segment both vertebrae and intervertebral discs from medical images without fundamental change to the model. Evaluation of the approach shows it to obtain accurate and robust performance in the presence of significant anatomical variation. The median average symmetric surface distances for 2D vertebra segmentation were 0.27 mm on MRI data and 0.02 mm on CT data. For 3D vertebra segmentation the median surface distances were 0.90 mm on MRI data and 0.20 mm on CT data. For 3D intervertebral disc segmentation a median surface distance of 0.54 mm was obtained on MRI data.

[1]  L. Younes Shapes and Diffeomorphisms , 2010 .

[2]  Daniel Cremers,et al.  A Survey and Comparison of Discrete and Continuous Multi-label Optimization Approaches for the Potts Model , 2013, International Journal of Computer Vision.

[3]  Hans-Peter Meinzer,et al.  Statistical shape models for 3D medical image segmentation: A review , 2009, Medical Image Anal..

[4]  Daniel Cremers,et al.  Shape statistics in kernel space for variational image segmentation , 2003, Pattern Recognit..

[5]  Jean Ponce,et al.  Learning mid-level features for recognition , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[6]  A. Atiya,et al.  Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond , 2005, IEEE Transactions on Neural Networks.

[7]  H. Knutsson Representing Local Structure Using Tensors , 1989 .

[8]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[9]  Prasanth B. Nair,et al.  Use of a statistical model of the whole femur in a large scale, multi-model study of femoral neck fracture risk. , 2009, Journal of biomechanics.

[10]  Torsten Rohlfing,et al.  Quo Vadis, Atlas-Based Segmentation? , 2005 .

[11]  David J. Field,et al.  Emergence of simple-cell receptive field properties by learning a sparse code for natural images , 1996, Nature.

[12]  Andrea Vedaldi,et al.  Vlfeat: an open and portable library of computer vision algorithms , 2010, ACM Multimedia.

[13]  Laurent D. Cohen,et al.  On active contour models and balloons , 1991, CVGIP Image Underst..

[14]  Carl-Fredrik Westin,et al.  Representing Local Structure Using Tensors II , 2011, SCIA.

[15]  R. Fisher THE USE OF MULTIPLE MEASUREMENTS IN TAXONOMIC PROBLEMS , 1936 .

[16]  Serge J. Belongie,et al.  Normalized cuts in 3-D for spinal MRI segmentation , 2004, IEEE Transactions on Medical Imaging.

[17]  Andrew Blake,et al.  Branch-and-Mincut: Global Optimization for Image Segmentation with High-Level Priors , 2012, Journal of Mathematical Imaging and Vision.

[18]  Tom Fawcett,et al.  An introduction to ROC analysis , 2006, Pattern Recognit. Lett..

[19]  Martin Urschler,et al.  Vertebrae Segmentation in 3D CT Images Based on a Variational Framework , 2015 .

[20]  Jayaram K. Udupa,et al.  Automatic landmark selection for active shape models , 2005, SPIE Medical Imaging.

[21]  Andrew Zisserman,et al.  MLESAC: A New Robust Estimator with Application to Estimating Image Geometry , 2000, Comput. Vis. Image Underst..

[22]  Guillermo Sapiro,et al.  Geodesic Active Contours , 1995, International Journal of Computer Vision.

[23]  H. Labelle,et al.  Sagittal Alignment of the Spine and Pelvis in the Presence of L5–S1 Isthmic Lysis and Low-Grade Spondylolisthesis , 2006 .

[24]  Dongsung Kim,et al.  A fully automatic vertebra segmentation method using 3D deformable fences , 2009, Comput. Medical Imaging Graph..

[25]  Jun Ma,et al.  Hierarchical segmentation and identification of thoracic vertebra using learning-based edge detection and coarse-to-fine deformable model , 2010, Comput. Vis. Image Underst..

[26]  Pascal Vincent,et al.  Stacked Denoising Autoencoders: Learning Useful Representations in a Deep Network with a Local Denoising Criterion , 2010, J. Mach. Learn. Res..

[27]  Caroline Petitjean,et al.  A review of segmentation methods in short axis cardiac MR images , 2011, Medical Image Anal..

[28]  Shuo Li,et al.  Intervertebral disc segmentation in MR images using anisotropic oriented flux , 2013, Medical Image Anal..

[29]  Alejandro F. Frangi,et al.  Accurate Segmentation of Vertebral Bodies and Processes Using Statistical Shape Decomposition and Conditional Models , 2015, IEEE Transactions on Medical Imaging.

[30]  J. Sethian,et al.  Fronts propagating with curvature-dependent speed: algorithms based on Hamilton-Jacobi formulations , 1988 .

[31]  Dorin Comaniciu,et al.  Four-Chamber Heart Modeling and Automatic Segmentation for 3-D Cardiac CT Volumes Using Marginal Space Learning and Steerable Features , 2008, IEEE Transactions on Medical Imaging.

[32]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[33]  Bernhard Schölkopf,et al.  Nonlinear Component Analysis as a Kernel Eigenvalue Problem , 1998, Neural Computation.

[34]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.

[35]  Terrence J. Sejnowski,et al.  Edges are the Independent Components of Natural Scenes , 1996, NIPS.

[36]  Guillermo Sapiro,et al.  Supervised Dictionary Learning , 2008, NIPS.

[37]  Michiel M. A. Janssen,et al.  Quantitative analysis of the closure pattern of the neurocentral junction as related to preexistent rotation in the normal immature spine. , 2013, The spine journal : official journal of the North American Spine Society.

[38]  Stefano Soatto,et al.  Class segmentation and object localization with superpixel neighborhoods , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[39]  Nikos Komodakis,et al.  MRF Energy Minimization and Beyond via Dual Decomposition , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[40]  Kilian Q. Weinberger,et al.  Distance Metric Learning for Large Margin Nearest Neighbor Classification , 2005, NIPS.

[41]  Tai Sing Lee,et al.  Region competition: unifying snakes, region growing, energy/Bayes/MDL for multi-band image segmentation , 1995, Proceedings of IEEE International Conference on Computer Vision.

[42]  Christopher Nimsky,et al.  Segmentation of Vertebral Bodies in MR Images , 2012, VMV.

[43]  Daniel Cremers,et al.  Kernel Density Estimation and Intrinsic Alignment for Shape Priors in Level Set Segmentation , 2006, International Journal of Computer Vision.

[44]  Daniel J. Cook,et al.  Variability of manual lumbar spine segmentation , 2012, International Journal of Spine Surgery.

[45]  Daniel Cremers,et al.  An algorithm for minimizing the Mumford-Shah functional , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[46]  Vladimir Kolmogorov,et al.  An Experimental Comparison of Min-Cut/Max-Flow Algorithms for Energy Minimization in Vision , 2004, IEEE Trans. Pattern Anal. Mach. Intell..

[47]  Chih-Jen Lin,et al.  Probability Estimates for Multi-class Classification by Pairwise Coupling , 2003, J. Mach. Learn. Res..

[48]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[49]  Michael Elad,et al.  Sparse and Redundant Representations - From Theory to Applications in Signal and Image Processing , 2010 .

[50]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[51]  S. Li,et al.  Regression Segmentation for $M^{3}$ Spinal Images , 2015, IEEE Transactions on Medical Imaging.

[52]  Hugo Hutt,et al.  3D Intervertebral Disc Segmentation from MRI Using Supervoxel-Based CRFs , 2015, CSI@MICCAI.

[53]  Stefan Wesarg,et al.  3D Active Shape Model Segmentation with Nonlinear Shape Priors , 2011, MICCAI.

[54]  Hans Knutsson,et al.  Morphons: segmentation using elastic canvas and paint on priors , 2005, IEEE International Conference on Image Processing 2005.

[55]  Bulat Ibragimov,et al.  An Improved Shape-Constrained Deformable Model for Segmentation of Vertebrae from CT Lumbar Spine Images , 2015 .

[56]  Guido Gerig,et al.  User-guided 3D active contour segmentation of anatomical structures: Significantly improved efficiency and reliability , 2006, NeuroImage.

[57]  Timothy F. Cootes,et al.  Building 3-D Statistical Shape Models by Direct Optimization , 2010, IEEE Transactions on Medical Imaging.

[58]  Antonin Chambolle,et al.  A First-Order Primal-Dual Algorithm for Convex Problems with Applications to Imaging , 2011, Journal of Mathematical Imaging and Vision.

[59]  Timothy F. Cootes,et al.  Active Shape Models-Their Training and Application , 1995, Comput. Vis. Image Underst..

[60]  Gareth Funka-Lea,et al.  Graph Cuts and Efficient N-D Image Segmentation , 2006, International Journal of Computer Vision.

[61]  P. Violas,et al.  Objective quantification of intervertebral disc volume properties using MRI in idiopathic scoliosis surgery. , 2007, Magnetic resonance imaging.

[62]  Dana H. Ballard,et al.  Generalizing the Hough transform to detect arbitrary shapes , 1981, Pattern Recognit..

[63]  John Platt,et al.  Probabilistic Outputs for Support vector Machines and Comparisons to Regularized Likelihood Methods , 1999 .

[64]  J. Ross,et al.  Lumbar degenerative disk disease. , 2007, Radiology.

[65]  Oliver Wirjadi,et al.  Survey of 3d image segmentation methods , 2007 .

[66]  H. Labelle,et al.  Spine Segmentation in Medical Images Using Manifold Embeddings and Higher-Order MRFs , 2013, IEEE Transactions on Medical Imaging.

[67]  Nikos Komodakis,et al.  Markov Random Field modeling, inference & learning in computer vision & image understanding: A survey , 2013, Comput. Vis. Image Underst..

[68]  Terrence J. Sejnowski,et al.  The “independent components” of natural scenes are edge filters , 1997, Vision Research.

[69]  Robert Tibshirani,et al.  The Elements of Statistical Learning: Data Mining, Inference, and Prediction, 2nd Edition , 2001, Springer Series in Statistics.

[70]  Andrew Y. Ng,et al.  Learning Feature Representations with K-Means , 2012, Neural Networks: Tricks of the Trade.

[71]  Demetri Terzopoulos,et al.  Deformable models in medical image analysis: a survey , 1996, Medical Image Anal..

[72]  Ramin Zabih,et al.  Dynamic Programming and Graph Algorithms in Computer Vision , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[73]  Fengzeng Jian,et al.  An improved level set method for vertebra CT image segmentation , 2013, Biomedical engineering online.

[74]  Michael Isard,et al.  Active Contours: The Application of Techniques from Graphics, Vision, Control Theory and Statistics to Visual Tracking of Shapes in Motion , 2000 .

[75]  B. Michael Kelm,et al.  Fast and robust 3D vertebra segmentation using statistical shape models , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[76]  Pascal Vincent,et al.  Representation Learning: A Review and New Perspectives , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[77]  J. Gower Generalized procrustes analysis , 1975 .

[78]  Alejandro F. Frangi,et al.  Age-Related Changes in Vertebral Morphometry by Statistical Shape Analysis , 2012, MeshMed.

[79]  Pushmeet Kohli,et al.  Robust Higher Order Potentials for Enforcing Label Consistency , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[80]  Pushmeet Kohli,et al.  Dynamic Graph Cuts for Efficient Inference in Markov Random Fields , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[81]  Rajat Raina,et al.  Efficient sparse coding algorithms , 2006, NIPS.

[82]  Daniel Forsberg Atlas-Based Segmentation of the Thoracic and Lumbar Vertebrae , 2015 .

[83]  Pushmeet Kohli,et al.  Markov Random Fields for Vision and Image Processing , 2011 .

[84]  Richard M. Everson,et al.  Segmentation of Lumbar Vertebrae Slices from CT Images , 2015 .

[85]  D. Mumford,et al.  Optimal approximations by piecewise smooth functions and associated variational problems , 1989 .

[86]  Pascal Fua,et al.  Supervoxel-Based Segmentation of Mitochondria in EM Image Stacks With Learned Shape Features , 2012, IEEE Transactions on Medical Imaging.

[87]  Joachim Weickert,et al.  Coherence-Enhancing Diffusion Filtering , 1999, International Journal of Computer Vision.

[88]  Rachid Deriche,et al.  A Review of Statistical Approaches to Level Set Segmentation: Integrating Color, Texture, Motion and Shape , 2007, International Journal of Computer Vision.

[89]  Horst Bischof,et al.  Variational segmentation of elongated volumetric structures , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[90]  Nikos Komodakis,et al.  Beyond pairwise energies: Efficient optimization for higher-order MRFs , 2009, CVPR.

[91]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[92]  Richard Szeliski,et al.  A Comparative Study of Energy Minimization Methods for Markov Random Fields , 2006, ECCV.

[93]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[94]  W. Press,et al.  Numerical Recipes: The Art of Scientific Computing , 1987 .

[95]  Dorin Comaniciu,et al.  Spine detection in CT and MR using iterated marginal space learning , 2013, Medical Image Anal..

[96]  Jean Ponce,et al.  Sparse Modeling for Image and Vision Processing , 2014, Found. Trends Comput. Graph. Vis..

[97]  Samuel Kadoury,et al.  Stacked Auto-encoders for Classification of 3D Spine Models in Adolescent Idiopathic Scoliosis , 2015 .

[98]  W. Bradley,et al.  MRI: The Basics , 1997 .

[99]  Lena Costaridou,et al.  Atlas-Based Segmentation of Degenerated Lumbar Intervertebral Discs From MR Images of the Spine , 2009, IEEE Transactions on Biomedical Engineering.

[100]  Cristian Lorenz,et al.  Automated model-based vertebra detection, identification, and segmentation in CT images , 2009, Medical Image Anal..

[101]  Nikos Paragios,et al.  Deformable Medical Image Registration: A Survey , 2013, IEEE Transactions on Medical Imaging.

[102]  Z.J. Koles,et al.  Medical Image Segmentation: Methods and Software , 2007, 2007 Joint Meeting of the 6th International Symposium on Noninvasive Functional Source Imaging of the Brain and Heart and the International Conference on Functional Biomedical Imaging.

[103]  Stuart Crozier,et al.  Automated 3D Segmentation of Vertebral Bodies and Intervertebral Discs from MRI , 2011, 2011 International Conference on Digital Image Computing: Techniques and Applications.

[104]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[105]  Pushmeet Kohli,et al.  Measuring uncertainty in graph cut solutions , 2008, Comput. Vis. Image Underst..

[106]  Ian T. Jolliffe,et al.  Principal Component Analysis , 2002, International Encyclopedia of Statistical Science.

[107]  Timothy F. Cootes,et al.  Statistical Shape and Appearance Models in Osteoporosis , 2014, Current Osteoporosis Reports.

[108]  Daniel Rueckert,et al.  Right ventricle segmentation from cardiac MRI: A collation study , 2015, Medical Image Anal..

[109]  Michael Brady,et al.  Estimating the bias field of MR images , 1997, IEEE Transactions on Medical Imaging.

[110]  C J Taylor,et al.  Anatomical statistical models and their role in feature extraction. , 2004, The British journal of radiology.

[111]  Stefano Soatto,et al.  Quick Shift and Kernel Methods for Mode Seeking , 2008, ECCV.

[112]  Pascal Fua,et al.  SLIC Superpixels Compared to State-of-the-Art Superpixel Methods , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[113]  Alison C Jones,et al.  Finite element analysis of the spine: towards a framework of verification, validation and sensitivity analysis. , 2008, Medical engineering & physics.

[114]  Li Bai,et al.  Introducing Willmore Flow Into Level Set Segmentation of Spinal Vertebrae , 2013, IEEE Transactions on Biomedical Engineering.

[115]  Zhigang Peng,et al.  Automated Vertebra Detection and Segmentation from the Whole Spine MR Images , 2005, 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference.

[116]  Shang-Hong Lai,et al.  Learning-Based Vertebra Detection and Iterative Normalized-Cut Segmentation for Spinal MRI , 2009, IEEE Transactions on Medical Imaging.

[117]  Alejandro F. Frangi,et al.  Statistical Interspace Models (SIMs): Application to Robust 3D Spine Segmentation , 2015, IEEE Transactions on Medical Imaging.

[118]  Stephen M. Smith,et al.  Segmentation of brain MR images through a hidden Markov random field model and the expectation-maximization algorithm , 2001, IEEE Transactions on Medical Imaging.

[119]  Paul Suetens,et al.  Fundamentals of Medical Imaging by Paul Suetens , 2009 .

[120]  Nikos Paragios,et al.  Uncertainty-Driven Efficiently-Sampled Sparse Graphical Models for Concurrent Tumor Segmentation and Atlas Registration , 2013, 2013 IEEE International Conference on Computer Vision.

[121]  Jennifer S Gregory,et al.  The intrinsic shape of the human lumbar spine in the supine, standing and sitting postures: characterization using an active shape model , 2009, Journal of anatomy.

[122]  F. Pernus,et al.  Determination of axial vertebral rotation in MR images: comparison of four manual and a computerized method , 2010, European Spine Journal.

[123]  Vincent Lepetit,et al.  A Fully Automated Approach to Segmentation of Irregularly Shaped Cellular Structures in EM Images , 2010, MICCAI.

[124]  Calvin R. Maurer,et al.  A Linear Time Algorithm for Computing Exact Euclidean Distance Transforms of Binary Images in Arbitrary Dimensions , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[125]  B. Wolffenbuttel,et al.  Vertebral fracture assessment in supine position: comparison by using conventional semiquantitative radiography and visual radiography. , 2009, Radiology.