Towards robust and effective shape modeling: Sparse shape composition

Organ shape plays an important role in various clinical practices, e.g., diagnosis, surgical planning and treatment evaluation. It is usually derived from low level appearance cues in medical images. However, due to diseases and imaging artifacts, low level appearance cues might be weak or misleading. In this situation, shape priors become critical to infer and refine the shape derived by image appearances. Effective modeling of shape priors is challenging because: (1) shape variation is complex and cannot always be modeled by a parametric probability distribution; (2) a shape instance derived from image appearance cues (input shape) may have gross errors; and (3) local details of the input shape are difficult to preserve if they are not statistically significant in the training data. In this paper we propose a novel Sparse Shape Composition model (SSC) to deal with these three challenges in a unified framework. In our method, a sparse set of shapes in the shape repository is selected and composed together to infer/refine an input shape. The a priori information is thus implicitly incorporated on-the-fly. Our model leverages two sparsity observations of the input shape instance: (1) the input shape can be approximately represented by a sparse linear combination of shapes in the shape repository; (2) parts of the input shape may contain gross errors but such errors are sparse. Our model is formulated as a sparse learning problem. Using L1 norm relaxation, it can be solved by an efficient expectation-maximization (EM) type of framework. Our method is extensively validated on two medical applications, 2D lung localization in X-ray images and 3D liver segmentation in low-dose CT scans. Compared to state-of-the-art methods, our model exhibits better performance in both studies.

[1]  Petros Dellaportas,et al.  On Bayesian model and variable selection using MCMC , 2002, Stat. Comput..

[2]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[3]  Timothy F. Cootes,et al.  A mixture model for representing shape variation , 1999, Image Vis. Comput..

[4]  Simon Lucey,et al.  Face alignment through subspace constrained mean-shifts , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[5]  Rasmus Larsen,et al.  Sparse Decomposition and Modeling of Anatomical Shape Variation , 2007, IEEE Transactions on Medical Imaging.

[6]  Sheng Xu,et al.  Discrete Deformable Model Guided by Partial Active Shape Model for TRUS Image Segmentation , 2010, IEEE Transactions on Biomedical Engineering.

[7]  Anand Rangarajan,et al.  A new point matching algorithm for non-rigid registration , 2003, Comput. Vis. Image Underst..

[8]  Sébastien Ourselin,et al.  A Registration-Based Propagation Framework for Automatic Whole Heart Segmentation of Cardiac MRI , 2010, IEEE Transactions on Medical Imaging.

[9]  James S. Duncan,et al.  Segmentation of left ventricle from 3D cardiac MR image sequences using a subject-specific dynamical model , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Timothy F. Cootes,et al.  Active shape models , 1998 .

[11]  Jim Graham,et al.  Robust Active Shape Model Search , 2002, ECCV.

[12]  Yang Yu,et al.  Automatic image annotation using group sparsity , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[13]  E. George,et al.  Journal of the American Statistical Association is currently published by American Statistical Association. , 2007 .

[14]  D. Donoho For most large underdetermined systems of equations, the minimal 𝓁1‐norm near‐solution approximates the sparsest near‐solution , 2006 .

[15]  John Wright,et al.  RASL: Robust alignment by sparse and low-rank decomposition for linearly correlated images , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[16]  Dinggang Shen,et al.  Deformable segmentation of 3-D ultrasound prostate images using statistical texture matching method , 2006, IEEE Transactions on Medical Imaging.

[17]  J. CandesE.,et al.  Near-Optimal Signal Recovery From Random Projections , 2006 .

[18]  Junaed Sattar Snakes , Shapes and Gradient Vector Flow , 2022 .

[19]  Chunming Li,et al.  Level set evolution without re-initialization: a new variational formulation , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[20]  Yiqiang Zhan,et al.  Active Scheduling of Organ Detection and Segmentation in Whole-Body Medical Images , 2008, MICCAI.

[21]  Michael Elad,et al.  Submitted to Ieee Transactions on Image Processing Image Decomposition via the Combination of Sparse Representations and a Variational Approach , 2022 .

[22]  Dinggang Shen,et al.  Hierarchical active shape models, using the wavelet transform , 2003, IEEE Transactions on Medical Imaging.

[23]  Junzhou Huang,et al.  Sparse shape composition: A new framework for shape prior modeling , 2011, CVPR 2011.

[24]  Pingkun Yan,et al.  Incremental Shape Statistics Learning for Prostate Tracking in TRUS , 2010, MICCAI.

[25]  Emmanuel J. Candès,et al.  Near-Optimal Signal Recovery From Random Projections: Universal Encoding Strategies? , 2004, IEEE Transactions on Information Theory.

[26]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Milan Sonka,et al.  Segmentation and interpretation of MR brain images. An improved active shape model , 1998, IEEE Transactions on Medical Imaging.

[28]  C. Goodall Procrustes methods in the statistical analysis of shape , 1991 .

[29]  Julien Abi-Nahed,et al.  Robust Active Shape Models: A Robust, Generic and Simple Automatic Segmentation Tool , 2006, MICCAI.

[30]  Dinggang Shen,et al.  An adaptive-focus statistical shape model for segmentation and shape modeling of 3-D brain structures , 2001, IEEE Transactions on Medical Imaging.

[31]  Guang-Zhong Yang,et al.  Outlier Detection and Handling for Robust 3-D Active Shape Models Search , 2007, IEEE Transactions on Medical Imaging.

[32]  Junzhou Huang,et al.  3D Anatomical Shape Atlas Construction Using Mesh Quality Preserved Deformable Models , 2012, MeshMed.

[33]  Thomas B. Moeslund,et al.  Long-Term Occupancy Analysis Using Graph-Based Optimisation in Thermal Imagery , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[34]  James S. Duncan,et al.  Bidirectional Segmentation of Three-Dimensional Cardiac MR Images Using a Subject-Specific Dynamical Model , 2008, MICCAI.

[35]  Martin Engelhardt,et al.  Statistical validation metric for accuracy assessment in medical image segmentation , 2007, International Journal of Computer Assisted Radiology and Surgery.

[36]  Hans-Peter Meinzer,et al.  Statistical shape models for 3D medical image segmentation: A review , 2009, Medical Image Anal..

[37]  Guillermo Sapiro,et al.  Non-local sparse models for image restoration , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[38]  Dimitris N. Metaxas,et al.  Deformable segmentation via sparse representation and dictionary learning , 2012, Medical Image Anal..

[39]  Marc Teboulle,et al.  A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems , 2009, SIAM J. Imaging Sci..

[40]  Takeo Kanade,et al.  A Generative Shape Regularization Model for Robust Face Alignment , 2008, ECCV.

[41]  Dorin Comaniciu,et al.  Four-Chamber Heart Modeling and Automatic Segmentation for 3-D Cardiac CT Volumes Using Marginal Space Learning and Steerable Features , 2008, IEEE Transactions on Medical Imaging.

[42]  MetaxasDimitris,et al.  3D anatomical shape atlas construction using mesh quality preserved deformable models , 2013 .

[43]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[44]  Dinggang Shen,et al.  An Adaptive-Focus Deformable Model Using Statistical and Geometric Information , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[45]  James S. Duncan,et al.  Segmentation of the Left Ventricle From Cardiac MR Images Using a Subject-Specific Dynamical Model , 2010, IEEE Transactions on Medical Imaging.

[46]  F. Bookstein Thin-plate splines and decomposition of deformation , 1989 .

[47]  Nikos Paragios,et al.  Shape Priors for Level Set Representations , 2002, ECCV.

[48]  Dinggang Shen,et al.  Segmenting Lung Fields in Serial Chest Radiographs Using Both Population-Based and Patient-Specific Shape Statistics , 2008, IEEE Transactions on Medical Imaging.

[49]  Dorin Comaniciu,et al.  Database-guided segmentation of anatomical structures with complex appearance , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[50]  Dimitris N. Metaxas,et al.  Metamorphs: Deformable Shape and Appearance Models , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[51]  Renaud Keriven,et al.  Shape Priors using Manifold Learning Techniques , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[52]  James S. Duncan,et al.  Medical Image Analysis , 1999, IEEE Pulse.

[53]  Timothy F. Cootes,et al.  Active Shape Models-Their Training and Application , 1995, Comput. Vis. Image Underst..

[54]  Junzhou Huang,et al.  Learning with dynamic group sparsity , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[55]  Yiqiang Zhan,et al.  Cross Modality Deformable Segmentation Using Hierarchical Clustering and Learning , 2009, MICCAI.

[56]  Dorin Comaniciu,et al.  Hierarchical, learning-based automatic liver segmentation , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[57]  Xuelong Li,et al.  Estimating patient-specific shape prior for medical image segmentation , 2011, 2011 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[58]  James S. Duncan,et al.  A Dynamical Shape Prior for LV Segmentation from RT3D Echocardiography , 2009, MICCAI.