Fully automatic segmentation of AP pelvis X-rays via random forest regression with efficient feature selection and hierarchical sparse shape composition

In clinical practice, traditional X-ray radiography is widely used, and knowledge of landmarks and contours in anteroposterior (AP) pelvis X-rays is invaluable for computer aided diagnosis, hip surgery planning and image-guided interventions. This paper presents a fully automatic approach for landmark detection and shape segmentation of both pelvis and femur in conventional AP X-ray images. Our approach is based on the framework of landmark detection via Random Forest (RF) regression and shape regularization via hierarchical sparse shape composition. We propose a visual feature FL-HoG (Flexible-Level Histogram of Oriented Gradients) and a feature selection algorithm based on trace radio optimization to improve the robustness and the efficacy of RF-based landmark detection. The landmark detection result is then used in a hierarchical sparse shape composition framework for shape regularization. Finally, the extracted shape contour is fine-tuned by a post-processing step based on low level image features. The experimental results demonstrate that our feature selection algorithm reduces the feature dimension in a factor of 40 and improves both training and test efficiency. Further experiments conducted on 436 clinical AP pelvis X-rays show that our approach achieves an average point-to-curve error around 1.2mm for femur and 1.9mm for pelvis.

[1]  Timothy F. Cootes,et al.  A mixture model for representing shape variation , 1999, Image Vis. Comput..

[2]  Guoyan Zheng.  Expectation Conditional Maximization-Based Deformable Shape Registration , 2013, CAIP.

[3]  Dorin Comaniciu,et al.  Shape Regression Machine , 2007, IPMI.

[4]  Weiliang Xu,et al.  Segmentation of radiographic images under topological constraints: application to the femur , 2010, International Journal of Computer Assisted Radiology and Surgery.

[5]  Timothy F. Cootes,et al.  Accurate Fully Automatic Femur Segmentation in Pelvic Radiographs Using Regression Voting , 2012, MICCAI.

[6]  Olivier Ecabert,et al.  Automatic Model-Based Segmentation of the Heart in CT Images , 2008, IEEE Transactions on Medical Imaging.

[7]  Renaud Keriven,et al.  Shape Priors using Manifold Learning Techniques , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[8]  Horst Bischof,et al.  Generalized sparse MRF appearance models , 2010, Image Vis. Comput..

[9]  Dorin Comaniciu,et al.  Image based regression using boosting method , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[10]  Dorin Comaniciu,et al.  Hierarchical, learning-based automatic liver segmentation , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[11]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[12]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[13]  Dorin Comaniciu,et al.  Four-Chamber Heart Modeling and Automatic Segmentation for 3-D Cardiac CT Volumes Using Marginal Space Learning and Steerable Features , 2008, IEEE Transactions on Medical Imaging.

[14]  Sebastian P. M. Dries,et al.  Spine Detection and Labeling Using a Parts-Based Graphical Model , 2007, IPMI.

[15]  Guoyan Zheng,et al.  Statistical shape model-based reconstruction of a scaled, patient-specific surface model of the pelvis from a single standard AP x-ray radiograph. , 2010, Medical physics.

[16]  D. Donoho.  For most large underdetermined systems of equations, the minimal 𝓁1‐norm near‐solution approximates the sparsest near‐solution , 2006 .

[17]  Volker Kuhn,et al.  Proximal femur segmentation in conventional pelvic x ray. , 2008, Medical physics.

[18]  Horst Bischof,et al.  Global localization of 3D anatomical structures by pre-filtered Hough Forests and discrete optimization , 2013, Medical Image Anal..

[19]  Paul Suetens,et al.  Active Shape Model-Based Segmentation of Digital X-ray Images , 1999, MICCAI.

[20]  Antonio Criminisi,et al.  Regression Forests for Efficient Anatomy Detection and Localization in CT Studies , 2010, MCV.

[21]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[22]  Junzhou Huang,et al.  Sparse shape composition: A new framework for shape prior modeling , 2011, CVPR 2011.

[23]  Yi Yang,et al.  3D human pose recovery from image by efficient visual feature selection , 2011, Comput. Vis. Image Underst..

[24]  Rasmus Larsen,et al.  Sparse Decomposition and Modeling of Anatomical Shape Variation , 2007, IEEE Transactions on Medical Imaging.

[25]  Marleen de Bruijne,et al.  2D-3D shape reconstruction of the distal femur from stereo X-ray imaging using statistical shape models , 2011, Medical Image Anal..

[26]  Antonio Criminisi,et al.  Fast Multiple Organ Detection and Localization in Whole-Body MR Dixon Sequences , 2011, MICCAI.

[27]  Stephen P. Boyd,et al.  An Interior-Point Method for Large-Scale {\it l}$_{\mbox{1}}$-Regularized Logistic Regression , 2007 .

[28]  Dorin Comaniciu,et al.  Marginal Space Learning for Efficient Detection of 2D/3D Anatomical Structures in Medical Images , 2009, IPMI.

[29]  Mei-Chen Yeh,et al.  Fast Human Detection Using a Cascade of Histograms of Oriented Gradients , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[30]  R Burgkart,et al.  Intraoperative, fluoroscopy‐based planning for complex osteotomies of the proximal femur , 2005, The international journal of medical robotics + computer assisted surgery : MRCAS.

[31]  R. Fisher.  THE USE OF MULTIPLE MEASUREMENTS IN TAXONOMIC PROBLEMS , 1936 .

[32]  Ying Chen,et al.  Automatic Extraction of Femur Contours from Hip X-Ray Images , 2005, CVBIA.

[33]  Juergen Gall,et al.  Class-specific Hough forests for object detection , 2009, CVPR.

[34]  C. Taylor,et al.  Active shape models - 'Smart Snakes'. , 1992 .

[35]  Emmanuel J. Candès,et al.  Near-Optimal Signal Recovery From Random Projections: Universal Encoding Strategies? , 2004, IEEE Transactions on Information Theory.

[36]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[37]  Song Wang,et al.  Shape deformation: SVM regression and application to medical image segmentation , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[38]  Guoyan Zheng,et al.  Automatic Extraction of Proximal Femur Contours from Calibrated X-Ray Images Using 3D Statistical Models , 2008, MIAR.

[39]  Thomas B. Moeslund,et al.  A Survey of Computer Vision-Based Human Motion Capture , 2001, Comput. Vis. Image Underst..

[40]  David Cristinacce,et al.  Automatic feature localisation with constrained local models , 2008, Pattern Recognit..

[41]  Christoph Schnörr,et al.  A Study of Parts-Based Object Class Detection Using Complete Graphs , 2010, International Journal of Computer Vision.

[42]  Xuelong Li,et al.  Estimating patient-specific shape prior for medical image segmentation , 2011, 2011 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[43]  Stephen P. Boyd,et al.  An Interior-Point Method for Large-Scale l1-Regularized Logistic Regression , 2007, J. Mach. Learn. Res..

[44]  Nathan Lay,et al.  Rapid Multi-organ Segmentation Using Context Integration and Discriminative Models , 2013, IPMI.