Cascaded statistical shape model based segmentation of the full lower limb in CT

Abstract Image segmentation has become an important tool in orthopedic and biomechanical research. However, it greatly remains a time-consuming and laborious task. In this manuscript, we propose a fully automatic model-based segmentation pipeline for the full lower limb in computed tomography (CT) images. The method relies on prior shape model fitting, followed by a gradient-defined free from deformation. The technique allows for the generation of anatomically corresponding surface meshes, which can subsequently be applied in anatomical and mechanical simulation studies. Starting from an initial, small (n ≤ 10) sample of manual segmentations, the model is continuously updated and refined with newly segmented training samples. Validation of the segmentation pipeline was performed by comparing the automatic segmentations against corresponding manual segmentations. Convergence of the segmentation pipeline was obtained in 250 cases and failed in three samples. The average distance error ranged from 0.53 to 0.76 mm and maximal error ranged from 2.0 to 7.8 mm for the 7 different osteological structures that were investigated. The accuracy of the shape model-based segmentation gradually increased as the number of training shapes in the updated population also increased. When optimized with the free form deformation, however, average segmentation accuracy rapidly plateaued from already as little as 20 training samples on. The maximum segmentation error plateaued from 100 training samples on.

[1]  Hao Li,et al.  Global Correspondence Optimization for Non‐Rigid Registration of Depth Scans , 2008, Comput. Graph. Forum.

[2]  Beat Schmutz,et al.  Effects of CT image segmentation methods on the accuracy of long bone 3D reconstructions. , 2011, Medical engineering & physics.

[3]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Hans-Peter Meinzer,et al.  Statistical shape models for 3D medical image segmentation: A review , 2009, Medical Image Anal..

[5]  Nicholas Ayache,et al.  Geometric Variability of the Scoliotic Spine Using Statistics on Articulated Shape Models , 2008, IEEE Transactions on Medical Imaging.

[6]  Hans-Christian Hege,et al.  Automatic Segmentation of the Pelvic Bones from CT Data Based on a Statistical Shape Model , 2008, VCBM.

[7]  Hans-Christian Hege,et al.  A 3D statistical shape model of the pelvic bone for segmentation , 2004, SPIE Medical Imaging.

[8]  Yoshikazu Nakajima,et al.  Fully automatic segmentation of the Femur from 3D-CT images using primitive shape recognition and statistical shape models , 2013, International Journal of Computer Assisted Radiology and Surgery.

[9]  Shaohua Kevin Zhou,et al.  Segmentation of Multiple Knee Bones from CT for Orthopedic Knee Surgery Planning , 2014, MICCAI.

[10]  Xiaodong Wu,et al.  Optimal Surface Segmentation in Volumetric Images-A Graph-Theoretic Approach , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Anand Rangarajan,et al.  A new point matching algorithm for non-rigid registration , 2003, Comput. Vis. Image Underst..

[12]  Yoshinobu Sato,et al.  Automated CT Segmentation of Diseased Hip Using Hierarchical and Conditional Statistical Shape Models , 2013, MICCAI.

[13]  Brian D. Adams,et al.  Automated bony region identification using artificial neural networks: reliability and validation measurements , 2008, Skeletal Radiology.

[14]  Chengwen Chu,et al.  FACTS: Fully Automatic CT Segmentation of a Hip Joint , 2014, Annals of Biomedical Engineering.

[15]  Joseph Antony,et al.  Quantifying radiographic knee osteoarthritis severity using deep convolutional neural networks , 2016, 2016 23rd International Conference on Pattern Recognition (ICPR).

[16]  Hans-Christian Hege,et al.  An articulated statistical shape model for accurate hip joint segmentation , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[17]  Richard Kijowski,et al.  Deep convolutional neural network and 3D deformable approach for tissue segmentation in musculoskeletal magnetic resonance imaging , 2018, Magnetic resonance in medicine.

[18]  C. Kwoh,et al.  Knee cartilage: efficient and reproducible segmentation on high-spatial-resolution MR images with the semiautomated graph-cut algorithm method. , 2009, Radiology.

[19]  Ross T. Whitaker,et al.  DeepSSM: A Deep Learning Framework for Statistical Shape Modeling from Raw Images , 2018, ShapeMI@MICCAI.

[20]  Xiaodong Wu,et al.  LOGISMOS—Layered Optimal Graph Image Segmentation of Multiple Objects and Surfaces: Cartilage Segmentation in the Knee Joint , 2010, IEEE Transactions on Medical Imaging.

[21]  Paul J. Rullkoetter,et al.  Development of subject-specific and statistical shape models of the knee using an efficient segmentation and mesh-morphing approach , 2010, Comput. Methods Programs Biomed..

[22]  Timothy F. Cootes,et al.  Use of active shape models for locating structures in medical images , 1994, Image Vis. Comput..

[23]  Gábor Székely,et al.  Fully automatic and fast segmentation of the femur bone from 3D-CT images with no shape prior , 2011, 2011 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[24]  H. Bijl,et al.  Mesh deformation based on radial basis function interpolation , 2007 .

[25]  Matthias Bindernagel Articulated Statistical Shape Models , 2013 .

[26]  Yadong Wang,et al.  Automatic segmentation technique for acetabulum and femoral head in CT images , 2013, Pattern Recognit..

[27]  Jos Vander Sloten,et al.  Segmentation accuracy of long bones. , 2014, Medical engineering & physics.

[28]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[29]  Benedict Verhegghe,et al.  Fully automatic segmentation of femurs with medullary canal definition in high and in low resolution CT scans. , 2016, Medical engineering & physics.

[30]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[31]  Hervé Delingette,et al.  Comparison of statistical models performance in case of segmentation using a small amount of training datasets , 2011, The Visual Computer.

[32]  Richard K. Beatson,et al.  Reconstruction and representation of 3D objects with radial basis functions , 2001, SIGGRAPH.

[33]  Yoshinobu Sato,et al.  Automated Segmentation of the Femur and Pelvis from 3D CT Data of Diseased Hip Using Hierarchical Statistical Shape Model of Joint Structure , 2009, MICCAI.

[34]  Lei Xing,et al.  Automatic deformable surface registration for medical applications by radial basis function-based robust point-matching , 2016, Comput. Biol. Medicine.

[35]  Jeffrey A Weiss,et al.  Subject-specific analysis of joint contact mechanics: application to the study of osteoarthritis and surgical planning. , 2013, Journal of biomechanical engineering.

[36]  Sébastien Ourselin,et al.  MR image segmentation of the knee bone using phase information , 2007, Medical Image Anal..

[37]  Hamid Bahai,et al.  Surface alignment based on the moment of inertia and improved least-squares methods , 2000 .

[38]  Timothy F. Cootes,et al.  Active Shape Models-Their Training and Application , 1995, Comput. Vis. Image Underst..

[39]  Gareth Funka-Lea,et al.  Graph Cuts and Efficient N-D Image Segmentation , 2006, International Journal of Computer Vision.

[40]  K. S. Arun,et al.  Least-Squares Fitting of Two 3-D Point Sets , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[41]  Hans-Christian Hege,et al.  Coupling Deformable Models for Multi-object Segmentation , 2008, ISBMS.