Unifying the seeds auto-generation (SAGE) with knee cartilage segmentation framework: data from the osteoarthritis initiative

AbstractPurposeManual segmentation is sensitive to operator bias, while semiautomatic random walks segmentation offers an intuitive approach to understand the user knowledge at the expense of large amount of user input. In this paper, we propose a novel random walks seed auto-generation (SAGE) hybrid model that is robust to interobserver error and intensive user intervention.MethodsKnee image is first oversegmented to produce homogeneous superpixels. Then, a ranking model is developed to rank the superpixels according to their affinities to standard priors, wherein background superpixels would have lower ranking values. Finally, seed labels are generated on the background superpixel using Fuzzy C-Means method. ResultsSAGE has achieved better interobserver DSCs of 0.94 ± 0.029 and 0.93 ± 0.035 in healthy and OA knee segmentation, respectively. Good segmentation performance has been reported in femoral (Healthy: 0.94 ± 0.036 and OA: 0.93 ± 0.034), tibial (Healthy: 0.91 ± 0.079 and OA: 0.88 ± 0.095) and patellar (Healthy: 0.88 ± 0.10 and OA: 0.84 ± 0.094) cartilage segmentation. Besides, SAGE has demonstrated greater mean readers’ time of 80 ± 19 s and 80 ± 27 s in healthy and OA knee segmentation, respectively. ConclusionsSAGE enhances the efficiency of segmentation process and attains satisfactory segmentation performance compared to manual and random walks segmentation. Future works should validate SAGE on progressive image data cohort using OA biomarkers.

[1]  Khairil Amir Sayuti,et al.  Interactive medical image segmentation with seed precomputation system: Data from the Osteoarthritis Initiative , 2014, 2014 IEEE Conference on Biomedical Engineering and Sciences (IECBES).

[2]  William A. Barrett,et al.  Interactive Segmentation with Intelligent Scissors , 1998, Graph. Model. Image Process..

[3]  Pascal Fua,et al.  SLIC Superpixels Compared to State-of-the-Art Superpixel Methods , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Ahmad Helmy Abdul Karim,et al.  Investigation of random walks knee cartilage segmentation model using inter-observer reproducibility: Data from the osteoarthritis initiative. , 2017, Bio-medical materials and engineering.

[5]  Ahmad Helmy Abdul Karim,et al.  Analysis on Semi-Automated Knee Cartilage Segmentation Model using Inter-Observer Reproducibility: Data from the Osteoarthritis Initiative , 2017, ICBBB '17.

[6]  Yuanqing Li,et al.  An Iterative Boundary Random Walks Algorithm for Interactive Image Segmentation , 2018, ArXiv.

[7]  Simo Saarakkala,et al.  Application of a semi-automatic cartilage segmentation method for biomechanical modeling of the knee joint , 2017, Computer methods in biomechanics and biomedical engineering.

[8]  Leo Grady,et al.  A Seeded Image Segmentation Framework Unifying Graph Cuts And Random Walker Which Yields A New Algorithm , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[9]  Leo Grady,et al.  Random Walks for Image Segmentation , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Boris Escalante-Ramírez,et al.  Knee cartilage segmentation using active shape models and local binary patterns , 2014, Photonics Europe.

[11]  Boris Escalante-Ram Knee cartilage segmentation using active shape models and local binary patterns , 2014 .

[12]  Zhaoshui He,et al.  An Improved Random Walk Algorithm for Interactive Image Segmentation , 2017, ICONIP.

[13]  L. F. Schaefer,et al.  Quantitative measurement of medial femoral knee cartilage volume - analysis of the OA Biomarkers Consortium FNIH Study cohort. , 2017, Osteoarthritis and cartilage.

[14]  Marie-Pierre Jolly,et al.  Interactive graph cuts for optimal boundary & region segmentation of objects in N-D images , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[15]  J. MacQueen Some methods for classification and analysis of multivariate observations , 1967 .

[16]  Stuart Crozier,et al.  Automatic Segmentation and Quantitative Analysis of the Articular Cartilages From Magnetic Resonance Images of the Knee , 2010, IEEE Transactions on Medical Imaging.

[17]  Ole Fogh Olsen,et al.  Segmenting Articular Cartilage Automatically Using a Voxel Classification Approach , 2007, IEEE Transactions on Medical Imaging.

[18]  Timothy F. Cootes,et al.  Active Shape Models-Their Training and Application , 1995, Comput. Vis. Image Underst..

[19]  Ahmad Helmy Abdul Karim,et al.  Flexible non cartilage seeds for osteoarthritic magnetic resoance image of knee: Data from the osteoarthritis initiative , 2016, 2016 IEEE EMBS Conference on Biomedical Engineering and Sciences (IECBES).

[20]  Kyongtae Ty Bae,et al.  Simultaneous 3D segmentation of three bone compartments on high resolution knee MR images from osteoarthritis initiative (OAI) using graph cuts , 2009, Medical Imaging.

[21]  Songül Albayrak,et al.  Automatic segmentation of cartilage in high-field magnetic resonance images of the knee joint with an improved voxel-classification-driven region-growing algorithm using vicinity-correlated subsampling , 2016, Comput. Biol. Medicine.

[22]  Wei Chen,et al.  Automatic Knee Cartilage Segmentation Using Multi-Feature Support Vector Machine and Elastic Region Growing for Magnetic Resonance Images , 2016 .

[23]  J. Bezdek,et al.  FCM: The fuzzy c-means clustering algorithm , 1984 .

[24]  Hansang Lee,et al.  Multi-atlas segmentation of the cartilage in knee MR images with sequential volume- and bone-mask-based registrations , 2016, SPIE Medical Imaging.

[25]  Bernhard Schölkopf,et al.  Ranking on Data Manifolds , 2003, NIPS.

[26]  Mads Nielsen,et al.  Automatic segmentation of high- and low-field knee MRIs using knee image quantification with data from the osteoarthritis initiative , 2015, Journal of medical imaging.

[27]  Linghong Zhou,et al.  SPARSE: Seed Point Auto‐Generation for Random Walks Segmentation Enhancement in medical inhomogeneous targets delineation of morphological MR and CT images , 2015, Journal of applied clinical medical physics.

[28]  Yen-Wei Chen,et al.  Simultaneous Segmentation of Multiple Organs Using Random Walks , 2016, J. Inf. Process..

[29]  Khairil Amir Sayuti,et al.  Interactive knee cartilage extraction using efficient segmentation software: data from the osteoarthritis initiative. , 2014, Bio-medical materials and engineering.

[30]  Marie-Pierre Jolly,et al.  Interactive Graph Cuts for Optimal Boundary and Region Segmentation of Objects in N-D Images , 2001, ICCV.

[31]  C. Kwoh,et al.  Prediction of medial tibiofemoral compartment joint space loss progression using volumetric cartilage measurements: Data from the FNIH OA biomarkers consortium , 2017, European Radiology.