The potential for different computed tomography-based machine learning networks to automatically segment and differentiate pelvic and sacral osteosarcoma from Ewing’s sarcoma

Background This study aimed to explore optimal computed tomography (CT)-based machine learning and deep learning methods for the identification of pelvic and sacral osteosarcomas (OS) and Ewing’s sarcomas (ES). Methods A total of 185 patients with pathologically confirmed pelvic and sacral OS and ES were analyzed. We first compared the performance of 9 radiomics-based machine learning models, 1 radiomics-based convolutional neural networks (CNNs) model, and 1 3-dimensional (3D) CNN model, respectively. We then proposed a 2-step no-new-Net (nnU-Net) model for the automatic segmentation and identification of OS and ES. The diagnoses by 3 radiologists were also obtained. The area under the receiver operating characteristic curve (AUC) and accuracy (ACC) were used to evaluate the different models. Results Age, tumor size, and tumor location showed significant differences between OS and ES (P<0.01). For the radiomics-based machine learning models, logistic regression (LR; AUC =0.716, ACC =0.660) performed best in the validation set. However, the radiomics-based CNN model had an AUC of 0.812 and ACC of 0.774 in the validation set, which were higher than those of the 3D CNN model (AUC =0.709, ACC =0.717). Among all the models, the nnU-Net model performed best, with an AUC of 0.835 and an ACC of 0.830 in the validation set, which was significantly higher than the primary physician’s diagnosis (ACCs ranged from 0.757 to 0.811) (P<0.01). Conclusions The proposed nnU-Net model could be an end-to-end, non-invasive, and accurate auxiliary diagnostic tool for the differentiation of pelvic and sacral OS and ES.

[1]  Gopal S. Tandel,et al.  Role of Ensemble Deep Learning for Brain Tumor Classification in Multiple Magnetic Resonance Imaging Sequence Data , 2023, Diagnostics.

[2]  X. Qu,et al.  Current development and prospects of deep learning in spine image analysis: a literature review. , 2021, Quantitative imaging in medicine and surgery.

[3]  Lei Dong,et al.  Deep learning for automatic target volume segmentation in radiation therapy: a review. , 2021, Quantitative imaging in medicine and surgery.

[4]  Ming Ni [Update and interpretation of 2021 National Comprehensive Cancer Network (NCCN) "Clinical Practice Guidelines for Bone Tumors"]. , 2021, Zhongguo xiu fu chong jian wai ke za zhi = Zhongguo xiufu chongjian waike zazhi = Chinese journal of reparative and reconstructive surgery.

[5]  P. Yin,et al.  Radiomics Models for the Preoperative Prediction of Pelvic and Sacral Tumor Types: A Single-Center Retrospective Study of 795 Cases , 2021, Frontiers in Oncology.

[6]  D. Donati,et al.  The role of imaging in computer assisted tumor surgery of the sacrum and pelvis. , 2021, Current medical imaging.

[7]  Xiuqing Gong,et al.  Osteosarcoma: a review of current and future therapeutic approaches , 2021, BioMedical Engineering OnLine.

[8]  L. Rundo,et al.  AI applications to medical images: From machine learning to deep learning. , 2021, Physica medica : PM : an international journal devoted to the applications of physics to medicine and biology : official journal of the Italian Association of Biomedical Physics.

[9]  Qianjin Feng,et al.  Pretreatment Prediction of Relapse Risk in Patients with Osteosarcoma Using Radiomics Nomogram Based on CT: A Retrospective Multicenter Study , 2021, BioMed research international.

[10]  Hui Chen,et al.  Using machine learning techniques predicts prognosis of patients with Ewing sarcoma , 2021, Journal of orthopaedic research : official publication of the Orthopaedic Research Society.

[11]  Jens Petersen,et al.  nnU-Net: a self-configuring method for deep learning-based biomedical image segmentation , 2020, Nature Methods.

[12]  Hui Liu,et al.  Deep learning-based classification of primary bone tumors on radiographs: A preliminary study , 2020, EBioMedicine.

[13]  N. Mao,et al.  Machine and Deep Learning Based Radiomics Models for Preoperative Prediction of Benign and Malignant Sacral Tumors , 2020, Frontiers in Oncology.

[14]  W. Yao,et al.  A systematic review of radiomics in osteosarcoma: utilizing radiomics quality score as a tool promoting clinical translation , 2020, European Radiology.

[15]  Zaiyi Liu,et al.  Development and external validation of an MRI-based radiomics nomogram for pretreatment prediction for early relapse in osteosarcoma: A retrospective multicenter study. , 2020, European journal of radiology.

[16]  N. Mao,et al.  Differentiation of Pelvic Osteosarcoma and Ewing Sarcoma Using Radiomic Analysis Based on T2-Weighted Images and Contrast-Enhanced T1-Weighted Images , 2020, BioMed research international.

[17]  Xin Chen,et al.  Feasibility of multi-parametric magnetic resonance imaging combined with machine learning in the assessment of necrosis of osteosarcoma after neoadjuvant chemotherapy: a preliminary study , 2020, BMC Cancer.

[18]  Keiichi I. Nakayama,et al.  Artificial intelligence in oncology , 2020, Cancer science.

[19]  Gihad N. Sohsah,et al.  Scalable Classification of Organisms into a Taxonomy Using Hierarchical Supervised Learners , 2020, bioRxiv.

[20]  C. Luo,et al.  A Delta-radiomics model for preoperative evaluation of Neoadjuvant chemotherapy response in high-grade osteosarcoma , 2020, Cancer Imaging.

[21]  Sun-Ho Lee,et al.  Novel prognostication of patients with spinal and pelvic chondrosarcoma using deep survival neural networks , 2020, BMC Medical Informatics and Decision Making.

[22]  Ross B. Girshick,et al.  Focal Loss for Dense Object Detection , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Kai Ma,et al.  Med3D: Transfer Learning for 3D Medical Image Analysis , 2019, ArXiv.

[24]  Dorit Merhof,et al.  Radiomic versus Convolutional Neural Networks Analysis for Classification of Contrast-enhancing Lesions at Multiparametric Breast MRI. , 2019, Radiology.

[25]  Nan Hong,et al.  A Triple‐Classification Radiomics Model for the Differentiation of Primary Chordoma, Giant Cell Tumor, and Metastatic Tumor of Sacrum Based on T2‐Weighted and Contrast‐Enhanced T1‐Weighted MRI , 2018, Journal of magnetic resonance imaging : JMRI.

[26]  O. Beuf,et al.  [Prediction of chemotherapy response in primary osteosarcoma using the machine learning technique on radiomic data]. , 2019, Bulletin du cancer.

[27]  M. Sawan,et al.  Bispectrum Features and Multilayer Perceptron Classifier to Enhance Seizure Prediction , 2018, Scientific Reports.

[28]  Nan Hong,et al.  Comparison of radiomics machine-learning classifiers and feature selection for differentiation of sacral chordoma and sacral giant cell tumour based on 3D computed tomography features , 2018, European Radiology.

[29]  Wei Guo,et al.  Radiological characteristics and predisposing factors of venous tumor thrombus in pelvic osteosarcoma: A mono‐institutional retrospective study of 115 cases , 2018, Cancer medicine.

[30]  S. Bini Artificial Intelligence, Machine Learning, Deep Learning, and Cognitive Computing: What Do These Terms Mean and How Will They Impact Health Care? , 2018, The Journal of arthroplasty.

[31]  R. Randall,et al.  Provider views on the management of Ewing sarcoma of the spine and pelvis , 2018, Journal of surgical oncology.

[32]  S. Patnaik,et al.  Imaging features of Ewing's sarcoma: Special reference to uncommon features and rare sites of presentation , 2018, Journal of cancer research and therapeutics.

[33]  Anirban Sarkar,et al.  Grad-CAM++: Generalized Gradient-Based Visual Explanations for Deep Convolutional Networks , 2017, 2018 IEEE Winter Conference on Applications of Computer Vision (WACV).

[34]  HyunWook Park,et al.  A parallel MR imaging method using multilayer perceptron , 2017, Medical physics.

[35]  K. Choi,et al.  Osteosarcoma of pelvic bones: imaging features. , 2017, Clinical imaging.

[36]  N. Adachi,et al.  Percent slope analysis of dynamic magnetic resonance imaging for assessment of chemotherapy response of osteosarcoma or Ewing sarcoma: systematic review and meta-analysis , 2016, Skeletal Radiology.

[37]  P. Rajiah,et al.  Imaging of sarcomas of pelvic bones. , 2011, Seminars in ultrasound, CT, and MR.

[38]  Marco Nolden,et al.  The Medical Imaging Interaction Toolkit , 2005, Medical Image Anal..

[39]  W. Enneking,et al.  Resection and reconstruction for primary neoplasms involving the innominate bone. , 1978, The Journal of bone and joint surgery. American volume.