Residual convolutional neural network for predicting response of transarterial chemoembolization in hepatocellular carcinoma from CT imaging

Background We attempted to train and validate a model of deep learning for the preoperative prediction of the response of patients with intermediate-stage hepatocellular carcinoma (HCC) undergoing transarterial chemoembolization (TACE). Method All computed tomography (CT) images were acquired for 562 patients from the Nan Fang Hospital (NFH), 89 patients from Zhu Hai Hospital Affiliated with Jinan University (ZHHAJU), and 138 patients from the Sun Yat-sen University Cancer Center (SYUCC). We built a predictive model from the outputs using the transfer learning techniques of a residual convolutional neural network (ResNet50). The prediction accuracy for each patch was revaluated in two independent validation cohorts. Results In the training set (NFH), the deep learning model had an accuracy of 84.3% and areas under curves (AUCs) of 0.97, 0.96, 0.95, and 0.96 for complete response (CR), partial response (PR), stable disease (SD), and progressive disease (PD), respectively. In the other two validation sets (ZHHAJU and SYUCC), the deep learning model had accuracies of 85.1% and 82.8% for CR, PR, SD, and PD. The ResNet50 model also had high AUCs for predicting the objective response of TACE therapy in patches and patients of three cohorts. Decision curve analysis (DCA) showed that the ResNet50 model had a high net benefit in the two validation cohorts. Conclusion The deep learning model presented a good performance for predicting the response of TACE therapy and could help clinicians in better screening patients with HCC who can benefit from the interventional treatment. Key Points • Therapy response of TACE can be predicted by a deep learning model based on CT images. • The probability value from a trained or validation deep learning model showed significant correlation with different therapy responses. • Further improvement is necessary before clinical utilization.

[1]  Daniel Rubin,et al.  Retinal Lesion Detection With Deep Learning Using Image Patches , 2018, Investigative ophthalmology & visual science.

[2]  Andrew H. Beck,et al.  Diagnostic Assessment of Deep Learning Algorithms for Detection of Lymph Node Metastases in Women With Breast Cancer , 2017, JAMA.

[3]  Berkman Sahiner,et al.  3D convolutional neural network for automatic detection of lung nodules in chest CT , 2017, Medical Imaging.

[4]  T. Bilhim,et al.  Chemoembolization of Hepatocellular Carcinoma with Drug-Eluting Polyethylene Glycol Embolic Agents: Single-Center Retrospective Analysis in 302 Patients. , 2018, Journal of vascular and interventional radiology : JVIR.

[5]  Yuanyuan Wang,et al.  Noninvasive IDH1 mutation estimation based on a quantitative radiomics approach for grade II glioma , 2017, European Radiology.

[6]  K. Sung,et al.  Nonresectable combined hepatocellular carcinoma and cholangiocarcinoma: analysis of the response and prognostic factors after transcatheter arterial chemoembolization. , 2010, Radiology.

[7]  J. Bruix,et al.  Systematic review of randomized trials for unresectable hepatocellular carcinoma: Chemoembolization improves survival , 2003, Hepatology.

[8]  Raymond Y Huang,et al.  Residual Convolutional Neural Network for the Determination of IDH Status in Low- and High-Grade Gliomas from MR Imaging , 2017, Clinical Cancer Research.

[9]  S. Park,et al.  Methodologic Guide for Evaluating Clinical Performance and Effect of Artificial Intelligence Technology for Medical Diagnosis and Prediction. , 2018, Radiology.

[10]  Subhashini Venugopalan,et al.  Development and Validation of a Deep Learning Algorithm for Detection of Diabetic Retinopathy in Retinal Fundus Photographs. , 2016, JAMA.

[11]  Qianjin Feng,et al.  Pattern Classification for Gastrointestinal Stromal Tumors by Integration of Radiomics and Deep Convolutional Features , 2019, IEEE Journal of Biomedical and Health Informatics.

[12]  Yi Yang,et al.  Accelerating Deep Neural Network Training with Inconsistent Stochastic Gradient Descent , 2016, Neural Networks.

[13]  Young Han Lee,et al.  Efficiency Improvement in a Busy Radiology Practice: Determination of Musculoskeletal Magnetic Resonance Imaging Protocol Using Deep-Learning Convolutional Neural Networks , 2018, Journal of Digital Imaging.

[14]  Michael Blum,et al.  High-Throughput Classification of Radiographs Using Deep Convolutional Neural Networks , 2016, Journal of Digital Imaging.

[15]  Tianxin Lin,et al.  A Radiomics Nomogram for the Preoperative Prediction of Lymph Node Metastasis in Bladder Cancer , 2017, Clinical Cancer Research.

[16]  X. Wang,et al.  The status of transarterial chemoembolization treatment in the era of precision oncology. , 2017, Hepatic oncology.

[17]  Patrick Granton,et al.  Radiomics: extracting more information from medical images using advanced feature analysis. , 2012, European journal of cancer.

[18]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  Erich P Huang,et al.  Quantitative MRI radiomics in the prediction of molecular classifications of breast cancer subtypes in the TCGA/TCIA data set , 2016, npj Breast Cancer.

[20]  O. Abe,et al.  Deep Learning with Convolutional Neural Network for Differentiation of Liver Masses at Dynamic Contrast-enhanced CT: A Preliminary Study. , 2017, Radiology.

[21]  Myeong-Jin Kim,et al.  Complete response at first chemoembolization is still the most robust predictor for favorable outcome in hepatocellular carcinoma. , 2015, Journal of hepatology.

[22]  Hongyang Wang,et al.  Multiple interactive factors in hepatocarcinogenesis. , 2014, Cancer letters.

[23]  Jing Zhao,et al.  Precision medicine for hepatocellular carcinoma: driver mutations and targeted therapy , 2017, Oncotarget.

[24]  Hoo-Chang Hoo-Chang Shin Shin,et al.  Deep Convolutional Neural Networks for Computer-Aided Detection: CNN Architectures, Dataset Characteristics and Transfer Learning , 2016, Ieee Transactions on Medical Imaging.

[25]  Eun Sun Lee,et al.  Prediction of Therapeutic Response of Hepatocellular Carcinoma to Transcatheter Arterial Chemoembolization Based on Pretherapeutic Dynamic CT and Textural Findings. , 2017, AJR. American journal of roentgenology.

[26]  Sang Gyune Kim,et al.  Predictive factors of contrast-enhanced ultrasonography for the response to transarterial chemoembolization in hepatocellular carcinoma , 2015, Clinical and molecular hepatology.

[27]  Xiaohong W. Gao,et al.  Prediction of Multidrug-Resistant TB from CT Pulmonary Images Based on Deep Learning Techniques. , 2017, Molecular pharmaceutics.

[28]  O. Abe,et al.  Deep learning for staging liver fibrosis on CT: a pilot study , 2018, European Radiology.

[29]  Steve B. Jiang,et al.  Intelligent Parameter Tuning in Optimization-Based Iterative CT Reconstruction via Deep Reinforcement Learning , 2017, IEEE Transactions on Medical Imaging.

[30]  P. Ingrand,et al.  Predictive factors for complete response of chemoembolization with drug-eluting beads (DEB-TACE) for hepatocellular carcinoma , 2016, European Radiology.

[31]  S. Strange,et al.  Haemorrhage from the upper alimentary tract , 1964, Journal of the Indian medical profession.

[32]  Sebastian Thrun,et al.  Dermatologist-level classification of skin cancer with deep neural networks , 2017, Nature.

[33]  Kui Wang,et al.  Nomogram for Preoperative Estimation of Microvascular Invasion Risk in Hepatitis B Virus-Related Hepatocellular Carcinoma Within the Milan Criteria. , 2016, JAMA surgery.

[34]  M. Kudo,et al.  Asia–Pacific clinical practice guidelines on the management of hepatocellular carcinoma: a 2017 update , 2017, Hepatology International.

[35]  S. Kumano,et al.  Prognosis following transcatheter arterial embolization for 121 patients with unresectable hepatocellular carcinoma with or without a history of treatment. , 2006, World journal of gastroenterology.

[36]  Jing Zhang,et al.  A radiomics nomogram for preoperative prediction of microvascular invasion risk in hepatitis B virus-related hepatocellular carcinoma. , 2018, Diagnostic and interventional radiology.

[37]  Jing Zhao,et al.  Precision medicine for hepatocellular carcinoma: driver mutations and targeted therapy. , 2017, Oncotarget.

[38]  W. Qin,et al.  Radiomics signature: A potential biomarker for the prediction of MGMT promoter methylation in glioblastoma , 2018, Journal of magnetic resonance imaging : JMRI.

[39]  Jie Tian,et al.  Deep learning Radiomics of shear wave elastography significantly improved diagnostic performance for assessing liver fibrosis in chronic hepatitis B: a prospective multicentre study , 2018, Gut.

[40]  M. Kudo Locoregional Therapy for Hepatocellular Carcinoma , 2015, Liver Cancer.

[41]  Y. Liu,et al.  Radiomic Features Are Associated With EGFR Mutation Status in Lung Adenocarcinomas. , 2016, Clinical lung cancer.

[42]  A. Gasbarrini,et al.  Prognostic ability of BCLC-B Subclassification in Patients with Hepatocellular Carcinoma Undergoing Transarterial Chemoembolization. , 2017, Annals of hepatology.

[43]  Ronald M. Summers,et al.  Deep Convolutional Neural Networks for Computer-Aided Detection: CNN Architectures, Dataset Characteristics and Transfer Learning , 2016, IEEE Transactions on Medical Imaging.

[44]  T. Murakami,et al.  Surgical and Locoregional Therapy of HCC: TACE , 2015, Liver Cancer.

[45]  O. Abe,et al.  Liver Fibrosis: Deep Convolutional Neural Network for Staging by Using Gadoxetic Acid-enhanced Hepatobiliary Phase MR Images. , 2017, Radiology.

[46]  J. Bruix,et al.  Management of hepatocellular carcinoma: An update , 2011, Hepatology.

[47]  K. Zhu,et al.  Medium or Large Hepatocellular Carcinoma: Sorafenib Combined with Transarterial Chemoembolization and Radiofrequency Ablation. , 2018, Radiology.

[48]  Z. Tang,et al.  Value of texture analysis based on enhanced MRI for predicting an early therapeutic response to transcatheter arterial chemoembolisation combined with high-intensity focused ultrasound treatment in hepatocellular carcinoma. , 2018, Clinical radiology.

[49]  M. Soulen,et al.  Society of Interventional Radiology position statement on chemoembolization of hepatic malignancies. , 2006, Journal of vascular and interventional radiology : JVIR.

[50]  Tim Meyer,et al.  EASL and mRECIST responses are independent prognostic factors for survival in hepatocellular cancer patients treated with transarterial embolization. , 2011, Journal of hepatology.

[51]  Daniel S. Kermany,et al.  Identifying Medical Diagnoses and Treatable Diseases by Image-Based Deep Learning , 2018, Cell.

[52]  J. Canales‐Vázquez,et al.  Radiomics of CT Features May Be Nonreproducible and Redundant: Influence of CT Acquisition Parameters. , 2018, Radiology.

[53]  Jong Chul Ye,et al.  A deep convolutional neural network using directional wavelets for low‐dose X‐ray CT reconstruction , 2016, Medical physics.

[54]  Yanqi Huang,et al.  Radiomics Signature: A Potential Biomarker for the Prediction of Disease-Free Survival in Early-Stage (I or II) Non-Small Cell Lung Cancer. , 2016, Radiology.

[55]  A. Gasbarrini,et al.  Prognostic ability of BCLC-B Subclassification in Patients with Hepatocellular Carcinoma Undergoing Transarterial Chemoembolization. , 2018, Annals of hepatology.

[56]  M. Makuuchi,et al.  Prospective cohort study of transarterial chemoembolization for unresectable hepatocellular carcinoma in 8510 patients. , 2006, Gastroenterology.