State of the Art in Artificial Intelligence and Radiomics in Hepatocellular Carcinoma

The most common liver malignancy is hepatocellular carcinoma (HCC), which is also associated with high mortality. Often HCC develops in a chronic liver disease setting, and early diagnosis as well as accurate screening of high-risk patients is crucial for appropriate and effective management of these patients. While imaging characteristics of HCC are well-defined in the diagnostic phase, challenging cases still occur, and current prognostic and predictive models are limited in their accuracy. Radiomics and machine learning (ML) offer new tools to address these issues and may lead to scientific breakthroughs with the potential to impact clinical practice and improve patient outcomes. In this review, we will present an overview of these technologies in the setting of HCC imaging across different modalities and a range of applications. These include lesion segmentation, diagnosis, prognostic modeling and prediction of treatment response. Finally, limitations preventing clinical application of radiomics and ML at the present time are discussed, together with necessary future developments to bring the field forward and outside of a purely academic endeavor.

[1]  R. Cuocolo,et al.  MRI based radiomics in nasopharyngeal cancer: Systematic review and perspectives using radiomic quality score (RQS) assessment. , 2021, European journal of radiology.

[2]  R. Cuocolo,et al.  Quality control and whole-gland, zonal and lesion annotations for the PROSTATEx challenge public dataset. , 2021, European journal of radiology.

[3]  A. Yezzi,et al.  Deep Learning Whole‐Gland and Zonal Prostate Segmentation on a Public MRI Dataset , 2021, Journal of magnetic resonance imaging : JMRI.

[4]  Tyler J. Fraum,et al.  Targetoid appearance on T2-weighted imaging and signs of tumor vascular involvement: diagnostic value for differentiating HCC from other primary liver carcinomas , 2021, European Radiology.

[5]  Momen Abayazid,et al.  Toward reliable automatic liver and tumor segmentation using convolutional neural network based on 2.5D models , 2020, International Journal of Computer Assisted Radiology and Surgery.

[6]  Alessandro Di Stefano,et al.  Lung Segmentation on High-Resolution Computerized Tomography Images Using Deep Learning: A Preliminary Step for Radiomics Studies , 2020, J. Imaging.

[7]  Xin Li,et al.  Longitudinal radiomics algorithm of posttreatment computed tomography images for early detecting recurrence of hepatocellular carcinoma after resection or ablation , 2020, Translational oncology.

[8]  M. Soresi,et al.  Benign and malignant mimickers of infiltrative hepatocellular carcinoma: tips and tricks for differential diagnosis on CT and MRI. , 2020, Clinical imaging.

[9]  Miguel Jiménez Pérez,et al.  Application of artificial intelligence in the diagnosis and treatment of hepatocellular carcinoma: A review , 2020, World journal of gastroenterology.

[10]  Rui Zhang,et al.  Deep Learning Predicts Overall Survival of Patients With Unresectable Hepatocellular Carcinoma Treated by Transarterial Chemoembolization Plus Sorafenib , 2020, Frontiers in Oncology.

[11]  R. Masuzaki,et al.  Application of artificial intelligence in hepatology: Minireview , 2020 .

[12]  L. Cavallo,et al.  Prediction of pituitary adenoma surgical consistency: radiomic data mining and machine learning on T2-weighted MRI , 2020, Neuroradiology.

[13]  F. Wu,et al.  Preoperative prediction for pathological grade of hepatocellular carcinoma via machine learning–based radiomics , 2020, European Radiology.

[14]  Lorenzo Ugga,et al.  Machine learning for the identification of clinically significant prostate cancer on MRI: a meta-analysis , 2020, European Radiology.

[15]  Yi Wei,et al.  Gadoxetic acid-enhanced MRI radiomics signature: prediction of clinical outcome in hepatocellular carcinoma after surgical resection. , 2020, Annals of translational medicine.

[16]  M. Supanich,et al.  Deep learning LI-RADS grading system based on contrast enhanced multiphase MRI for differentiation between LR-3 and LR-4/LR-5 liver tumors , 2020, Annals of translational medicine.

[17]  R. Cuocolo,et al.  Prostate MRI radiomics: A systematic review and radiomic quality score assessment. , 2020, European journal of radiology.

[18]  W. Lu,et al.  Deep Learning for Accurate Diagnosis of Liver Tumor Based on Magnetic Resonance Imaging and Clinical Data , 2020, Frontiers in Oncology.

[19]  A. Brunetti,et al.  MRI radiomics-based machine-learning classification of bone chondrosarcoma. , 2020, European journal of radiology.

[20]  Lorenzo Ugga,et al.  Machine Learning in Oncology: A Clinical Appraisal. , 2020, Cancer letters.

[21]  Haifeng Xu,et al.  Radiomics based on artificial intelligence in liver diseases: where are we? , 2020, Gastroenterology report.

[22]  Jie Tian,et al.  Deep Learning Radiomics Based on Contrast-Enhanced Ultrasound Might Optimize Curative Treatments for Very-Early or Early-Stage Hepatocellular Carcinoma Patients , 2020, Liver Cancer.

[23]  D. Gao,et al.  Deep learning assisted differentiation of hepatocellular carcinoma from focal liver lesions: choice of four-phase and three-phase CT imaging protocol , 2020, Abdominal Radiology.

[24]  Xingyu Zhao,et al.  Preoperative Prediction of Microvascular Invasion in Hepatocellular Carcinoma: Initial Application of a Radiomic Algorithm Based on Grayscale Ultrasound Images , 2020, Frontiers in Oncology.

[25]  Hironori Tanaka,et al.  Current role of ultrasound in the diagnosis of hepatocellular carcinoma , 2020, Journal of Medical Ultrasonics.

[26]  Xinhua Wei,et al.  Diagnostic performance of LI-RADS for MRI and CT detection of HCC: A systematic review and diagnostic meta-analysis. , 2020, European journal of radiology.

[27]  Jie Tian,et al.  Accurate prediction of responses to transarterial chemoembolization for patients with hepatocellular carcinoma by using artificial intelligence in contrast-enhanced ultrasound , 2020, European Radiology.

[28]  Samy A Azer,et al.  Deep learning with convolutional neural networks for identification of liver masses and hepatocellular carcinoma: A systematic review , 2019, World journal of gastrointestinal oncology.

[29]  João Manoel Miranda Magalhães Santos,et al.  State-of-the-art in radiomics of hepatocellular carcinoma: a review of basic principles, applications, and limitations , 2019, Abdominal Radiology.

[30]  J. Marescaux,et al.  Radiomics in hepatocellular carcinoma: a quantitative review , 2019, Hepatology International.

[31]  L. Schwartz,et al.  Radiomics machine-learning signature for diagnosis of hepatocellular carcinoma in cirrhotic patients with indeterminate liver nodules , 2019, European Radiology.

[32]  Jie Tian,et al.  Radiomics analysis enables recurrence prediction for hepatocellular carcinoma after liver transplantation. , 2019, European journal of radiology.

[33]  R. Cuocolo,et al.  Current applications of big data and machine learning in cardiology , 2019, Journal of geriatric cardiology : JGC.

[34]  Luke Oakden-Rayner,et al.  Exploring large scale public medical image datasets , 2019, Academic radiology.

[35]  Wei Zhao,et al.  Residual convolutional neural network for predicting response of transarterial chemoembolization in hepatocellular carcinoma from CT imaging , 2019, European Radiology.

[36]  M. Viergever,et al.  Automatic classification of focal liver lesions based on MRI and risk factors , 2019, PloS one.

[37]  Manish Arya,et al.  Computer-aided diagnosis of cirrhosis and hepatocellular carcinoma using multi-phase abdomen CT , 2019, International Journal of Computer Assisted Radiology and Surgery.

[38]  Akira Yamada,et al.  Dynamic contrast-enhanced computed tomography diagnosis of primary liver cancers using transfer learning of pretrained convolutional neural networks: Is registration of multiphasic images necessary? , 2019, International Journal of Computer Assisted Radiology and Surgery.

[39]  Vincent Agnus,et al.  Liver tissue segmentation in multiphase CT scans using cascaded convolutional neural networks , 2019, International Journal of Computer Assisted Radiology and Surgery.

[40]  Zhen-Chang Wang,et al.  Noninvasive Evaluation of the Pathologic Grade of Hepatocellular Carcinoma Using MCF-3DCNN: A Pilot Study , 2019, BioMed research international.

[41]  Di Dong,et al.  Prediction early recurrence of hepatocellular carcinoma eligible for curative ablation using a Radiomics nomogram , 2019, Cancer Imaging.

[42]  J. Duncan,et al.  Deep learning for liver tumor diagnosis part I: development of a convolutional neural network classifier for multi-phasic MRI , 2019, European Radiology.

[43]  A. Luciani,et al.  Diagnosis of focal liver lesions from ultrasound using deep learning. , 2019, Diagnostic and interventional imaging.

[44]  D. Gu,et al.  Preoperative radiomics nomogram for microvascular invasion prediction in hepatocellular carcinoma using contrast-enhanced CT , 2019, European Radiology.

[45]  Qi Wei,et al.  Artificial intelligence in medical imaging of the liver , 2019, World journal of gastroenterology.

[46]  Xin Li,et al.  Preoperative prediction of microvascular invasion in hepatocellular cancer: a radiomics model using Gd-EOB-DTPA-enhanced MRI , 2019, European Radiology.

[47]  Christos Davatzikos,et al.  Emerging Applications of Artificial Intelligence in Neuro-Oncology. , 2019, Radiology.

[48]  Hao Chen,et al.  The Liver Tumor Segmentation Benchmark (LiTS) , 2019, Medical Image Anal..

[49]  Eric J Topol,et al.  High-performance medicine: the convergence of human and artificial intelligence , 2019, Nature Medicine.

[50]  Alex John London,et al.  Artificial Intelligence and Black-Box Medical Decisions: Accuracy versus Explainability. , 2019, The Hastings Center report.

[51]  Arvid Lundervold,et al.  An overview of deep learning in medical imaging focusing on MRI , 2018, Zeitschrift fur medizinische Physik.

[52]  Q. Gao,et al.  Radiomics score: a potential prognostic imaging feature for postoperative survival of solitary HCC patients , 2018, BMC Cancer.

[53]  Jie Tian,et al.  Ultrasound-based radiomics score: a potential biomarker for the prediction of microvascular invasion in hepatocellular carcinoma , 2018, European Radiology.

[54]  Shaocheng Zhu,et al.  Predicting the grade of hepatocellular carcinoma based on non-contrast-enhanced MRI radiomics signature , 2018, European Radiology.

[55]  James S. Duncan,et al.  Liver Tissue Classification Using an Auto-context-based Deep Neural Network with a Multi-phase Training Framework , 2018, Patch-MI@MICCAI.

[56]  Puja Bharti,et al.  Preliminary Study of Chronic Liver Classification on Ultrasound Images Using an Ensemble Model , 2018, Ultrasonic imaging.

[57]  P. Schirmacher,et al.  EASL Clinical Practice Guidelines: Management of hepatocellular carcinoma. , 2018, Journal of hepatology.

[58]  Xiao Zheng,et al.  A two-stage multi-view learning framework based computer-aided diagnosis of liver tumors with contrast enhanced ultrasound images. , 2018, Clinical hemorheology and microcirculation.

[59]  Aaron C. Abajian,et al.  Predicting Treatment Response to Intra-arterial Therapies for Hepatocellular Carcinoma with the Use of Supervised Machine Learning-An Artificial Intelligence Concept. , 2018, Journal of vascular and interventional radiology : JVIR.

[60]  J. Sosna,et al.  Patient-specific and global convolutional neural networks for robust automatic liver tumor delineation in follow-up CT studies , 2018, Medical & Biological Engineering & Computing.

[61]  John O. Prior,et al.  Signature of survival: a 18F-FDG PET based whole-liver radiomic analysis predicts survival after 90Y-TARE for hepatocellular carcinoma , 2017, Oncotarget.

[62]  V. Alves,et al.  Histological Grading of Hepatocellular Carcinoma—A Systematic Review of Literature , 2017, Front. Med..

[63]  O. Abe,et al.  Deep Learning with Convolutional Neural Network for Differentiation of Liver Masses at Dynamic Contrast-enhanced CT: A Preliminary Study. , 2017, Radiology.

[64]  P. Lambin,et al.  Radiomics: the bridge between medical imaging and personalized medicine , 2017, Nature Reviews Clinical Oncology.

[65]  Hung-Wen Chiu,et al.  Disease-free survival assessment by artificial neural networks for hepatocellular carcinoma patients after radiofrequency ablation. , 2017, Journal of the Formosan Medical Association = Taiwan yi zhi.

[66]  Olivier Gevaert,et al.  Noninvasive radiomics signature based on quantitative analysis of computed tomography images as a surrogate for microvascular invasion in hepatocellular carcinoma: a pilot study , 2017, Journal of medical imaging.

[67]  Samuel Kadoury,et al.  Liver segmentation: indications, techniques and future directions , 2017, Insights into Imaging.

[68]  C. Liang,et al.  Malignancy characterization of hepatocellular carcinomas based on texture analysis of contrast‐enhanced MR images , 2017, Journal of magnetic resonance imaging : JMRI.

[69]  Xiao Han,et al.  MR‐based synthetic CT generation using a deep convolutional neural network method , 2017, Medical physics.

[70]  Amber L. Simpson,et al.  Preoperative Prediction of Microvascular Invasion in Hepatocellular Carcinoma Using Quantitative Image Analysis. , 2017, Journal of the American College of Surgeons.

[71]  Sebastian J. Schlecht,et al.  Automatic Liver and Tumor Segmentation of CT and MRI Volumes using Cascaded Fully Convolutional Neural Networks , 2017, ArXiv.

[72]  Fabrice Heitz,et al.  Scale-adaptive supervoxel-based random forests for liver tumor segmentation in dynamic contrast-enhanced CT scans , 2017, International Journal of Computer Assisted Radiology and Surgery.

[73]  Mohammed Elmogy,et al.  Diagnosis of Focal Liver Diseases Based on Deep Learning Technique for Ultrasound Images , 2017, Arabian Journal for Science and Engineering.

[74]  C. Liang,et al.  Texture analysis of intermediate-advanced hepatocellular carcinoma: prognosis and patients' selection of transcatheter arterial chemoembolization and sorafenib , 2016, Oncotarget.

[75]  Paul Kinahan,et al.  Radiomics: Images Are More than Pictures, They Are Data , 2015, Radiology.

[76]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[77]  M. Schwartz,et al.  Recurrence of hepatocellular cancer after resection: patterns, treatments, and prognosis. , 2015, Annals of surgery.

[78]  Elliot K Fishman,et al.  Preliminary Data Using Computed Tomography Texture Analysis for the Classification of Hypervascular Liver Lesions: Generation of a Predictive Model on the Basis of Quantitative Spatial Frequency Measurements—A Work in Progress , 2015, Journal of computer assisted tomography.

[79]  Joon Koo Han,et al.  Hepatocellular carcinoma: diagnostic performance of multidetector CT and MR imaging-a systematic review and meta-analysis. , 2015, Radiology.

[80]  H. Heinzl,et al.  How to STATE suitability and START transarterial chemoembolization in patients with intermediate stage hepatocellular carcinoma. , 2014, Journal of hepatology.

[81]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[82]  A. Tamori,et al.  Positioning of 18F‐fluorodeoxyglucose‐positron emission tomography imaging in the management algorithm of hepatocellular carcinoma , 2014, Journal of gastroenterology and hepatology.

[83]  A. Burroughs,et al.  A simple prognostic scoring system for patients receiving transarterial embolisation for hepatocellular cancer , 2013, Annals of oncology : official journal of the European Society for Medical Oncology.

[84]  V. Mazzaferro,et al.  Heterogeneity of Patients with Intermediate (BCLC B) Hepatocellular Carcinoma: Proposal for a Subclassification to Facilitate Treatment Decisions , 2012, Seminars in Liver Disease.

[85]  James A Scott,et al.  Neural network evaluation of PET scans of the liver: a potentially useful adjunct in clinical interpretation. , 2011, Radiology.

[86]  L. Roberts,et al.  Epidemiology and management of hepatocellular carcinoma. , 2010, Infectious disease clinics of North America.

[87]  Chung-Ming Chen,et al.  Automatic segmentation of liver PET images , 2008, Comput. Medical Imaging Graph..

[88]  M. Dumont,et al.  European Association for the Study of the Liver , 1971 .

[89]  Xingyu Zhao,et al.  Deep Learning Predicts Overall Survival of Patients with Unresectable Hepatocellular Carcinoma Treated by Transarterial Chemoembolization Plus Sorafenib: A Multicenter Study , 2020, SSRN Electronic Journal.

[90]  M. Özmen,et al.  Microvascular invasion in hepatocellular carcinoma. , 2016, Diagnostic and interventional radiology.

[91]  D. Woodfield Hepatocellular carcinoma. , 1986, The New Zealand medical journal.