Deep learning with convolutional neural networks for identification of liver masses and hepatocellular carcinoma: A systematic review

BACKGROUND Artificial intelligence, such as convolutional neural networks (CNNs), has been used in the interpretation of images and the diagnosis of hepatocellular cancer (HCC) and liver masses. CNN, a machine-learning algorithm similar to deep learning, has demonstrated its capability to recognise specific features that can detect pathological lesions. AIM To assess the use of CNNs in examining HCC and liver masses images in the diagnosis of cancer and evaluating the accuracy level of CNNs and their performance. METHODS The databases PubMed, EMBASE, and the Web of Science and research books were systematically searched using related keywords. Studies analysing pathological anatomy, cellular, and radiological images on HCC or liver masses using CNNs were identified according to the study protocol to detect cancer, differentiating cancer from other lesions, or staging the lesion. The data were extracted as per a predefined extraction. The accuracy level and performance of the CNNs in detecting cancer or early stages of cancer were analysed. The primary outcomes of the study were analysing the type of cancer or liver mass and identifying the type of images that showed optimum accuracy in cancer detection. RESULTS A total of 11 studies that met the selection criteria and were consistent with the aims of the study were identified. The studies demonstrated the ability to differentiate liver masses or differentiate HCC from other lesions (n = 6), HCC from cirrhosis or development of new tumours (n = 3), and HCC nuclei grading or segmentation (n = 2). The CNNs showed satisfactory levels of accuracy. The studies aimed at detecting lesions (n = 4), classification (n = 5), and segmentation (n = 2). Several methods were used to assess the accuracy of CNN models used. CONCLUSION The role of CNNs in analysing images and as tools in early detection of HCC or liver masses has been demonstrated in these studies. While a few limitations have been identified in these studies, overall there was an optimal level of accuracy of the CNNs used in segmentation and classification of liver cancers images.

[1]  Joel H. Saltz,et al.  Comparison of Different Classifiers with Active Learning to Support Quality Control in Nucleus Segmentation in Pathology Images , 2018, AMIA Joint Summits on Translational Science proceedings. AMIA Joint Summits on Translational Science.

[2]  Carlo La Vecchia,et al.  Hepatocellular carcinoma epidemiology. , 2014, Best practice & research. Clinical gastroenterology.

[3]  S. Nomura,et al.  Application of Convolutional Neural Networks in the Diagnosis of Helicobacter pylori Infection Based on Endoscopic Images , 2017, EBioMedicine.

[4]  William E. Wagner,et al.  Using IBM® SPSS® Statistics for Research Methods and Social Science Statistics , 2012 .

[5]  Claude B. Sirlin,et al.  LI‐RADS (Liver Imaging Reporting and Data System): Summary, discussion, and consensus of the LI‐RADS Management Working Group and future directions , 2015, Hepatology.

[6]  Puja Bharti,et al.  Preliminary Study of Chronic Liver Classification on Ultrasound Images Using an Ensemble Model , 2018, Ultrasonic imaging.

[7]  Siqi Li,et al.  Joint multiple fully connected convolutional neural network with extreme learning machine for hepatocellular carcinoma nuclei grading , 2017, Comput. Biol. Medicine.

[8]  Sajjad Waheed,et al.  Gastrointestinal polyp detection in endoscopic images using an improved feature extraction method , 2018, Biomedical engineering letters.

[9]  Sajjad Waheed,et al.  An Automatic Gastrointestinal Polyp Detection System in Video Endoscopy Using Fusion of Color Wavelet and Convolutional Neural Network Features , 2017, Int. J. Biomed. Imaging.

[10]  Yen-Wei Chen,et al.  Detection of Liver Tumor Candidates from CT Images Using Deep Convolutional Neural Networks , 2017 .

[11]  Xuanqin Mou,et al.  Quality Assessment of Screen Content Images via Convolutional-Neural-Network-Based Synthetic/Natural Segmentation , 2018, IEEE Transactions on Image Processing.

[12]  P. Malfertheiner,et al.  World Gastroenterology Organisation Guideline. Hepatocellular carcinoma (HCC): a global perspective. , 2010, Journal of gastrointestinal and liver diseases : JGLD.

[13]  Yaonan Wang,et al.  Benchmark Data Set and Method for Depth Estimation From Light Field Images , 2018, IEEE Transactions on Image Processing.

[14]  J. Dufour,et al.  The story of HCC in NAFLD: from epidemiology, across pathogenesis, to prevention and treatment , 2016, Liver international : official journal of the International Association for the Study of the Liver.

[15]  Richard K. G. Do,et al.  Convolutional neural networks: an overview and application in radiology , 2018, Insights into Imaging.

[16]  Yu-Dong Yao,et al.  Structure convolutional extreme learning machine and case-based shape template for HCC nucleus segmentation , 2018, Neurocomputing.

[17]  J. Lundy,et al.  Liver Metastases. , 1981, Current problems in surgery.

[18]  Kenji Suzuki,et al.  Overview of deep learning in medical imaging , 2017, Radiological Physics and Technology.

[19]  M. Kudo,et al.  Asia–Pacific clinical practice guidelines on the management of hepatocellular carcinoma: a 2017 update , 2017, Hepatology International.

[20]  Takumi Itoh,et al.  Deep learning analyzes Helicobacter pylori infection by upper gastrointestinal endoscopy images , 2018, Endoscopy International Open.

[21]  Nasir M. Rajpoot,et al.  Locality Sensitive Deep Learning for Detection and Classification of Nuclei in Routine Colon Cancer Histology Images , 2016, IEEE Trans. Medical Imaging.

[22]  Yonggang Lu,et al.  A novel MRI segmentation method using CNN‐based correction network for MRI‐guided adaptive radiotherapy , 2018, Medical physics.

[23]  O. Abe,et al.  Deep Learning with Convolutional Neural Network for Differentiation of Liver Masses at Dynamic Contrast-enhanced CT: A Preliminary Study. , 2017, Radiology.

[24]  S. Azer,et al.  Group interaction in problem-based learning tutorials: a systematic review. , 2015, European journal of dental education : official journal of the Association for Dental Education in Europe.

[25]  C. Sirlin,et al.  Toward a standardized system for hepatocellular carcinoma diagnosis using computed tomography and MRI , 2013, Expert review of gastroenterology & hepatology.

[26]  Ronald M. Summers,et al.  Deep Convolutional Neural Networks for Computer-Aided Detection: CNN Architectures, Dataset Characteristics and Transfer Learning , 2016, IEEE Transactions on Medical Imaging.

[27]  Max Q.-H. Meng,et al.  Gastrointestinal bleeding detection in wireless capsule endoscopy images using handcrafted and CNN features , 2017, 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[28]  Leo Joskowicz,et al.  Patient-specific and global convolutional neural networks for robust automatic liver tumor delineation in follow-up CT studies , 2018, Medical & Biological Engineering & Computing.

[29]  H. Duan,et al.  Gastric precancerous diseases classification using CNN with a concise model , 2017, PloS one.

[30]  Bram van Ginneken,et al.  Automatic classification of pulmonary peri-fissural nodules in computed tomography using an ensemble of 2D views and a convolutional neural network out-of-the-box , 2015, Medical Image Anal..

[31]  M. Colombo,et al.  Contrast enhanced CT-scan to diagnose intrahepatic cholangiocarcinoma in patients with cirrhosis. , 2013, Journal of hepatology.

[32]  V. Vilgrain,et al.  Comparison of semi-automated and manual methods to measure the volume of liver tumours on MDCT images , 2011, European Radiology.

[33]  C. Sirlin,et al.  Liver Imaging Reporting and Data System , 2020, Advances in Clinical Radiology.

[34]  J. Bruix,et al.  Management of hepatocellular carcinoma: An update , 2011, Hepatology.

[35]  Nanning Zheng,et al.  Improving CNN Performance Accuracies With Min–Max Objective , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[36]  Hong-Yang Wang,et al.  Gender disparity in hepatocellular carcinoma (HCC): multiple underlying mechanisms , 2017, Science China Life Sciences.

[37]  Zhen-ning Wang,et al.  Effect of neoadjuvant chemotherapy in patients with gastric cancer: a PRISMA-compliant systematic review and meta-analysis , 2018, BMC Cancer.

[38]  C. Pal,et al.  Deep Learning: A Primer for Radiologists. , 2017, Radiographics : a review publication of the Radiological Society of North America, Inc.

[39]  Faisal Mahmood,et al.  Deep learning and conditional random fields‐based depth estimation and topographical reconstruction from conventional endoscopy , 2017, Medical Image Anal..

[40]  Sebastian Thrun,et al.  Dermatologist-level classification of skin cancer with deep neural networks , 2017, Nature.

[41]  James S. Duncan,et al.  Liver Tissue Classification Using an Auto-context-based Deep Neural Network with a Multi-phase Training Framework , 2018, Patch-MI@MICCAI.

[42]  Leo Joskowicz,et al.  Automatic detection of new tumors and tumor burden evaluation in longitudinal liver CT scan studies , 2017, International Journal of Computer Assisted Radiology and Surgery.

[43]  Hayit Greenspan,et al.  Fully convolutional network and sparsity-based dictionary learning for liver lesion detection in CT examinations , 2018, Neurocomputing.

[44]  Kostas Marias,et al.  Extending 2-D Convolutional Neural Networks to 3-D for Advancing Deep Learning Cancer Classification With Application to MRI Liver Tumor Differentiation , 2019, IEEE Journal of Biomedical and Health Informatics.

[45]  Brian B. Avants,et al.  The Multimodal Brain Tumor Image Segmentation Benchmark (BRATS) , 2015, IEEE Transactions on Medical Imaging.

[46]  P. Malfertheiner,et al.  Hepatocellular carcinoma (HCC): a global perspective. , 2010, Journal of clinical gastroenterology.

[47]  Hayit Greenspan,et al.  GAN-based Synthetic Medical Image Augmentation for increased CNN Performance in Liver Lesion Classification , 2018, Neurocomputing.