Classification and Segmentation of Hyperspectral Data of Hepatocellular Carcinoma Samples Using 1‐D Convolutional Neural Network

Pathological diagnosis plays an important role in the diagnosis and treatment of hepatocellular carcinoma (HCC). The traditional method of pathological diagnosis of most cancers requires freezing, slicing, hematoxylin and eosin staining, and manual analysis, limiting the speed of the diagnosis process. In this study, we designed a one‐dimensional convolutional neural network to classify the hyperspectral data of HCC sample slices acquired by our hyperspectral imaging system. A weighted loss function was employed to promote the performance of the model. The proposed method allows us to accelerate the diagnosis process of identifying tumor tissues. Our deep learning model achieved good performance on our data set with sensitivity, specificity, and area under receiver operating characteristic curve of 0.871, 0.888, and 0.950, respectively. Meanwhile, our deep learning model outperformed the other machine learning methods assessed on our data set. The proposed method is a potential tool for the label‐free and real‐time pathologic diagnosis. © 2019 International Society for Advancement of Cytometry

[1]  Yanjun Qi Random Forest for Bioinformatics , 2012 .

[2]  Rongrong Ji,et al.  Spectral-spatial classification of hyperspectral imagery based on Random Forests , 2013, ICIMCS '13.

[3]  Guolan Lu,et al.  Medical hyperspectral imaging: a review , 2014, Journal of biomedical optics.

[4]  David A. Boas,et al.  "Handbook of biomedical optics", edited by David A. Boas, Constantinos Pitris, and Nimmi Ramanujam , 2012, BioMedical Engineering OnLine.

[5]  June-Goo Lee,et al.  Deep Learning in Medical Imaging: General Overview , 2017, Korean journal of radiology.

[6]  Siqi Li,et al.  Joint multiple fully connected convolutional neural network with extreme learning machine for hepatocellular carcinoma nuclei grading , 2017, Comput. Biol. Medicine.

[7]  Johannes R. Sveinsson,et al.  Spectral and spatial classification of hyperspectral data using SVMs and morphological profiles , 2008, 2007 IEEE International Geoscience and Remote Sensing Symposium.

[8]  Zhiwen Liu,et al.  Cell dynamic morphology classification using deep convolutional neural networks , 2018, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[9]  Abbas K. AlZubaidi,et al.  Computer aided diagnosis in digital pathology application: Review and perspective approach in lung cancer classification , 2017, 2017 Annual Conference on New Trends in Information & Communications Technology Applications (NTICT).

[10]  Nello Cristianini,et al.  Support vector machine classification and validation of cancer tissue samples using microarray expression data , 2000, Bioinform..

[11]  David A. Cairns,et al.  Application of the Random Forest Classification Method to Peaks Detected from Mass Spectrometric Proteomic Profiles of Cancer Patients and Controls , 2008, Statistical applications in genetics and molecular biology.

[12]  G. Izmirlian,et al.  Application of the Random Forest Classification Algorithm to a SELDI‐TOF Proteomics Study in the Setting of a Cancer Prevention Trial , 2004, Annals of the New York Academy of Sciences.

[13]  Ekrem Duman,et al.  A profit-driven Artificial Neural Network (ANN) with applications to fraud detection and direct marketing , 2016, Neurocomputing.

[14]  Christoph Meinel,et al.  Deep Learning for Medical Image Analysis , 2018, Journal of Pathology Informatics.

[15]  Ming Ni,et al.  Automated classification of hepatocellular carcinoma differentiation using multiphoton microscopy and deep learning , 2019, Journal of biophotonics.

[16]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[17]  Abbas Alimohammadi,et al.  Land cover mapping based on random forest classification of multitemporal spectral and thermal images , 2015, Environmental Monitoring and Assessment.

[18]  Weimin Huang,et al.  Brain tumor grading based on Neural Networks and Convolutional Neural Networks , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[19]  Sigeru Omatu,et al.  Combining Neural Networks for Skin Detection , 2011, ArXiv.

[20]  Leonie L. Zeune,et al.  How to Agree on a CTC: Evaluating the Consensus in Circulating Tumor Cell Scoring , 2018, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[21]  Stephen T. C. Wong,et al.  Combining deep learning and coherent anti-Stokes Raman scattering imaging for automated differential diagnosis of lung cancer , 2017, Journal of biomedical optics.

[22]  Jon Atli Benediktsson,et al.  Sensitivity of Support Vector Machines to Random Feature Selection in Classification of Hyperspectral Data , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[23]  Andrew Janowczyk,et al.  A deep learning based strategy for identifying and associating mitotic activity with gene expression derived risk categories in estrogen receptor positive breast cancers , 2017, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[24]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[25]  Yuya Kajikawa,et al.  Computer-aided diagnosis: A survey with bibliometric analysis , 2017, Int. J. Medical Informatics.

[26]  G. Mercier,et al.  Support vector machines for hyperspectral image classification with spectral-based kernels , 2003, IGARSS 2003. 2003 IEEE International Geoscience and Remote Sensing Symposium. Proceedings (IEEE Cat. No.03CH37477).

[27]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[28]  Kunio Doi,et al.  Computer-aided diagnosis in medical imaging: Historical review, current status and future potential , 2007, Comput. Medical Imaging Graph..

[29]  Nisreen I. R. Yassin,et al.  Machine learning techniques for breast cancer computer aided diagnosis using different image modalities: A systematic review , 2018, Comput. Methods Programs Biomed..

[30]  Aleš Procházka,et al.  Cycling Segments Multimodal Analysis and Classification Using Neural Networks , 2017 .

[31]  Max A. Viergever,et al.  Breast Cancer Histopathology Image Analysis: A Review , 2014, IEEE Transactions on Biomedical Engineering.

[32]  Stephen T. C. Wong,et al.  Multiclass Cancer Classification by Using Fuzzy Support Vector Machine and Binary Decision Tree With Gene Selection , 2005, Journal of biomedicine & biotechnology.

[33]  Max A. Viergever,et al.  Automatic Segmentation of MR Brain Images With a Convolutional Neural Network , 2016, IEEE Transactions on Medical Imaging.

[34]  Syed A. Hoda,et al.  Rubin's Pathology: Clinicopathologic Foundations of Medicine, 5th Edition , 2007 .

[35]  A. Jemal,et al.  Cancer statistics in China, 2015 , 2016, CA: a cancer journal for clinicians.

[36]  Gang Chen,et al.  Label-free classification of hepatocellular-carcinoma grading using second harmonic generation microscopy. , 2018, Biomedical optics express.

[37]  William Stafford Noble,et al.  Support vector machine , 2013 .

[38]  Andrew A. Renshaw,et al.  Rubin??s Pathology. Clinicopathologic Foundations of Medicine , 2008 .

[39]  S. S. Salankar,et al.  MRI brain cancer classification using Support Vector Machine , 2014, 2014 IEEE Students' Conference on Electrical, Electronics and Computer Science.

[40]  Pandia Rajan Jeyaraj,et al.  Computer-assisted medical image classification for early diagnosis of oral cancer employing deep learning algorithm , 2019, Journal of Cancer Research and Clinical Oncology.

[41]  Muktabh Mayank Srivastava,et al.  Boosted Cascaded Convnets for Multilabel Classification of Thoracic Diseases in Chest Radiographs , 2017, ICIAR.

[42]  A. Jemal,et al.  Global cancer statistics , 2011, CA: a cancer journal for clinicians.

[43]  Zhiyuan Luo,et al.  Gene Selection for Cancer Classification using Wilcoxon Rank Sum Test and Support Vector Machine , 2006, 2006 International Conference on Computational Intelligence and Security.

[44]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[45]  O. Mutanga,et al.  Discriminating the papyrus vegetation (Cyperus papyrus L.) and its co-existent species using random forest and hyperspectral data resampled to HYMAP , 2012 .

[46]  Palak Mehta,et al.  Review on Techniques and Steps of Computer Aided Skin Cancer Diagnosis , 2016 .

[47]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[48]  Tara N. Sainath,et al.  Improving deep neural networks for LVCSR using rectified linear units and dropout , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[49]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[50]  Ronald M. Summers,et al.  Deep Learning in Medical Imaging: Overview and Future Promise of an Exciting New Technique , 2016 .