Classification of Histopathology Images of Lung Cancer Using Convolutional Neural Network (CNN)

Cancer is the uncontrollable cell division of abnormal cells inside the human body, which can spread to other body organs. It is one of the non-communicable diseases (NCDs) and NCDs accounts for 71% of total deaths worldwide whereas lung cancer is the second most diagnosed cancer after female breast cancer. Cancer survival rate of lung cancer is only 19%. There are various methods for the diagnosis of lung cancer, such as X-ray, CT scan, PET-CT scan, bronchoscopy and biopsy. However, to know the subtype of lung cancer based on the tissue type H and E staining is widely used, where the staining is done on the tissue aspirated from a biopsy. Studies have reported that the type of histology is associated with prognosis and treatment in lung cancer. Therefore, early and accurate detection of lung cancer histology is an urgent need and as its treatment is dependent on the type of histology, molecular profile and stage of the disease, it is most essential to analyse the histopathology images of lung cancer. Hence, to speed up the vital process of diagnosis of lung cancer and reduce the burden on pathologists, Deep learning techniques are used. These techniques have shown improved efficacy in the analysis of histopathology slides of cancer. Several studies reported the importance of convolution neural networks (CNN) in the classification of histopathological pictures of various cancer types such as brain, skin, breast, lung, colorectal cancer. In this study tri-category classification of lung cancer images (normal, adenocarcinoma and squamous cell carcinoma) are carried out by using ResNet 50, VGG-19, Inception_ResNet_V2 and DenseNet for the feature extraction and triplet loss to guide the CNN such that it increases inter-cluster distance and reduces intra-cluster distance.

[1]  Ashok Kumar Dwivedi Artificial neural network model for effective cancer classification using microarray gene expression data , 2018, Neural Computing and Applications.

[2]  Gora Chand Nandi,et al.  Continuous dynamic Indian Sign Language gesture recognition with invariant backgrounds , 2015, 2015 International Conference on Advances in Computing, Communications and Informatics (ICACCI).

[3]  M. Nishio,et al.  Homology-Based Image Processing for Automatic Classification of Histopathological Images of Lung Tissue , 2021, Cancers.

[4]  C. Chandrasekar,et al.  Lung Nodule Detection Using Fuzzy Clustering and Support Vector Machines , 2013 .

[5]  Satvik Garg,et al.  Prediction of lung and colon cancer through analysis of histopathological images by utilizing Pre-trained CNN models with visualization of class activation and saliency maps , 2020, AICCC.

[6]  Dhirendra Pratap Singh,et al.  Lung cancer identification: a review on detection and classification , 2020, Cancer and Metastasis Reviews.

[7]  Hiok Chai Quek,et al.  Ovarian Cancer Diagnosis with Complementary Learning Fuzzy Neural Network , 2022 .

[8]  Thomas Hellström,et al.  Fusion of Gesture and Speech for Increased Accuracy in Human Robot Interaction , 2019, 2019 24th International Conference on Methods and Models in Automation and Robotics (MMAR).

[9]  Bin Fan,et al.  MiRFinder: an improved approach and software implementation for genome-wide fast microRNA precursor scans , 2007, BMC Bioinformatics.

[10]  Santosh K. Mishra,et al.  De novo SVM classification of precursor microRNAs from genomic pseudo hairpins using global and intrinsic folding measures , 2007, Bioinform..

[11]  Antonello Rizzi,et al.  Cancer Diagnosis Using Deep Learning: A Bibliographic Review , 2019, Cancers.

[12]  Andrew A. Renshaw,et al.  Rubin??s Pathology. Clinicopathologic Foundations of Medicine , 2008 .

[13]  Gora Chand Nandi,et al.  Real‐Time Gesture–Based Communication Using Possibility Theory–Based Hidden Markov Model , 2017, Comput. Intell..

[14]  Gora Chand Nandi,et al.  Development of a Fuzzy Expert System based Liveliness Detection Scheme for Biometric Authentication , 2016, ArXiv.

[15]  C. V. Jawahar,et al.  Improving multiclass classification by deep networks using DAGSVM and Triplet Loss , 2018, Pattern Recognit. Lett..

[16]  M. Ghazisaeedi,et al.  Improving the Prediction of Survival in Cancer Patients by Using Machine Learning Techniques: Experience of Gene Expression Data: A Narrative Review , 2017, Iranian journal of public health.

[17]  Kunio Doi,et al.  Computer-aided diagnosis in medical imaging: Historical review, current status and future potential , 2007, Comput. Medical Imaging Graph..

[18]  Kai-Florian Richter,et al.  A Fuzzy Inference System for a Visually Grounded Robot State of Mind , 2020, ECAI.

[19]  Jonathan M. Garibaldi,et al.  Using Rule-Based Machine Learning for Candidate Disease Gene Prioritization and Sample Classification of Cancer Gene Expression Data , 2012, PloS one.

[20]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[21]  Kok-Swee Sim,et al.  Convolutional neural network improvement for breast cancer classification , 2019, Expert Syst. Appl..

[22]  Avinash Kumar Singh,et al.  Extracting Primary Objects and Spatial Relations from Sentences , 2019, ICAART.

[23]  Begonya Garcia-Zapirain,et al.  Breast Cancer Histopathology Image Classification Using an Ensemble of Deep Learning Models , 2020, Sensors.

[24]  Kai-Florian Richter,et al.  Understandable Teams of Pepper Robots , 2020, PAAMS.

[25]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[26]  Yongming Li,et al.  Automatic cell nuclei segmentation and classification of cervical Pap smear images , 2019, Biomed. Signal Process. Control..

[27]  Arvid Lundervold,et al.  An overview of deep learning in medical imaging focusing on MRI , 2018, Zeitschrift fur medizinische Physik.

[28]  Evangelos Triantaphyllou,et al.  A systematic survey of computer-aided diagnosis in medicine: Past and present developments , 2019, Expert Syst. Appl..

[29]  Shiqian Ma,et al.  Highly accurate model for prediction of lung nodule malignancy with CT scans , 2018, Scientific Reports.

[30]  M. Giger,et al.  Anniversary paper: History and status of CAD and quantitative image analysis: the role of Medical Physics and AAPM. , 2008, Medical physics.

[31]  Wen-Huang Cheng,et al.  Computer-aided classification of lung nodules on computed tomography images via deep learning technique , 2015, OncoTargets and therapy.

[32]  Fei Li,et al.  Classification of real and pseudo microRNA precursors using local structure-sequence features and support vector machine , 2005, BMC Bioinformatics.

[33]  R FORD,et al.  Medical malpractice. , 1950, The New England journal of medicine.

[34]  Gora Chand Nandi,et al.  Development of a self reliant humanoid robot for sketch drawing , 2017, Multimedia Tools and Applications.

[35]  Youping Deng,et al.  Gene selection and classification for cancer microarray data based on machine learning and similarity measures , 2011, BMC Genomics.

[36]  Expression invariant fragmented face recognition , 2014, 2014 International Conference on Signal Propagation and Computer Technology (ICSPCT 2014).

[37]  Shweta Tripathi,et al.  A speaker invariant speech recognition technique using HFCC features in isolated Hindi words , 2014, Int. J. Comput. Intell. Stud..

[38]  Jiahui Liu,et al.  Multipath feature recalibration DenseNet for image classification , 2020, International Journal of Machine Learning and Cybernetics.

[39]  Gora Chand Nandi,et al.  Face recognition using facial symmetry , 2012, CCSEIT '12.

[40]  Kai-Florian Richter,et al.  Towards Verbal Explanations by Collaborating Robot Teams , 2019 .

[41]  Dr. Rajashree Shettar,et al.  Early Detection of Lung Cancer Using Neural Network Techniques , 2014 .

[42]  P. Pêgo-Fernandes,et al.  The role of the surgeon in treating patients with lung cancer. An updating article , 2021, Sao Paulo medical journal = Revista paulista de medicina.

[43]  Kai-Florian Richter,et al.  An Empirical Review of Calibration Techniques for the Pepper Humanoid Robot's RGB and Depth Camera , 2019, IntelliSys.

[44]  Yang Liu,et al.  MiRTDL: A Deep Learning Approach for miRNA Target Prediction , 2016, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[45]  A. Jemal,et al.  Global cancer statistics 2018: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries , 2018, CA: a cancer journal for clinicians.

[46]  Yang Xie,et al.  Artificial Intelligence in Lung Cancer Pathology Image Analysis , 2019, Cancers.

[47]  Chaoyang Zhang,et al.  Deep Learning Based Analysis of Histopathological Images of Breast Cancer , 2019, Front. Genet..

[48]  Shuigeng Zhou,et al.  MiRenSVM: towards better prediction of microRNA precursors using an ensemble SVM classifier with multi-loop features , 2010, BMC Bioinformatics.

[49]  G. C. Nandi,et al.  Face recognition with liveness detection using eye and mouth movement , 2014, 2014 International Conference on Signal Propagation and Computer Technology (ICSPCT 2014).

[50]  W. Travis Pathology & Genetics Tumours of the lung, Pleura, Thymus and Heart , 2004 .

[51]  James Philbin,et al.  FaceNet: A unified embedding for face recognition and clustering , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[52]  Seunghyun Park,et al.  deepMiRGene: Deep Neural Network based Precursor microRNA Prediction , 2016, ArXiv.

[53]  Hiroshi Fujita,et al.  Automated Classification of Lung Cancer Types from Cytological Images Using Deep Convolutional Neural Networks , 2017, BioMed research international.

[54]  Francisco Herrera,et al.  Deep Learning in Omics Data Analysis and Precision Medicine , 2019, Computational Biology.

[55]  Gora Chand Nandi,et al.  Face liveness detection through face structure analysis , 2014, Int. J. Appl. Pattern Recognit..

[56]  P. Jia,et al.  The Effects of Clinical Decision Support Systems on Medication Safety: An Overview , 2016, PloS one.

[57]  Shuyu Li,et al.  Colon Cancer Detection Using Whole Slide Histopathological Images , 2013 .

[58]  Qiang Qu,et al.  Learning for Personalized Medicine: A Comprehensive Review From a Deep Learning Perspective , 2019, IEEE Reviews in Biomedical Engineering.

[59]  Igor V. Tetko,et al.  Gene selection from microarray data for cancer classification - a machine learning approach , 2005, Comput. Biol. Chem..

[60]  Gora Chand Nandi,et al.  A mathematical framework for possibility theory-based hidden Markov model , 2017, Int. J. Bio Inspired Comput..

[61]  Kai-Florian Richter,et al.  Verbal explanations by collaborating robot teams , 2020, Paladyn J. Behav. Robotics.

[62]  Evangelos Triantaphyllou,et al.  The seven key challenges for the future of computer-aided diagnosis in medicine , 2019, Int. J. Medical Informatics.

[63]  H. E. Pople,et al.  Internist-1, an experimental computer-based diagnostic consultant for general internal medicine. , 1982, The New England journal of medicine.

[64]  Zakaria Suliman Zubi,et al.  Using some data mining techniques for early diagnosis of lung cancer , 2011 .

[65]  Jirí Sedlár,et al.  Predicting Deletion of Chromosomal Arms 1p/19q in Low-Grade Gliomas from MR Images Using Machine Intelligence , 2017, Journal of Digital Imaging.

[66]  Kamalika Datta,et al.  Comparative study of spread spectrum based audio watermarking techniques , 2011, 2011 International Conference on Recent Trends in Information Technology (ICRTIT).

[67]  J. Kvedar,et al.  Artificial intelligence powers digital medicine , 2018, npj Digital Medicine.

[68]  N. Hanna,et al.  The impact of induction chemotherapy on the outcome of second-line therapy with pemetrexed or docetaxel in patients with advanced non-small-cell lung cancer. , 2006, Annals of oncology : official journal of the European Society for Medical Oncology.

[69]  D. Brat,et al.  Predicting cancer outcomes from histology and genomics using convolutional networks , 2017, Proceedings of the National Academy of Sciences.

[70]  Kamalika Datta,et al.  Peak Detection based Spread Spectrum Audio Watermarking using Discrete Wavelet Transform , 2011 .

[71]  Byoung-Tak Zhang,et al.  Human microRNA prediction through a probabilistic co-learning model of sequence and structure , 2005, Nucleic acids research.

[72]  Timothy R. Smith,et al.  Malpractice Liability and Defensive Medicine: A National Survey of Neurosurgeons , 2012, PloS one.

[73]  Junhao Wen,et al.  Fundus Image Classification Using VGG-19 Architecture with PCA and SVD , 2018, Symmetry.

[74]  Rinkle Rani,et al.  A Systematic Review of Applications of Machine Learning in Cancer Prediction and Diagnosis , 2021, Archives of Computational Methods in Engineering.

[75]  Yan Cui,et al.  Transfer Learning for Molecular Cancer Classification Using Deep Neural Networks , 2019, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[76]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[77]  Yukiko Nakamura,et al.  Influence of histological type, smoking history and chemotherapy on survival after first‐line therapy in patients with advanced non‐small cell lung cancer , 2007, Cancer science.

[78]  Gora Chand Nandi,et al.  NAO humanoid robot: Analysis of calibration techniques for robot sketch drawing , 2016, Robotics Auton. Syst..

[79]  Saiful Islam,et al.  Cancer diagnosis in histopathological image: CNN based approach , 2019, Informatics in Medicine Unlocked.

[80]  G. C. Nandi,et al.  Sketch drawing by NAO humanoid robot , 2015, TENCON 2015 - 2015 IEEE Region 10 Conference.

[81]  A. Ng,et al.  Deep learning for chest radiograph diagnosis: A retrospective comparison of the CheXNeXt algorithm to practicing radiologists , 2018, PLoS medicine.

[82]  Zhuowen Tu,et al.  Aggregated Residual Transformations for Deep Neural Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[83]  Argin Margoosian,et al.  Ensemble-based classifiers for cancer classification using human tumor microarray data , 2013, 2013 21st Iranian Conference on Electrical Engineering (ICEE).

[84]  Yongyi Yang,et al.  Computer-Aided Detection and Diagnosis of Breast Cancer With Mammography: Recent Advances , 2009, IEEE Transactions on Information Technology in Biomedicine.

[85]  R. Ledley,et al.  Reasoning foundations of medical diagnosis. , 1991, M.D. computing : computers in medical practice.

[86]  Ronald M. Summers,et al.  DeepPap: Deep Convolutional Networks for Cervical Cell Classification , 2017, IEEE Journal of Biomedical and Health Informatics.

[87]  Jin Wang,et al.  Training Convolutional Neural Networks with Multi-Size Images and Triplet Loss for Remote Sensing Scene Classification , 2020, Sensors.

[88]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[89]  Hao Chen,et al.  Automated Melanoma Recognition in Dermoscopy Images via Very Deep Residual Networks , 2017, IEEE Transactions on Medical Imaging.

[90]  Sung-Bae Cho,et al.  Cancer classification using ensemble of neural networks with multiple significant gene subsets , 2007, Applied Intelligence.

[91]  G. C. Nandi,et al.  Possibility theory based continuous Indian Sign Language gesture recognition , 2015, TENCON 2015 - 2015 IEEE Region 10 Conference.

[92]  M. Shamim Hossain,et al.  Cervical cancer classification using convolutional neural networks and extreme learning machines , 2020, Future Gener. Comput. Syst..

[93]  A. Madabhushi,et al.  Histopathological Image Analysis: A Review , 2009, IEEE Reviews in Biomedical Engineering.

[94]  A. Jemal,et al.  Higher Lung Cancer Incidence in Young Women Than Young Men in the United States , 2018, The New England journal of medicine.

[95]  Kun-Huang Chen,et al.  Applying particle swarm optimization-based decision tree classifier for cancer classification on gene expression data , 2014, Appl. Soft Comput..

[96]  Fatma E. Z. Abou-Chadi,et al.  Early Lung Cancer Detection using Deep Learning Optimization , 2020, Int. J. Online Biomed. Eng..

[97]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[98]  Maruf Pasha,et al.  Survey of Machine Learning Algorithms for Disease Diagnostic , 2017 .

[99]  T. Freer,et al.  Screening mammography with computer-aided detection: prospective study of 12,860 patients in a community breast center. , 2001, Radiology.

[100]  Ola Spjuth,et al.  Transfer Learning with Deep Convolutional Neural Networks for Classifying Cellular Morphological Changes , 2018, bioRxiv.

[101]  Gora Chand Nandi,et al.  Implementation of MFCC based hand gesture recognition on HOAP-2 using Webots platform , 2014, 2014 International Conference on Advances in Computing, Communications and Informatics (ICACCI).

[102]  Richard M. Karp,et al.  Reducibility Among Combinatorial Problems , 1972, 50 Years of Integer Programming.

[103]  N. Dubrawsky Cancer statistics , 1989, CA: a cancer journal for clinicians.

[104]  A. Bustamam,et al.  Analysis of Deep Feature Extraction for Colorectal Cancer Detection , 2020, 2020 4th International Conference on Informatics and Computational Sciences (ICICoS).

[105]  A. Fischer,et al.  Hematoxylin and eosin staining of tissue and cell sections. , 2008, CSH protocols.

[106]  Li Shen,et al.  Dimension reduction-based penalized logistic regression for cancer classification using microarray data , 2005, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[107]  Rob Fergus,et al.  Visualizing and Understanding Convolutional Networks , 2013, ECCV.

[108]  Gora Chand Nandi,et al.  A Speech Recognition Technique Using MFCC with DWT in Isolated Hindi Words , 2013, ICACNI.

[109]  Gora Chand Nandi,et al.  An efficient gesture based humanoid learning using wavelet descriptor and MFCC techniques , 2017, Int. J. Mach. Learn. Cybern..

[110]  C. Jack,et al.  Alzheimer's Disease Neuroimaging Initiative , 2008 .

[111]  John Papaioannou,et al.  Clinically missed cancer: how effectively can radiologists use computer-aided detection? , 2012, AJR. American journal of roentgenology.

[112]  Ayman M. Eldeib,et al.  Breast cancer classification using deep belief networks , 2016, Expert Syst. Appl..

[113]  Andrew A. Borkowski,et al.  Lung and Colon Cancer Histopathological Image Dataset (LC25000) , 2019, ArXiv.

[114]  Gora Chand Nandi,et al.  Development of a Framework for Human–Robot interactions with Indian Sign Language Using Possibility Theory , 2017, Int. J. Soc. Robotics.

[115]  Gora Chand Nandi,et al.  Visual perception-based criminal identification: a query-based approach , 2017, J. Exp. Theor. Artif. Intell..

[116]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[117]  G. C. Nandi,et al.  A MFCC based Hindi speech recognition technique using HTK Toolkit , 2013, 2013 IEEE Second International Conference on Image Information Processing (ICIIP-2013).

[118]  B. van Ginneken,et al.  Deep learning as a tool for increased accuracy and efficiency of histopathological diagnosis , 2016, Scientific Reports.

[119]  Nico Karssemeijer,et al.  Large scale deep learning for computer aided detection of mammographic lesions , 2017, Medical Image Anal..

[120]  Wei Xie,et al.  Accurate Cancer Classification Using Expressions of Very Few Genes , 2007, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[121]  R. Dikshit,et al.  Epidemiology of lung cancer in India: focus on the differences between non-smokers and smokers: a single-centre experience. , 2012, Indian journal of cancer.

[122]  Tuong Le,et al.  A Novel Framework for Trash Classification Using Deep Transfer Learning , 2019, IEEE Access.

[123]  G. Rossi,et al.  Lung cancer histology-driven strategic therapeutic approaches , 2020 .

[124]  Kai-Florian Richter,et al.  Understandable Collaborating Robot Teams , 2020, PAAMS.

[125]  Twan van Laarhoven,et al.  L2 Regularization versus Batch and Weight Normalization , 2017, ArXiv.

[126]  G. C. Nandi,et al.  Implementation and evaluation of DWT and MFCC based ISL gesture recognition , 2014, 2014 9th International Conference on Industrial and Information Systems (ICIIS).

[127]  R. Moynihan Preventing overdiagnosis: the myth, the music, and the medical meeting , 2015, BMJ : British Medical Journal.

[128]  Gora Chand Nandi,et al.  A rough set based reasoning approach for criminal identification , 2019, Int. J. Mach. Learn. Cybern..

[129]  J. Ferlay,et al.  Cancer statistics for the year 2020: An overview , 2021, International journal of cancer.

[130]  Wei Cao,et al.  Deep Learning based Radiomics (DLR) and its usage in noninvasive IDH1 prediction for low grade glioma , 2017, Scientific Reports.

[131]  Gora Chand Nandi,et al.  Human perception based criminal identification through human robot interaction , 2015, 2015 Eighth International Conference on Contemporary Computing (IC3).

[132]  Zhi-Hua Zhou,et al.  Improve Computer-Aided Diagnosis With Machine Learning Techniques Using Undiagnosed Samples , 2007, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.