Classification of Digital Pathological Images of Non-Hodgkin's Lymphoma Subtypes Based on the Fusion of Transfer Learning and Principal Component Analysis.

PURPOSE Non-Hodgkin's lymphoma (NHL) is a serious malignant disease. Delayed diagnosis will cause anemia, increased intracranial pressure, organ failure, and even lead to death. The current main trend in this area is to use deep learning (DL) for disease diagnosis. Extracting classification information from the digital pathology images by DL may realize the automated qualitative and quantitative analysis of NHL. Previously, DL has been used to classify NHL digital pathology images with some success. However, shortcomings still exist in the data preprocessing methods and feature extraction. Therefore, this paper presents a method for the classification of NHL subtypes based on the fusion of transfer learning (TL) and principal component analysis (PCA). METHODS First, the NHL digital pathology images were preprocessed by image division and segmentation and then input into the transfer models for fine-tuning and feature extraction. Second, PCA was used to map the extracted features. Finally, a neural network was used as a classifier to classify the mapped features. During the fine-tuning of the transfer models, two methods, freezing all feature extraction layers and fine-tuning all layers, were employed to select the optimal model with the best classification result among all the pre-selected transfer models. On this basis, the use of freezing the layers' location was discussed and analyzed. RESULTS The results show that the proposed method achieved average 5-fold cross-validation accuracies of 100%, 99.73%, and 99.20% for chronic lymphocytic leukemia (CLL), follicular lymphoma (FL), and mantle cell lymphoma tumor (MCL), and each category has standard deviations 0.00, 0.53, and 0.65, respectively, in the NHL reference dataset. The overall classification accuracy for 5-fold cross-validation is 98.93%, which is an increase of 1.26% compared to the latest reported methods, having a lower standard deviation (1.00). CONCLUSION The method proposed in this paper achieves a high classification accuracy and strong model generalization for the classification of NHL, which makes it possible to conduct intelligent classification of NHL in clinical practice. Our proposed method has definite clinical value and research significance.

[1]  Baiwei Mao,et al.  Ultra-Broadband Mode Converter Using Cascading Chirped Long-Period Fiber Grating , 2019, IEEE Photonics Journal.

[2]  Donghong Ji,et al.  Multi-task and multi-view training for end-to-end relation extraction , 2019, Neurocomputing.

[3]  Shih-Ming Jung,et al.  Physician supply and demand in anatomical pathology in Taiwan. , 2011, Journal of the Formosan Medical Association = Taiwan yi zhi.

[4]  Timothy R. Rebbeck,et al.  Oncologic Care and Pathology Resources in Africa: Survey and Recommendations. , 2016, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[5]  Hidetomo Ichihashi,et al.  Fuzzy PCA-Guided Robust $k$-Means Clustering , 2010, IEEE Transactions on Fuzzy Systems.

[6]  Liejun Wang,et al.  On OCT Image Classification via Deep Learning , 2019, IEEE Photonics Journal.

[7]  Daniel Riccio,et al.  A Deep Learning Approach for Breast Invasive Ductal Carcinoma Detection and Lymphoma Multi-Classification in Histological Images , 2019, IEEE Access.

[8]  Subhashini Venugopalan,et al.  Development and Validation of a Deep Learning Algorithm for Detection of Diabetic Retinopathy in Retinal Fundus Photographs. , 2016, JAMA.

[9]  Harold Varmus,et al.  Addressing the Growing International Challenge of Cancer: A Multinational Perspective , 2013, Science Translational Medicine.

[10]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[11]  Guowu Yang,et al.  An experimental study on breast lesion detection and classification from ultrasound images using deep learning architectures , 2019, BMC Medical Imaging.

[12]  Feng Li,et al.  Fully automated detection of retinal disorders by image-based deep learning , 2019, Graefe's Archive for Clinical and Experimental Ophthalmology.

[13]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Ronald M. Summers,et al.  Deep Convolutional Neural Networks for Computer-Aided Detection: CNN Architectures, Dataset Characteristics and Transfer Learning , 2016, IEEE Transactions on Medical Imaging.

[15]  Ian Magrath,et al.  Lymphomas in sub‐Saharan Africa – what can we learn and how can we help in improving diagnosis, managing patients and fostering translational research? , 2011, British journal of haematology.

[16]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[17]  S. Remick,et al.  AIDS-Related Non-Hodgkin's Lymphoma in Sub-Saharan Africa: Current Status and Realities of Therapeutic Approach. , 2012, Lymphoma.

[18]  Andrew Janowczyk,et al.  Deep learning for digital pathology image analysis: A comprehensive tutorial with selected use cases , 2016, Journal of pathology informatics.

[19]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[20]  Nico Karssemeijer,et al.  Large scale deep learning for computer aided detection of mammographic lesions , 2017, Medical Image Anal..

[21]  Cesar M. Castro,et al.  Design and clinical validation of a point-of-care device for the diagnosis of lymphoma via contrast-enhanced microholography and machine learning , 2018, Nature Biomedical Engineering.

[22]  Hui Li,et al.  Digital mammographic tumor classification using transfer learning from deep convolutional neural networks , 2016, Journal of medical imaging.

[23]  Ruijun Liu,et al.  A Survey of Sentiment Analysis Based on Transfer Learning , 2019, IEEE Access.

[24]  Shiliang Hu,et al.  A Transfer Learning Approach for Malignant Prostate Lesion Detection on Multiparametric MRI , 2019, Technology in cancer research & treatment.

[25]  Sebastian Thrun,et al.  Dermatologist-level classification of skin cancer with deep neural networks , 2017, Nature.