Pulmonary nodule risk classification in adenocarcinoma from CT images using deep CNN with scale transfer module

Pulmonary nodules risk classification in adenocarcinoma is essential for early detection of lung cancer and clinical treatment decision. Improving the level of early diagnosis and the identification of small lung adenocarcinoma has been always an important topic for imaging studies. In this study, the authors propose a deep convolutional neural network (CNN) with scale-transfer module (STM) and incorporate multi-feature fusion operation, named STM-Net. This network can amplify small targets and adapt to different resolution images. The evaluation data were obtained from the computed tomography (CT) database provided by Zhongshan Hospital Fudan University (ZSDB). All data have a pathological label and their lung adenocarcinomas risk are classified into four categories: atypical adenomatous hyperplasia, adenocarcinoma in situ, minimally invasive adenocarcinoma, and invasive adenocarcinoma. The authors’ deep learning network STM-Net was trained and tested for the risk stage prediction. The accuracy and the average area under the receiver operating characteristic curve achieved by their method are 95.455% and 0.987 for the ZSDB dataset. The experimental results show that STM-Net largely boosts classification accuracy on the pulmonary nodules classification compared with state-of-the-art approaches. The proposed method will be an effective auxiliary to help physicians diagnosis pulmonary nodules risk classification in adenocarcinoma in early-stage.

[1]  Bram van Ginneken,et al.  Pulmonary Nodule Detection in CT Images: False Positive Reduction Using Multi-View Convolutional Networks , 2016, IEEE Transactions on Medical Imaging.

[2]  Richard Gran,et al.  On the Convergence of Random Search Algorithms In Continuous Time with Applications to Adaptive Control , 1970, IEEE Trans. Syst. Man Cybern..

[3]  Josef Kittler,et al.  Region growing: a new approach , 1998, IEEE Trans. Image Process..

[4]  Lianfang Tian,et al.  Automatic benign and malignant classification of pulmonary nodules in thoracic computed tomography based on RF algorithm , 2018, IET Image Process..

[5]  Y. Zhu,et al.  Automated Classification of Pulmonary Nodules for Lung Adenocarcinomas Risk Evaluation: An Effective CT Analysis by Clustering Density Distribution Algorithm , 2017 .

[6]  Şaban Öztürk,et al.  HIC-net: A deep convolutional neural network model for classification of histopathological breast images , 2019, Comput. Electr. Eng..

[7]  Anthony P. Reeves,et al.  Automated pulmonary nodule CT image characterization in lung cancer screening , 2015, International Journal of Computer Assisted Radiology and Surgery.

[8]  L. Schwartz,et al.  Segmentation of lung lesions on CT scans using watershed, active contours, and Markov random field. , 2013, Medical physics.

[9]  Richard A. Robb,et al.  Noninvasive Computed Tomography-based Risk Stratification of Lung Adenocarcinomas in the National Lung Screening Trial. , 2015, American journal of respiratory and critical care medicine.

[10]  Robert J. Gillies,et al.  Delta Radiomics Improves Pulmonary Nodule Malignancy Prediction in Lung Cancer Screening , 2018, IEEE Access.

[11]  Wei Shen,et al.  Multi-crop Convolutional Neural Networks for lung nodule malignancy suspiciousness classification , 2017, Pattern Recognit..

[12]  Wei Chen,et al.  Dense Convolutional Binary-Tree Networks for Lung Nodule Classification , 2018, IEEE Access.

[13]  Sakae Homma,et al.  Small lung tumors with the size of 1cm or less in diameter: clinical, radiological, and histopathological characteristics. , 2004, Lung cancer.

[14]  John Quackenbush,et al.  Somatic Mutations Drive Distinct Imaging Phenotypes in Lung Cancer. , 2017, Cancer research.

[15]  Bingbing Ni,et al.  3D Deep Learning from CT Scans Predicts Tumor Invasiveness of Subcentimeter Pulmonary Adenocarcinomas. , 2018, Cancer research.

[16]  Yu Zhu,et al.  Quantitative CT analysis of pulmonary nodules for lung adenocarcinoma risk classification based on an exponential weighted grey scale angular density distribution feature , 2018, Comput. Methods Programs Biomed..

[17]  Yu Zhu,et al.  Hierarchical CNN-based real-time fatigue detection system by visual-based technologies using MSP model , 2018, IET Image Process..

[18]  S. Mukhopadhyay,et al.  Computer-aided Detection and Analysis of Pulmonary Nodule from CT Images: A Survey , 2012 .

[19]  Rodney W. Johnson,et al.  Axiomatic derivation of the principle of maximum entropy and the principle of minimum cross-entropy , 1980, IEEE Trans. Inf. Theory.

[20]  Patrick Granton,et al.  Radiomics: extracting more information from medical images using advanced feature analysis. , 2012, European journal of cancer.

[21]  Kunio Doi,et al.  Computer-aided diagnosis in medical imaging: Historical review, current status and future potential , 2007, Comput. Medical Imaging Graph..

[22]  Brian J. Bartholmai,et al.  Computer-Aided Nodule Assessment and Risk Yield (CANARY) may facilitate non-invasive prediction of EGFR mutation status in lung adenocarcinomas , 2017, Scientific Reports.

[23]  Jianhua Li,et al.  Agile convolutional neural network for pulmonary nodule classification using CT images , 2018, International Journal of Computer Assisted Radiology and Surgery.

[24]  Jin Mo Goo,et al.  Ground-glass nodules on chest CT as imaging biomarkers in the management of lung adenocarcinoma. , 2011, AJR. American journal of roentgenology.

[25]  Farzad Khalvati,et al.  Radiomics analysis at PET/CT contributes to prognosis of recurrence and survival in lung cancer treated with stereotactic body radiotherapy , 2018, Scientific Reports.

[26]  Bram van Ginneken,et al.  Automatic detection of subsolid pulmonary nodules in thoracic computed tomography images , 2014, Medical Image Anal..

[27]  A. Nicholson,et al.  The IASLC Lung Cancer Staging Project: Proposals for Coding T Categories for Subsolid Nodules and Assessment of Tumor Size in Part‐Solid Tumors in the Forthcoming Eighth Edition of the TNM Classification of Lung Cancer , 2016, Journal of thoracic oncology : official publication of the International Association for the Study of Lung Cancer.

[28]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.