Lymph Node Metastasis Classification Based on Semi-Supervised Multi-View Network

Lymphatic metastasis is one of the most common proliferation pathways of thyroid carcinoma. Accurate diagnosis of lymph nodes is of great significance to surgical planning and prognosis. Due to the continuous development of deep learning recently, computer-aided diagnosis (CAD) systems for thyroid cancer have made considerable progress, but the research on the effective diagnosis of lymphatic metastasis remains insufficient. Focusing on this issue, we propose a semi-supervised multi-view network to diagnose lymph node metastasis, which combines coarse-view and fine-view to obtain a more comprehensive description. This method consists of three parts as follows: 1) joint probabilistic labels of the nodule partition information are generated by fuzzy clustering and perform semi-supervised learning on coarse-view with real labels; 2) an attention mechanism based network for fine-view is designed to capture various differentiated local features in a pyramid manner; 3) the two parts are then combined to extract global and local features more effectively to derive more accurate diagnostic reasoning. Especially, the introduction of fuzzy logic greatly reduces the impact of the uncertainty of the generated labels, thereby ensuring the effectiveness of the pseudo-labels. Extensive experiments on our collected dataset demonstrate that the proposed method is more efficient than other state-of-the-art methods.

[1]  Yasuhiro Ito,et al.  Clinical Significance of Lymph Node Metastasis of Thyroid Papillary Carcinoma Located in One Lobe , 2006, World Journal of Surgery.

[2]  Jie Yang,et al.  Thyroid Nodule Ultrasound Image Classification Through Hybrid Feature Cropping Network , 2020, IEEE Access.

[3]  Chuan-Yu Chang,et al.  Applying the Particle Swarm Optimization and Boltzmann Function for Feature Selection and Classification of Lymph Node in Ultrasound Images , 2008, 2008 Eighth International Conference on Intelligent Systems Design and Applications.

[4]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[5]  Gabriel Maicas,et al.  Semi-Supervised Multi-Domain Multi-Task Training for Metastatic Colon Lymph Node Diagnosis from Abdominal CT , 2020, 2020 IEEE 17th International Symposium on Biomedical Imaging (ISBI).

[6]  Savita Gupta,et al.  Computer-Aided Diagnosis of Thyroid Nodule: A Review , 2012 .

[7]  Dong Ni,et al.  Deep Learning in Medical Ultrasound Analysis: A Review , 2019, Engineering.

[8]  François Chollet,et al.  Xception: Deep Learning with Depthwise Separable Convolutions , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Mark Sandler,et al.  MobileNetV2: Inverted Residuals and Linear Bottlenecks , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[10]  Ronald M. Summers,et al.  A Semi-Supervised CNN Learning Method with Pseudo-class Labels for Atherosclerotic Vascular Calcification Detection , 2019, 2019 IEEE 16th International Symposium on Biomedical Imaging (ISBI 2019).

[11]  W. T. Tucker,et al.  Convergence theory for fuzzy c-means: Counterexamples and repairs , 1987, IEEE Transactions on Systems, Man, and Cybernetics.

[12]  A. Shaha,et al.  Thyroid carcinoma , 1998, Cancer.

[13]  Koichi Ito,et al.  Lymph Node Metastasis From 259 Papillary Thyroid Microcarcinomas: Frequency, Pattern of Occurrence and Recurrence, and Optimal Strategy for Neck Dissection , 2003, Annals of surgery.

[14]  Agnieszka Witkowska,et al.  A Review on Ultrasound-Based Thyroid Cancer Tissue Characterization and Automated Classification , 2014, Technology in cancer research & treatment.

[15]  Á. Barroso,et al.  Ultrasonographic Differentiation Between Metastatic and Benign Lymph Nodes in Patients With Papillary Thyroid Carcinoma , 2005, Journal of ultrasound in medicine : official journal of the American Institute of Ultrasound in Medicine.

[16]  A. Kawaoi,et al.  Multiple thyroid involvement (intraglandular metastasis) in papillary thyroid carcinoma. A clinicopathologic study of 105 consecutive patients , 1992, Cancer.

[17]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Chunfeng Lian,et al.  Automated detection and classification of thyroid nodules in ultrasound images using clinical-knowledge-guided convolutional neural networks , 2019, Medical Image Anal..

[19]  Vidya K. Sudarshan,et al.  Automated Identification of Infarcted Myocardium Tissue Characterization Using Ultrasound Images: A Review , 2015, IEEE Reviews in Biomedical Engineering.

[20]  J. Bezdek,et al.  FCM: The fuzzy c-means clustering algorithm , 1984 .

[21]  Ronald M. Summers,et al.  Deep Convolutional Neural Networks for Computer-Aided Detection: CNN Architectures, Dataset Characteristics and Transfer Learning , 2016, IEEE Transactions on Medical Imaging.

[22]  E. A. Nurminskii Convergence conditions for nonlinear programming algorithms , 1972 .

[23]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[24]  Jia Deng,et al.  Stacked Hourglass Networks for Human Pose Estimation , 2016, ECCV.

[25]  Xiaolan Tang,et al.  Breast Ultrasound Image Classification and Segmentation Using Convolutional Neural Networks , 2018, PCM.

[26]  Catarina Eloy,et al.  Classification of breast cancer histology images using Convolutional Neural Networks , 2017, PloS one.

[27]  U. Rajendra Acharya,et al.  Automated benign & malignant thyroid lesion characterization and classification in 3D contrast-enhanced ultrasound , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.