Computer aided diagnosis of thyroid nodules based on the devised small-datasets multi-view ensemble learning

With the development of deep learning, its application in diagnosis of benign and malignant thyroid nodules has been widely concerned. However, it is difficult to obtain medical images, resulting in insufficient number of data, which contradicts the large amount of data required for acquiring effective deep learning diagnostic models. A multi-view ensemble learning based on voting mechanism is proposed herein to boost the performance of the models trained by small-dataset thyroid nodule ultrasound images. The method integrates three kinds of diagnosis results which are obtained from 3-view dataset which is composed of thyroid nodule ultrasound images, medical features extracted based on U-Net output and useful features selected by mRMR from the statistical features and texture features. To obtain preliminary diagnosis results, the images are utilized for training GoogleNet. For improving the results, supplementary methods were proposed based on the medical features and the selected features. To analyze the contribution of these features and acquire two groups of diagnosis results, the designed Xgboost classifier is utilized for obtaining two groups of features respectively. Subsequently, the boosting final results are obtained through majority voting mechanism. Furthermore, the proposed method is utilized to diagnose sequence images (the images extracted by frame from videos) to solve the poor results caused by slight differences. Finally, better final results are obtained for both of the normal dataset and the sequence dataset (consisting of sequence images). Compared with the accuracies obtained by only training deep learning models with small datasets, the diagnostic accuracies of the above two datasets are improved to 92.11% and 92.54% respectively by utilizing the proposed method.

[1]  Ramzi Guetari,et al.  Thyroid nodules classification and diagnosis in ultrasound images using fine‐tuning deep convolutional neural network , 2020, Int. J. Imaging Syst. Technol..

[2]  Fa Wu,et al.  Cascade convolutional neural networks for automatic detection of thyroid nodules in ultrasound images , 2017, Medical physics.

[3]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  Tianqi Chen,et al.  XGBoost: A Scalable Tree Boosting System , 2016, KDD.

[5]  Shuo Wang,et al.  Overview of deep learning , 2016, 2016 31st Youth Academic Annual Conference of Chinese Association of Automation (YAC).

[6]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[7]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Jing Yu,et al.  Classification of thyroid nodules in ultrasound images using deep model based transfer learning and hybrid features , 2017, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[9]  Takashi Matsubara,et al.  Data Augmentation Using Random Image Cropping and Patching for Deep CNNs , 2018, IEEE Transactions on Circuits and Systems for Video Technology.

[10]  Ching Y. Suen,et al.  Application of majority voting to pattern recognition: an analysis of its behavior and performance , 1997, IEEE Trans. Syst. Man Cybern. Part A.

[11]  R. Dhivya,et al.  Thyroid Nodule Classification in Medical Ultrasound Images , 2016, SoCPaR.

[12]  Juan Shan,et al.  Computer-Aided Diagnosis for Breast Ultrasound Using Computerized BI-RADS Features and Machine Learning Methods. , 2016, Ultrasound in medicine & biology.

[13]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[14]  Fuhui Long,et al.  Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy , 2003, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  M. Wilscy,et al.  Pretrained Convolutional Neural Networks as Feature Extractor for Image Splicing Detection , 2018, 2018 International Conference on Circuits and Systems in Digital Enterprise Technology (ICCSDET).

[16]  A. Samir,et al.  Machine learning for medical ultrasound: status, methods, and future opportunities , 2018, Abdominal Radiology.

[17]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[18]  Paul Babyn,et al.  Thyroid Nodule Classification in Ultrasound Images by Fine-Tuning Deep Convolutional Neural Network , 2017, Journal of Digital Imaging.

[19]  Igi Ardiyanto,et al.  Thyroid Nodule Classification Based on Characteristic of Margin using Geometric and Statistical Features , 2018, 2018 2nd International Conference on Biomedical Engineering (IBIOMED).

[20]  Ruey-Feng Chang,et al.  Automatic ultrasound segmentation and morphology based diagnosis of solid breast tumors , 2004, Breast Cancer Research and Treatment.

[21]  J. Bushberg The Essential Physics of Medical Imaging , 2001 .

[22]  Mary M. Galloway,et al.  Texture analysis using gray level run lengths , 1974 .

[23]  Dimitrios G Goulis,et al.  Thyroid nodules: Α guide to assessment, treatment and follow-up. , 2017, Maturitas.

[24]  Davide Contini,et al.  The LUCA project - Laser and Ultrasound Co-Analyzer for Thyroid Nodules: Overview and Current Status , 2018 .

[25]  A. Madabhushi,et al.  Histopathological Image Analysis: A Review , 2009, IEEE Reviews in Biomedical Engineering.

[26]  J Hong,et al.  GRAY LEVEL-GRADIENT COOCCURRENCE MATRIX TEXTURE ANALYSIS METHOD , 1984 .