Automated thyroid nodule detection from ultrasound imaging using deep convolutional neural networks

Thyroid cancer is the most common endocrine cancer and its incidence has continuously increased worldwide. In this paper, we focus on the challenging problem of nodule detection from ultrasound scans. In current clinical practice, this task is performed manually, which is tedious, subjective and highly depends on the clinical experience of radiologists. We propose a novel deep neural network architecture with carefully designed loss function regularization, and network hyperparameters to perform nodule detection without complex post-processing refinement steps. The local training and validation datasets consist of 2461 and 820 ultrasound frames acquired from 60 and 20 patients with a high degree of variability, respectively. The core of the proposed method is a deep learning framework based on multi-task model Mask R-CNN. We have developed a loss function with regularization that prioritizes detection over segmentation. Validation was conducted for 821 ultrasound frames from 20 patients. The proposed model can detect various types of thyroid nodules. The experimental results indicate that our proposed method is effective in thyroid nodule detection. Comparisons with the results by Faster R-CNN and conventional Mask R-CNN demonstrate that the proposed model outperforms the prior state-of-the-art detection methods.

[1]  S. Mandel,et al.  2015 American Thyroid Association Management Guidelines for Adult Patients with Thyroid Nodules and Differentiated Thyroid Cancer: The American Thyroid Association Guidelines Task Force on Thyroid Nodules and Differentiated Thyroid Cancer. , 2009, Thyroid : official journal of the American Thyroid Association.

[2]  M. Gurcan,et al.  Diagnosis of thyroid cancer using deep convolutional neural network models applied to sonographic images: a retrospective, multicohort, diagnostic study. , 2019, The Lancet. Oncology.

[3]  Hui Li,et al.  Digital mammographic tumor classification using transfer learning from deep convolutional neural networks , 2016, Journal of medical imaging.

[4]  Joongseek Lee,et al.  Ultrasound image analysis using deep learning algorithm for the diagnosis of thyroid nodules , 2019, Medicine.

[5]  Tao Jiang,et al.  Computer-aided diagnosis of malignant or benign thyroid nodes based on ultrasound images , 2017, European Archives of Oto-Rhino-Laryngology.

[6]  Pietro Perona,et al.  Microsoft COCO: Common Objects in Context , 2014, ECCV.

[7]  Weiwei Liu,et al.  An improved deep learning approach for detection of thyroid papillary cancer in ultrasound images , 2018, Scientific Reports.

[8]  F. Frasca,et al.  Worldwide Increasing Incidence of Thyroid Cancer: Update on Epidemiology and Risk Factors , 2013, Journal of cancer epidemiology.

[9]  Xiongwei Wu,et al.  Recent Advances in Deep Learning for Object Detection , 2019, Neurocomputing.

[10]  Savita Gupta,et al.  Neutrosophic Based Nakagami Total Variation Method for Speckle Suppression in Thyroid Ultrasound Images , 2017 .

[11]  F. Ouyang,et al.  Comparison between linear and nonlinear machine-learning algorithms for the classification of thyroid nodules. , 2019, European journal of radiology.

[12]  Chunfeng Lian,et al.  Automated detection and classification of thyroid nodules in ultrasound images using clinical-knowledge-guided convolutional neural networks , 2019, Medical Image Anal..

[13]  Savita Gupta,et al.  Automated delineation of thyroid nodules in ultrasound images using spatial neutrosophic clustering and level set , 2016, Appl. Soft Comput..

[14]  Dong Gyu Na,et al.  Impact of Nodule Size on Malignancy Risk Differs according to the Ultrasonography Pattern of Thyroid Nodules , 2018, Korean journal of radiology.

[15]  Savita Gupta,et al.  Computer aided thyroid nodule detection system using medical ultrasound images , 2018, Biomed. Signal Process. Control..

[16]  Joel E. W. Koh,et al.  Thyroid lesion classification in 242 patient population using Gabor transform features from high resolution ultrasound images , 2016, Knowl. Based Syst..

[17]  A. Jemal,et al.  Cancer statistics, 2019 , 2019, CA: a cancer journal for clinicians.

[18]  Dumitru Erhan,et al.  Deep Neural Networks for Object Detection , 2013, NIPS.

[19]  Recinda L. Sherman,et al.  Annual Report to the Nation on the Status of Cancer, 1975–2014, Featuring Survival , 2017, Journal of the National Cancer Institute.

[20]  Aimin Hao,et al.  Multitask Cascade Convolution Neural Networks for Automatic Thyroid Nodule Detection and Recognition , 2019, IEEE Journal of Biomedical and Health Informatics.

[21]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[22]  Sudhish N. George,et al.  Ultrasound image despeckling using low rank matrix approximation approach , 2017, Biomed. Signal Process. Control..

[23]  Xindong Wu,et al.  Object Detection With Deep Learning: A Review , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[24]  Jing Yu,et al.  Classification of thyroid nodules in ultrasound images using deep model based transfer learning and hybrid features , 2017, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[25]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[26]  M. Mazurowski,et al.  Management of Thyroid Nodules Seen on US Images: Deep Learning May Match Performance of Radiologists. , 2019, Radiology.

[27]  J. Dickinson,et al.  Thyroid cancer incidence in Canada: a national cancer registry analysis. , 2017, CMAJ open.

[28]  Paolo Vitti,et al.  AMERICAN ASSOCIATION OF CLINICAL ENDOCRINOLOGISTS, AMERICAN COLLEGE OF ENDOCRINOLOGY, AND ASSOCIAZIONE MEDICI ENDOCRINOLOGI MEDICAL GUIDELINES FOR CLINICAL PRACTICE FOR THE DIAGNOSIS AND MANAGEMENT OF THYROID NODULES--2016 UPDATE. , 2016, Endocrine practice : official journal of the American College of Endocrinology and the American Association of Clinical Endocrinologists.

[29]  Paul Babyn,et al.  Thyroid Nodule Classification in Ultrasound Images by Fine-Tuning Deep Convolutional Neural Network , 2017, Journal of Digital Imaging.

[30]  Ting Liu,et al.  Recent advances in convolutional neural networks , 2015, Pattern Recognit..

[31]  Bo Chen,et al.  MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications , 2017, ArXiv.

[32]  William D Middleton,et al.  ACR Thyroid Imaging, Reporting and Data System (TI-RADS): White Paper of the ACR TI-RADS Committee. , 2018, Journal of the American College of Radiology : JACR.

[33]  Fa Wu,et al.  Cascade convolutional neural networks for automatic detection of thyroid nodules in ultrasound images , 2017, Medical physics.

[34]  Dong Gyu Na,et al.  Ultrasonography Diagnosis and Imaging-Based Management of Thyroid Nodules: Revised Korean Society of Thyroid Radiology Consensus Statement and Recommendations , 2016, Korean journal of radiology.

[35]  Zhuang Fu,et al.  An image augmentation method using convolutional network for thyroid nodule classification by transfer learning , 2017, 2017 3rd IEEE International Conference on Computer and Communications (ICCC).

[36]  Eun-Kyung Kim,et al.  Deep convolutional neural network for the diagnosis of thyroid nodules on ultrasound , 2019, Head & neck.

[37]  Daniel Smutek,et al.  Patch-based classification of thyroid nodules in ultrasound images using direction independent features extracted by two-threshold binary decomposition , 2019, Comput. Medical Imaging Graph..

[38]  Shujian Yang,et al.  Automatic thyroid nodule recognition and diagnosis in ultrasound imaging with the YOLOv2 neural network , 2019, World Journal of Surgical Oncology.

[39]  Ankita Pramanik,et al.  Deep Learning Techniques—R-CNN to Mask R-CNN: A Survey , 2019, Computational Intelligence in Pattern Recognition.

[40]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.