Deep classification of breast cancer in ultrasound images: more classes, better results with multi-task learning

Ultrasound (US) is a low-cost, portable, and safe tool for breast cancer screening. However, automatic classification of invasive ductal carcinoma (IDC) in US is a difficult classification task due to their similar appearance to fibroadenoma (FA) (a type of benign tumor). Another challenge is the limited availability of US data with ground truth labels, further complicating the adoption of deep learning techniques for IDC detection. It has been shown that deep classification networks perform better when they simultaneously learn multiple correlated tasks. However, most previous studies on breast US classifications focused on the binary classification of benign versus malignant tumors. To this end, we propose a multi-class classification deep learning-based strategy mainly focusing on the classification of IDC. Inspired by multi-task learning (MTL), we adopt a novel scheme in adding the background tissue as an additional class and show substantial improvements in IDC detection.

[1]  Reyer Zwiggelaar,et al.  Automated Breast Ultrasound Lesions Detection Using Convolutional Neural Networks , 2018, IEEE Journal of Biomedical and Health Informatics.

[2]  Leslie N. Smith,et al.  Cyclical Learning Rates for Training Neural Networks , 2015, 2017 IEEE Winter Conference on Applications of Computer Vision (WACV).

[3]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[4]  Heng-Da Cheng,et al.  Breast Ultrasound Image Classification Based on Multiple-Instance Learning , 2012, Journal of Digital Imaging.

[5]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[6]  Purang Abolmaesumi,et al.  Ultrasound RF Time Series for Classification of Breast Lesions , 2015, IEEE Transactions on Medical Imaging.

[7]  Kok-Swee Sim,et al.  Convolutional neural network improvement for breast cancer classification , 2019, Expert Syst. Appl..

[8]  Seokmin Han,et al.  A deep learning framework for supporting the classification of breast lesions in ultrasound images , 2017, Physics in medicine and biology.

[9]  Zhang Yi,et al.  Automated diagnosis of breast ultrasonography images using deep neural networks , 2019, Medical Image Anal..

[10]  Sebastian Ruder,et al.  An Overview of Multi-Task Learning in Deep Neural Networks , 2017, ArXiv.

[11]  Ling Zhang,et al.  Automated breast cancer detection and classification using ultrasound images: A survey , 2015, Pattern Recognit..

[12]  Hassan Rivaz,et al.  A Pilot Study on Scatterer Density Classification of Ultrasound Images Using Deep Neural Networks , 2020, 2020 42nd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC).

[13]  Il Dong Yun,et al.  Joint Weakly and Semi-Supervised Deep Learning for Localization and Classification of Masses in Breast Ultrasound Images , 2017, IEEE Transactions on Medical Imaging.

[14]  Michael Galperin,et al.  Breast mass classification in sonography with transfer learning using a deep convolutional neural network and color conversion , 2019, Medical physics.

[15]  A. Boss,et al.  Classification of breast cancer in ultrasound imaging using a generic deep learning analysis software: a pilot study. , 2017, The British journal of radiology.

[16]  Wagner Coelho A. Pereira,et al.  Analysis of Co-Occurrence Texture Statistics as a Function of Gray-Level Quantization for Classifying Breast Ultrasound , 2012, IEEE Transactions on Medical Imaging.

[17]  Jeon-Hor Chen,et al.  Robust Texture Analysis Using Multi-Resolution Gray-Scale Invariant Features for Breast Sonographic Tumor Diagnosis , 2013, IEEE Transactions on Medical Imaging.

[18]  Hassan Rivaz,et al.  Two-stage ultrasound image segmentation using U-Net and test time augmentation , 2020, International Journal of Computer Assisted Radiology and Surgery.