Breast ultrasound region of interest detection and lesion localisation

In current breast ultrasound computer aided diagnosis systems, the radiologist preselects a region of interest (ROI) as an input for computerised breast ultrasound image analysis. This task is time consuming and there is inconsistency among human experts. Researchers attempting to automate the process of obtaining the ROIs have been relying on image processing and conventional machine learning methods. We propose the use of a deep learning method for breast ultrasound ROI detection and lesion localisation. We use the most accurate object detection deep learning framework - Faster-RCNN with Inception-ResNet-v2 - as our deep learning network. Due to the lack of datasets, we use transfer learning and propose a new 3-channel artificial RGB method to improve the overall performance. We evaluate and compare the performance of our proposed methods on two datasets (namely, Dataset A and Dataset B), i.e. within individual datasets and composite dataset. We report the lesion detection results with two types of analysis: (1) detected point (centre of the segmented region or the detected bounding box) and (2) Intersection over Union (IoU). Our results demonstrate that the proposed methods achieved comparable results on detected point but with notable improvement on IoU. In addition, our proposed 3-channel artificial RGB method improves the recall of Dataset A. Finally, we outline some future directions for the research.

[1]  Hiroshi Fujita,et al.  Development of a fully automatic scheme for detection of masses in whole breast ultrasound images. , 2007, Medical physics.

[2]  Gerard Pons,et al.  Computerized detection of breast lesions using deformable part models in ultrasound images. , 2014, Ultrasound in medicine & biology.

[3]  Xianglong Tang,et al.  Fully automatic and segmentation-robust classification of breast tumors based on local texture analysis of ultrasound images , 2010, Pattern Recognit..

[4]  Neil D. Reeves,et al.  Fully convolutional networks for diabetic foot ulcer segmentation , 2017, 2017 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[5]  Manu Goyal,et al.  Breast ultrasound lesions recognition: end-to-end deep learning approaches , 2018, Journal of medical imaging.

[6]  Eran A. Edirisinghe,et al.  Object Boundary Detection in Ultrasound Images , 2006, The 3rd Canadian Conference on Computer and Robot Vision (CRV'06).

[7]  Eran A. Edirisinghe,et al.  Computer Aided Detection and Recognition of Lesions in Ultrasound Breast Images , 2010, Int. J. Comput. Model. Algorithms Medicine.

[8]  Pietro Perona,et al.  Microsoft COCO: Common Objects in Context , 2014, ECCV.

[9]  M. Giger,et al.  Computerized lesion detection on breast ultrasound. , 2002, Medical physics.

[10]  Reyer Zwiggelaar,et al.  Automated Breast Ultrasound Lesions Detection Using Convolutional Neural Networks , 2018, IEEE Journal of Biomedical and Health Informatics.

[11]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[12]  Sergey Ioffe,et al.  Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning , 2016, AAAI.

[13]  Moi Hoon Yap,et al.  Processed images in human perception: a case study in ultrasound breast imaging. , 2010, European journal of radiology.

[14]  Michael Galperin,et al.  Breast mass classification in sonography with transfer learning using a deep convolutional neural network and color conversion , 2019, Medical physics.

[15]  M. Giger,et al.  Computerized detection and classification of cancer on breast ultrasound. , 2004, Academic radiology.

[16]  Dar-Ren Chen,et al.  Breast cancer diagnosis using image retrieval for different ultrasonic systems , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[17]  Sergio Guadarrama,et al.  Speed/Accuracy Trade-Offs for Modern Convolutional Object Detectors , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Moi Hoon Yap,et al.  The effect of filtering algorithms for breast ultrasound lesions segmentation , 2018 .

[19]  Robert Marti,et al.  Feasibility Study of Lesion Detection Using Deformable Part Models in Breast Ultrasound Images , 2013, IbPRIA.

[20]  C. Lawrence Zitnick,et al.  Edge Boxes: Locating Object Proposals from Edges , 2014, ECCV.

[21]  K. Kelly,et al.  Breast cancer detection using automated whole breast ultrasound and mammography in radiographically dense breasts , 2009, European Radiology.

[22]  Manu Goyal,et al.  Robust Methods for Real-Time Diabetic Foot Ulcer Detection and Localization on Mobile Devices , 2019, IEEE Journal of Biomedical and Health Informatics.

[23]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[24]  Maryellen L. Giger,et al.  Automated seeded lesion segmentation on digital mammograms , 1998, IEEE Transactions on Medical Imaging.

[25]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[27]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[28]  Wilfrido Gómez-Flores,et al.  New Fully Automated Method for Segmentation of Breast Lesions on Ultrasound Based on Texture Analysis. , 2016, Ultrasound in medicine & biology.

[29]  Rebecca S Lewis,et al.  Diagnostic accuracy of mammography, clinical examination, US, and MR imaging in preoperative assessment of breast cancer. , 2004, Radiology.

[30]  B Huynh,et al.  MO-DE-207B-06: Computer-Aided Diagnosis of Breast Ultrasound Images Using Transfer Learning From Deep Convolutional Neural Networks. , 2016, Medical physics.

[31]  Ling Zhang,et al.  Automated breast cancer detection and classification using ultrasound images: A survey , 2015, Pattern Recognit..

[32]  Yuxuan Wang,et al.  Completely automated segmentation approach for breast ultrasound images using multiple-domain features. , 2012, Ultrasound in medicine & biology.

[33]  Moi Hoon Yap,et al.  A novel algorithm for initial lesion detection in ultrasound breast images , 2008, Journal of applied clinical medical physics.

[34]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.