Segmentation of breast ultrasound image with semantic classification of superpixels

Breast cancer is a great threat to females. Ultrasound imaging has been applied extensively in diagnosis of breast cancer. Due to the poor image quality, segmentation of breast ultrasound (BUS) image remains a very challenging task. Besides, BUS image segmentation is a crucial step for further analysis. In this paper, we proposed a novel method to segment the breast tumor via semantic classification and merging patches. The proposed method firstly selects two diagonal points to crop a region of interest (ROI) on the original image. Then, histogram equalization, bilateral filter and pyramid mean shift filter are adopted to enhance the image. The cropped image is divided into many superpixels using simple linear iterative clustering (SLIC). Furthermore, some features are extracted from the superpixels and a bag-of-words model can be created. The initial classification can be obtained by a back propagation neural network (BPNN). To refine preliminary result, k-nearest neighbor (KNN) is used for reclassification and the final result is achieved. To verify the proposed method, we collected a BUS dataset containing 320 cases. The segmentation results of our method have been compared with the corresponding results obtained by five existing approaches. The experimental results show that our method achieved competitive results compared to conventional methods in terms of TP and FP, and produced good approximations to the hand-labelled tumor contours with comprehensive consideration of all metrics (the F1-score = 89.87% ± 4.05%, and the average radial error = 9.95% ± 4.42%).

[1]  Ling Zhang,et al.  A Fully Automatic Image Segmentation Using an Extended Fuzzy Set , 2011 .

[2]  Xuelong Li,et al.  A Novel Segmentation Approach Combining Region- and Edge-Based Information for Ultrasound Images , 2017, BioMed research international.

[3]  Liang Gao,et al.  Phase- and GVF-Based Level Set Segmentation of Ultrasonic Breast Tumors , 2012, J. Appl. Math..

[4]  Mario Ceresa,et al.  Fully automatic detection and segmentation of abdominal aortic thrombus in post‐operative CTA images using Deep Convolutional Neural Networks , 2018, Medical Image Anal..

[5]  Yong Fan,et al.  A deep learning model integrating FCNNs and CRFs for brain tumor segmentation , 2017, Medical Image Anal..

[6]  Xianglong Tang,et al.  Multiple-domain knowledge based MRF model for tumor segmentation in breast ultrasound images , 2012, 2012 19th IEEE International Conference on Image Processing.

[7]  P. Wells,et al.  Speckle in ultrasonic imaging , 1981 .

[8]  Xinjian Chen,et al.  Automatic Pathological Lung Segmentation in Low-Dose CT Image Using Eigenspace Sparse Shape Composition , 2019, IEEE Transactions on Medical Imaging.

[9]  A. Jemal,et al.  Cancer statistics, 2018 , 2018, CA: a cancer journal for clinicians.

[10]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[12]  Gabriela Csurka,et al.  Visual categorization with bags of keypoints , 2002, eccv 2004.

[13]  R. Chang,et al.  Tumor detection in automated breast ultrasound images using quantitative tissue clustering. , 2014, Medical physics.

[14]  Viksit Kumar,et al.  Automated and real-time segmentation of suspicious breast masses using convolutional neural network , 2018, PloS one.

[15]  Xuelong Li,et al.  Optimized graph-based segmentation for ultrasound images , 2014, Neurocomputing.

[16]  Xuelong Li,et al.  High-Order Energies for Stereo Segmentation , 2016, IEEE Transactions on Cybernetics.

[17]  Xuelong Li,et al.  Co-occurrence matching of local binary patterns for improving visual adaption and its application to smoke recognition , 2018, IET Comput. Vis..

[18]  Zhang Yi,et al.  Automated diagnosis of breast ultrasonography images using deep neural networks , 2019, Medical Image Anal..

[19]  Pascal Fua,et al.  SLIC Superpixels Compared to State-of-the-Art Superpixel Methods , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Lubomir M. Hadjiiski,et al.  Malignant and benign breast masses on 3D US volumetric images: effect of computer-aided diagnosis on radiologist accuracy. , 2007, Radiology.

[21]  Fei Xu,et al.  Neutro-Connectedness Cut , 2015, IEEE Transactions on Image Processing.

[22]  A. Jemal,et al.  Cancer Statistics, 2010 , 2010, CA: a cancer journal for clinicians.

[23]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[24]  Michael Elad,et al.  On the origin of the bilateral filter and ways to improve it , 2002, IEEE Trans. Image Process..

[25]  Richard O. Duda,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.

[26]  Min Xian,et al.  A Fully Automatic Breast Ultrasound Image Segmentation Approach Based on Neutro-Connectedness , 2014, 2014 22nd International Conference on Pattern Recognition.

[27]  Matti Pietikäinen,et al.  A comparative study of texture measures with classification based on featured distributions , 1996, Pattern Recognit..

[28]  Dacheng Tao,et al.  On Combining Biclustering Mining and AdaBoost for Breast Tumor Classification , 2020, IEEE Transactions on Knowledge and Data Engineering.

[29]  Fan Zhang,et al.  Evolutionary optimized fuzzy reasoning with mined diagnostic patterns for classification of breast tumors in ultrasound , 2019, Inf. Sci..

[30]  Jayaram K. Udupa,et al.  Methodology for evaluating image-segmentation algorithms , 2002, SPIE Medical Imaging.

[31]  Qinghua Huang,et al.  Breast ultrasound image segmentation: a survey , 2017, International Journal of Computer Assisted Radiology and Surgery.

[32]  Keiichi Abe,et al.  Topological structural analysis of digitized binary images by border following , 1985, Comput. Vis. Graph. Image Process..

[33]  Xuelong Li,et al.  Automatic segmentation of breast lesions for interaction in ultrasonic computer-aided diagnosis , 2015, Inf. Sci..

[34]  Chunming Li,et al.  Distance Regularized Level Set Evolution and Its Application to Image Segmentation , 2010, IEEE Transactions on Image Processing.

[35]  Michal Strzelecki,et al.  Texture Analysis Methods - A Review , 1998 .

[36]  Tianfu Wang,et al.  Semi-automatic Breast Ultrasound Image Segmentation Based on Mean Shift and Graph Cuts , 2014, Ultrasonic imaging.

[37]  Dorin Comaniciu,et al.  Mean shift analysis and applications , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[38]  Xuelong Li,et al.  Graph-based learning for segmentation of 3D ultrasound images , 2015, Neurocomputing.

[39]  Michael Brady,et al.  Segmentation of ultrasound B-mode images with intensity inhomogeneity correction , 2002, IEEE Transactions on Medical Imaging.

[40]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[41]  Lian-Wen Jin,et al.  A robust graph-based segmentation method for breast tumors in ultrasound images. , 2012, Ultrasonics.

[42]  Yuxuan Wang,et al.  Completely automated segmentation approach for breast ultrasound images using multiple-domain features. , 2012, Ultrasound in medicine & biology.

[43]  Fei Xu,et al.  Automatic Breast Ultrasound Image Segmentation: A Survey , 2017, Pattern Recognit..

[44]  Anjan Biswas,et al.  Optimization of breast lesion segmentation in texture feature space approach. , 2014, Medical engineering & physics.

[45]  Xuelong Li,et al.  A case-oriented web-based training system for breast cancer diagnosis , 2018, Comput. Methods Programs Biomed..