Particle method for segmentation of breast tumors in ultrasound images

Abstract We propose a new segmentation method based on multiple walking particles (WP) bouncing from the image edges. The particles are able to segment objects characterized by deep concavities as narrow as one pixel and handle single or multiple objects characterized by a noisy background and broken boundaries (“weak edge”, “boundary leakage”). The particles are designed to segment the image by permanently staying inside the object and repairing the boundaries where necessary. The proposed WP combine the advantages of the continuous diffusion models with the principles of multi-agent systems. WP have been tested against recent active contours and the distance regularized level set method on a set of complex-shaped synthetic images and ultrasound (US) images of breast cancer ( http://onlinemedicalimages.com ). The method has also been compared with localizing region-based active contours, the fuzzy C-mean level set method, and morphological active contours. The WP are faster and more accurate for images characterized by low contrast, noise, broken boundaries, or boundary leakage. However, for good quality, simple shaped objects the WP work similarly to the conventional methods. There is still an important difference even in this case: the WP do not require initialization. A video demo of the algorithm is at https://drive.google.com/drive/folders/1SlTphINKtdUwvdjjxiakFrwI2dDlIUAU

[1]  Weibin Liu,et al.  An improved edge-based level set method combining local regional fitting information for noisy image segmentation , 2017, Signal Process..

[2]  Anthony J. Yezzi,et al.  Curve evolution implementation of the Mumford-Shah functional for image segmentation, denoising, interpolation, and magnification , 2001, IEEE Trans. Image Process..

[3]  Chandra Kambhamettu,et al.  Extraction and tracking of the tongue surface from ultrasound image sequences , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[4]  Bing Li,et al.  Active Contour External Force Using Vector Field Convolution for Image Segmentation , 2007, IEEE Transactions on Image Processing.

[5]  Masafumi Hagiwara,et al.  Image segmentation by artificial life approach using autonomous agents , 1999, IJCNN'99. International Joint Conference on Neural Networks. Proceedings (Cat. No.99CH36339).

[6]  Yuan Yan Tang,et al.  Adaptive Image Segmentation With Distributed Behavior-Based Agents , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Chunming Li,et al.  Segmentation of external force field for automatic initialization and splitting of snakes , 2005, Pattern Recognit..

[8]  Luis Álvarez,et al.  A Morphological Approach to Curvature-Based Evolution of Curves and Surfaces , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Wei Jia,et al.  An Intensity-Texture model based level set method for image segmentation , 2015, Pattern Recognit..

[10]  Jing Li,et al.  An adaptive-scale active contour model for inhomogeneous image segmentation and bias field estimation , 2018, Pattern Recognit..

[11]  Vijayakumar Chinnadurai,et al.  Neuro-levelset system based segmentation in dynamic susceptibility contrast enhanced and diffusion weighted magnetic resonance images , 2012, Pattern Recognit..

[12]  Yunde Jia,et al.  On the Critical Point of Gradient Vector Flow Snake , 2007, ACCV.

[13]  J. Sethian,et al.  FRONTS PROPAGATING WITH CURVATURE DEPENDENT SPEED: ALGORITHMS BASED ON HAMILTON-JACOB1 FORMULATIONS , 2003 .

[14]  Daniel Cremers,et al.  On the Statistical Interpretation of the Piecewise Smooth Mumford-Shah Functional , 2007, SSVM.

[15]  Zhen Ma,et al.  A Novel Approach to Segment Skin Lesions in Dermoscopic Images Based on a Deformable Model , 2016, IEEE Journal of Biomedical and Health Informatics.

[16]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[17]  Allan Hanbury,et al.  Metrics for evaluating 3D medical image segmentation: analysis, selection, and tool , 2015, BMC Medical Imaging.

[18]  Hadj Batatia,et al.  A general quasi-automatic initialization for snakes: application to ultrasound images , 2005, IEEE International Conference on Image Processing 2005.

[19]  Fabien Michel,et al.  An Agent-Based Approach for Range Image Segmentation , 2008, MMAS/LSMAS/CCMMS.

[20]  Zemin Ren,et al.  Adaptive active contour model driven by fractional order fitting energy , 2015, Signal Process..

[21]  Jitendra Malik,et al.  Scale-Space and Edge Detection Using Anisotropic Diffusion , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  Yuan Yan Tang,et al.  An evolutionary autonomous agents approach to image feature extraction , 1997, IEEE Trans. Evol. Comput..

[23]  Pong C. Yuen,et al.  Segmented snake for contour detection , 1998, Pattern Recognit..

[24]  Hayet Farida Merouani,et al.  Segmentation of Images based Cellular Automata-Reactive Agent Implemented in Netlogo Platform , 2012 .

[25]  Annupan Rodtook,et al.  Automatic initialization of active contours and level set method in ultrasound images of breast abnormalities , 2018, Pattern Recognit..

[26]  Carole Le Guyader,et al.  Extrapolation of Vector Fields Using the Infinity Laplacian and with Applications to Image Segmentation , 2009, SSVM.

[27]  Annupan Rodtook,et al.  Phase portrait analysis for automatic initialization of multiple snakes for segmentation of the ultrasound images of breast cancer , 2017, Pattern Analysis and Applications.

[28]  Chaw-Seng Woo,et al.  Medical image segmentation using a multi-agent system approach , 2013, Int. Arab J. Inf. Technol..

[29]  Qinghua Huang,et al.  Breast ultrasound image segmentation: a survey , 2017, International Journal of Computer Assisted Radiology and Surgery.

[30]  Annupan Rodtook,et al.  Multi-feature gradient vector flow snakes for adaptive segmentation of the ultrasound images of breast cancer , 2013, J. Vis. Commun. Image Represent..

[31]  Hong-Bin Shen,et al.  Saliency driven region-edge-based top down level set evolution reveals the asynchronous focus in image segmentation , 2018, Pattern Recognit..

[32]  Hadj Batatia,et al.  Quasi-automatic initialization for parametric active contours , 2010, Pattern Recognit. Lett..

[33]  Edouard Duchesnay Agents situés dans l'image et organisés en pyramide irrégulière: Contribution à la segmentation par une approche d'agrégation coopérative et adaptative. (Multi-agent system organized in an irregular Pyramid: Application for image segmentation) , 2001 .

[34]  Michael H. F. Wilkinson,et al.  Automatic Image Segmentation Using a Deformable Model Based on Charged Particles , 2004, ICIAR.

[35]  Bing Li,et al.  Automatic Active Model Initialization via Poisson Inverse Gradient , 2008, IEEE Transactions on Image Processing.

[36]  M. Giger,et al.  Computerized diagnosis of breast lesions on ultrasound. , 2002, Medical physics.

[37]  Tian Jie,et al.  An automatic active contour model for multiple objects , 2002, Object recognition supported by user interaction for service robots.

[38]  Jinshan Tang A multi-direction GVF snake for the segmentation of skin cancer images , 2009, Pattern Recognit..

[39]  Xuelong Li,et al.  Improving Level Set Method for Fast Auroral Oval Segmentation , 2014, IEEE Transactions on Image Processing.

[40]  Guillermo Sapiro,et al.  Geodesic Active Contours , 1995, International Journal of Computer Vision.

[41]  Sim Heng Ong,et al.  Integrating spatial fuzzy clustering with level set methods for automated medical image segmentation , 2011, Comput. Biol. Medicine.

[42]  Devang J. Doshi,et al.  Complex cystic breast masses: diagnostic approach and imaging-pathologic correlation. , 2007, Radiographics : a review publication of the Radiological Society of North America, Inc.

[43]  Yuanquan Wang,et al.  Harmonic gradient vector flow external force for snake model , 2008 .

[44]  Chunming Li,et al.  Implicit Active Contours Driven by Local Binary Fitting Energy , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[45]  Min Wei,et al.  A fast snake model based on non-linear diffusion for medical image segmentation. , 2004, Computerized medical imaging and graphics : the official journal of the Computerized Medical Imaging Society.

[46]  Devinder Thapa,et al.  Automatic Segmentation and Diagnosis of Breast Lesions Using Morphology Method Based on Ultrasound , 2005, FSKD.

[47]  Xavier Bresson,et al.  Efficient Algorithm for Level Set Method Preserving Distance Function , 2012, IEEE Transactions on Image Processing.

[48]  Say Wei Foo,et al.  Dynamic directional gradient vector flow for snakes , 2006, IEEE Transactions on Image Processing.

[49]  Catherine Garbay,et al.  Automated segmentation of human brain MR images using a multi-agent approach , 2004, Artif. Intell. Medicine.

[50]  V. Caselles,et al.  A geometric model for active contours in image processing , 1993 .

[51]  Christopher J. Taylor,et al.  A cooperative framework for segmentation of MRI brain scans , 2000, Artif. Intell. Medicine.

[52]  Chengke Wu,et al.  NGVF: An improved external force field for active contour model , 2007, Pattern Recognit. Lett..

[53]  Ling Zhang,et al.  Automated breast cancer detection and classification using ultrasound images: A survey , 2015, Pattern Recognit..

[54]  David A. Clausi,et al.  Hybrid structural and texture distinctiveness vector field convolution for region segmentation , 2014, Comput. Vis. Image Underst..

[55]  Jerry L. Prince,et al.  Generalized gradient vector flow external forces for active contours , 1998, Signal Process..

[56]  王慧斌,et al.  Fast and robust image segmentation with active contours and Student's-t mixture model , 2017 .

[57]  Shigang Liu,et al.  A local region-based Chan-Vese model for image segmentation , 2012, Pattern Recognit..

[58]  Stanislav S. Makhanov,et al.  Initialization of active contours for segmentation of breast cancer via fusion of ultrasound, Doppler, and elasticity images , 2017, Ultrasonics.

[59]  Yunde Jia,et al.  Adaptive diffusion flow active contours for image segmentation , 2013, Comput. Vis. Image Underst..

[60]  Chunming Li,et al.  Distance Regularized Level Set Evolution and Its Application to Image Segmentation , 2010, IEEE Transactions on Image Processing.

[61]  João Manuel R. S. Tavares,et al.  A Review on the Current Segmentation Algorithms for Medical Images , 2009, IMAGAPP.

[62]  D. Mumford,et al.  Optimal approximations by piecewise smooth functions and associated variational problems , 1989 .

[63]  S. Shenbaga Devi,et al.  Automatic seed point selection in ultrasound echography images of breast using texture features , 2015 .

[64]  Fei Xu,et al.  Automatic Breast Ultrasound Image Segmentation: A Survey , 2017, Pattern Recognit..

[65]  Chunming Li,et al.  Level set evolution without re-initialization: a new variational formulation , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[66]  Allen R. Tannenbaum,et al.  Localizing Region-Based Active Contours , 2008, IEEE Transactions on Image Processing.

[67]  Qiang Chen,et al.  Robust noise region-based active contour model via local similarity factor for image segmentation , 2017, Pattern Recognit..

[68]  Dimitris N. Metaxas,et al.  Combining low-, high-level and empirical domain knowledge for automated segmentation of ultrasonic breast lesions , 2003, IEEE Transactions on Medical Imaging.

[69]  Ning Situ,et al.  A narrow band graph partitioning method for skin lesion segmentation , 2009, Pattern Recognit..

[70]  Tony F. Chan,et al.  Active contours without edges , 2001, IEEE Trans. Image Process..

[71]  Xin Yang,et al.  Active contour model driven by local histogram fitting energy , 2013, Pattern Recognit. Lett..