Anatomical Structure Segmentation in Ultrasound Volumes Using Cross Frame Belief Propagating Iterative Random Walks

Ultrasound (US) is widely used as a low-cost alternative to computed tomography or magnetic resonance and primarily for preliminary imaging. Since speckle intensity in US images is inherently stochastic, readers are often challenged in their ability to identify the pathological regions in a volume of a large number of images. This paper introduces a generalized approach for volumetric segmentation of structures in US images and volumes. We employ an iterative random walks (IRW) solver, a random forest learning model, and a gradient vector flow (GVF) based interframe belief propagation technique for achieving cross-frame volumetric segmentation. At the start, a weak estimate of the tissue structure is obtained using estimates of parameters of a statistical mechanics model of US tissue interaction. Ensemble learning of these parameters further using a random forest is used to initialize the segmentation pipeline. IRW is used for correcting the contour in various steps of the algorithm. Subsequently, a GVF-based interframe belief propagation is applied to adjacent frames based on the initialization of contour using information in the current frame to segment the complete volume by frame-wise processing. We have experimentally evaluated our approach using two different datasets. Intravascular ultrasound (IVUS) segmentation was evaluated using 10 pullbacks acquired at 20 MHz and thyroid US segmentation is evaluated on 16 volumes acquired at <inline-formula><tex-math notation="LaTeX">$\text{11}\text{--}\text{16}$</tex-math></inline-formula> MHz. Our approach obtains a Jaccard score of <inline-formula><tex-math notation="LaTeX">$\text{0.937} \pm \text{0.022}$</tex-math></inline-formula> for IVUS segmentation and <inline-formula><tex-math notation="LaTeX">$\text{0.908} \pm \text{0.028}$</tex-math></inline-formula> for thyroid segmentation while processing each frame in <inline-formula><tex-math notation="LaTeX">$\text{1.15} \pm \text{0.05}\;\text{s}$</tex-math></inline-formula> for the IVUS and in <inline-formula><tex-math notation="LaTeX">$\text{1.23} \pm \text{0.27}\;\text{s}$</tex-math></inline-formula> for thyroid segmentation without the need of any computing accelerators such as GPUs.

[1]  J A Noble,et al.  Ultrasound image segmentation and tissue characterization , 2010, Proceedings of the Institution of Mechanical Engineers. Part H, Journal of engineering in medicine.

[2]  Dimitrios K. Iakovidis,et al.  Efficient and Effective Ultrasound Image Analysis Scheme for Thyroid Nodule Detection , 2007, ICIAR.

[3]  Christian Hansen,et al.  Comparison of thyroid segmentation techniques for 3D ultrasound , 2017, Medical Imaging.

[4]  Pina Marziliano,et al.  Speckle Patch Similarity for Echogenicity-Based Multiorgan Segmentation in Ultrasound Images of the Thyroid Gland , 2017, IEEE Journal of Biomedical and Health Informatics.

[5]  D. Vince,et al.  Evaluation of three-dimensional segmentation algorithms for the identification of luminal and medial-adventitial borders in intravascular ultrasound images , 2000, IEEE Transactions on Medical Imaging.

[6]  Pabitra Mitra,et al.  Segmentation of Lumen and External Elastic Laminae in Intravascular Ultrasound Images Using Ultrasonic Backscattering Physics Initialized Multiscale Random Walks , 2016, ICVGIP Workshops.

[7]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[8]  Chandan Chakraborty,et al.  Automated in vivo delineation of lumen wall using intravascular ultrasound imaging , 2016, 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[9]  E. Gerardo Mendizabal-Ruiz,et al.  Segmentation of the luminal border in intravascular ultrasound B-mode images using a probabilistic approach , 2013, Medical Image Anal..

[10]  Alka Jindal,et al.  Segmentation of thyroid gland in ultrasound image using neural network , 2013, 2013 Fourth International Conference on Computing, Communications and Networking Technologies (ICCCNT).

[11]  Seyed Kamaledin Setarehdan,et al.  Automatic media-adventitia IVUS image segmentation based on sparse representation framework and dynamic directional active contour model , 2017, Comput. Biol. Medicine.

[12]  Nikos Dimitropoulos,et al.  Variable Background Active Contour Model for Computer-Aided Delineation of Nodules in Thyroid Ultrasound Images , 2007, IEEE Transactions on Information Technology in Biomedicine.

[13]  Milan Sonka,et al.  Graph-Based IVUS Segmentation With Efficient Computer-Aided Refinement , 2013, IEEE Transactions on Medical Imaging.

[14]  Nassir Navab,et al.  Joint learning of ultrasonic backscattering statistical physics and signal confidence primal for characterizing atherosclerotic plaques using intravascular ultrasound , 2014, Medical Image Anal..

[15]  Chuan-Yu Chang,et al.  Thyroid segmentation and volume estimation in ultrasound images , 2010, 2008 IEEE International Conference on Systems, Man and Cybernetics.

[16]  Pabitra Mitra,et al.  On the Fly Segmentation of Intravascular Ultrasound Images Powered by Learning of Backscattering Physics , 2018 .

[17]  Nassir Navab,et al.  Ultrasound confidence maps using random walks , 2012, Medical Image Anal..

[18]  Yiannis Kompatsiaris,et al.  Automated IVUS Contour Detection Using Intesity Features and Radial Basis Function Approximation , 2007, Twentieth IEEE International Symposium on Computer-Based Medical Systems (CBMS'07).

[19]  J. Alison Noble,et al.  Ultrasound image segmentation: a survey , 2006, IEEE Transactions on Medical Imaging.

[20]  Michalis A. Savelonas,et al.  Active Contours Guided by Echogenicity and Texture for Delineation of Thyroid Nodules in Ultrasound Images , 2009, IEEE Transactions on Information Technology in Biomedicine.

[21]  Joachim Hornegger,et al.  Quantification of Thyroid Volume Using 3-D Ultrasound Imaging , 2008, IEEE Transactions on Medical Imaging.

[22]  E. Gerardo Mendizabal-Ruiz,et al.  Computerized Medical Imaging and Graphics , 2022 .

[23]  Leo Grady,et al.  Random Walks for Image Segmentation , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Petia Radeva,et al.  HoliMAb: A holistic approach for Media-Adventitia border detection in intravascular ultrasound , 2012, Medical Image Anal..

[25]  J. Thomas,et al.  Three-dimensional segmentation of luminal and adventitial borders in serial intravascular ultrasound images. , 1999, Computerized medical imaging and graphics : the official journal of the Computerized Medical Imaging Society.

[26]  Bahaa E. A. Saleh Introduction to Subsurface Imaging , 2011 .