Lumen-intima and media-adventitia segmentation in IVUS images using supervised classifications of arterial layers and morphological structures

BACKGROUND Intravascular ultrasound (IVUS) provides axial grey-scale images of blood vessels. The large number of images require automatic analysis, specifically to identify the lumen and outer vessel wall. However, the high amount of noise, the presence of artifacts and anatomical structures, such as bifurcations, calcifications and fibrotic plaques, usually hinder the proper automatic segmentation of the vessel wall. METHODS Lumen, media, adventitia and surrounding tissues are automatically detected using Support Vector Machines (SVMs). The classification performance of the SVMs vary according to the kind of structure present within each region of the image. Random Forest (RF) is used to detect different morphological structures and to modify the initial layer classification depending on the detected structure. The resulting classification maps are fed into a segmentation method based on deformable contours to detect lumen-intima (LI) and media-adventitia (MA) interfaces. RESULTS The modifications in the layer classifications according to the presence of structures proved to be effective improving LI and MA segmentations. The proposed method reaches a Jaccard Measure (JM) of 0.88 ± 0.08 for LI segmentation, compared with 0.88 ± 0.05 of a semiautomatic method. When looking at MA, our method reaches a JM of 0.84 ± 0.09, and outperforms previous automatic methods in terms of HD, with 0.51mm ± 0.30. CONCLUSIONS A simple modification to the arterial layer classification produces results that match and improve state-of-the-art fully-automatic segmentation methods for LI and MA in 20MHz IVUS images. For LI segmentation, the proposed automatic method performs accurately as semi-automatic methods. For MA segmentation, our method matched the quality of state-of-the-art automatic methods described in the literature. Furthermore, our implementation is modular and open-source, allowing for future extensions and improvements.

[1]  E. Gerardo Mendizabal-Ruiz,et al.  A physics-based intravascular ultrasound image reconstruction method for lumen segmentation , 2016, Comput. Biol. Medicine.

[2]  Anup Basu,et al.  Segmentation of arterial walls in intravascular ultrasound cross‐sectional images using extremal region selection , 2018, Ultrasonics.

[3]  João Manuel R. S. Tavares,et al.  Automatic segmentation of the lumen region in intravascular images of the coronary artery , 2017, Medical Image Anal..

[4]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[5]  Shai Shalev-Shwartz,et al.  Stochastic dual coordinate ascent methods for regularized loss , 2012, J. Mach. Learn. Res..

[6]  J. Alison Noble,et al.  Ultrasound image segmentation: a survey , 2006, IEEE Transactions on Medical Imaging.

[7]  E. Gerardo Mendizabal-Ruiz,et al.  Segmentation of the luminal border in intravascular ultrasound B-mode images using a probabilistic approach , 2013, Medical Image Anal..

[8]  Petia Radeva,et al.  Intravascular Ultrasound Images Vessel Characterization Using AdaBoost , 2003, FIMH.

[9]  Milan Sonka,et al.  Graph-Based IVUS Segmentation With Efficient Computer-Aided Refinement , 2013, IEEE Transactions on Medical Imaging.

[10]  Kenneth Moreland,et al.  Diverging Color Maps for Scientific Visualization , 2009, ISVC.

[11]  Akiko Maehara,et al.  Effects of transducer position on backscattered intensity in coronary arteries. , 2002, Ultrasound in medicine & biology.

[12]  Matthew B. Blaschko,et al.  An ensemble deep learning based approach for red lesion detection in fundus images , 2017, Comput. Methods Programs Biomed..

[13]  Ioannis B. Theocharis,et al.  Genetic fuzzy rule based classification systems for coronary plaque characterization based on intravascular ultrasound images , 2015, Eng. Appl. Artif. Intell..

[14]  Jean-Claude Tardif,et al.  Assessment of Inter-Expert Variability and of an Automated Segmentation Method of 40 and 60 MHz IVUS Images of Coronary Arteries , 2017, PloS one.

[15]  Tomoyuki Yambe,et al.  Segmentation of Calcification Regions in Intravascular Ultrasound Images by Adaptive Thresholding , 2006, 19th IEEE Symposium on Computer-Based Medical Systems (CBMS'06).

[16]  Nassir Navab,et al.  A State-of-the-Art Review on Segmentation Algorithms in Intravascular Ultrasound (IVUS) Images , 2012, IEEE Transactions on Information Technology in Biomedicine.

[17]  L. Lo Vercio,et al.  Detection of morphological structures for vessel wall segmentation in IVUS using random forests , 2017, Symposium on Medical Information Processing and Analysis.

[18]  Noriaki Suetake,et al.  Automated boundary extraction and visualization system for coronary plaque in IVUS image by using fuzzy inference-based method , 2011, 2011 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE 2011).

[19]  Raimund Erbel,et al.  Virtual 3D IVUS vessel model for intravascular brachytherapy planning. I. 3D segmentation, reconstruction, and visualization of coronary artery architecture and orientation. , 2003, Medical Physics (Lancaster).

[20]  Petia Radeva,et al.  Statistical strategy for anisotropic adventitia modelling in IVUS , 2006, IEEE Transactions on Medical Imaging.

[21]  Seyed Kamaledin Setarehdan,et al.  Automatic media-adventitia IVUS image segmentation based on sparse representation framework and dynamic directional active contour model , 2017, Comput. Biol. Medicine.

[22]  Steven E. Nissen,et al.  Intravascular Ultrasound Assessment of Lumen Size and Wall Morphology in Normal Subjects and Patients With Coronary Artery Disease , 1991, Circulation.

[23]  Petia Radeva,et al.  HoliMAb: A holistic approach for Media-Adventitia border detection in intravascular ultrasound , 2012, Medical Image Anal..

[24]  Sung Min Kim,et al.  Characterization of coronary plaque regions in intravascular ultrasound images using a hybrid ensemble classifier , 2018, Comput. Methods Programs Biomed..

[25]  Petia Radeva,et al.  Automatic Bifurcation Detection in Coronary IVUS Sequences , 2012, IEEE Transactions on Biomedical Engineering.

[26]  U. Rajendra Acharya,et al.  Automated localization and segmentation techniques for B-mode ultrasound images: A review , 2018, Comput. Biol. Medicine.

[27]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[28]  Anne-Laure Boulesteix,et al.  Overview of random forest methodology and practical guidance with emphasis on computational biology and bioinformatics , 2012, WIREs Data Mining Knowl. Discov..

[29]  David Moratal,et al.  Automatic segmentation and 3D reconstruction of intravascular ultrasound images for a fast preliminar evaluation of vessel pathologies , 2007, Comput. Medical Imaging Graph..

[30]  E. Gerardo Mendizabal-Ruiz,et al.  Computerized Medical Imaging and Graphics , 2022 .

[31]  Jean Meunier,et al.  Intravascular Ultrasound image segmentation: A helical active contour method , 2010, 2010 2nd International Conference on Image Processing Theory, Tools and Applications.

[32]  Yongmin Kim,et al.  A methodology for evaluation of boundary detection algorithms on medical images , 1997, IEEE Transactions on Medical Imaging.

[33]  B F Waller,et al.  Intravascular ultrasound: a histological study of vessels during life. The new 'gold standard' for vascular imaging. , 1992, Circulation.

[34]  Zhenghui Hu,et al.  An artificial neural network method for lumen and media-adventitia border detection in IVUS , 2017, Comput. Medical Imaging Graph..

[35]  Jouke Dijkstra,et al.  Intravascular Ultrasound Image Hard Plaque Recognition and Media-adventitia Border Detection , 2013 .

[36]  Demetri Terzopoulos,et al.  T-snakes: Topology adaptive snakes , 2000, Medical Image Anal..

[37]  Petia Radeva,et al.  Computer-aided detection of intracoronary stent in intravascular ultrasound sequences. , 2016, Medical physics.

[38]  Pabitra Mitra,et al.  On the Fly Segmentation of Intravascular Ultrasound Images Powered by Learning of Backscattering Physics , 2018 .

[39]  Ethem Alpaydin,et al.  Introduction to machine learning , 2004, Adaptive computation and machine learning.

[40]  Mark D. Huffman,et al.  Heart disease and stroke statistics--2013 update: a report from the American Heart Association. , 2013, Circulation.

[41]  Ignacio Larrabide,et al.  Validation of an Open-Source Tool for Measuring Carotid Lumen Diameter and Intima-Media Thickness. , 2018, Ultrasound in medicine & biology.

[42]  Yaoyao Cui,et al.  A Novel Segmentation Approach for Intravascular Ultrasound Images , 2017 .

[43]  Tong Fang,et al.  Shape-Driven Segmentation of the Arterial Wall in Intravascular Ultrasound Images , 2008, IEEE Transactions on Information Technology in Biomedicine.

[44]  Xianghua Xie,et al.  Shape Prior Model for Media-Adventitia Border Segmentation in IVUS Using Graph Cut , 2012, MCV.

[45]  Heye Zhang,et al.  Automated Framework for Detecting Lumen and Media-Adventitia Borders in Intravascular Ultrasound Images. , 2015, Ultrasound in medicine & biology.

[46]  Nassir Navab,et al.  Automatic segmentation of calcified plaques and vessel borders in IVUS images , 2008, International Journal of Computer Assisted Radiology and Surgery.

[47]  Marie-Hélène Roy Cardinal,et al.  Fast-marching segmentation of three-dimensional intravascular ultrasound images: a pre- and post-intervention study. , 2010, Medical physics.

[48]  José Ignacio Orlando,et al.  Assessment of image features for vessel wall segmentation in intravascular ultrasound images , 2016, International Journal of Computer Assisted Radiology and Surgery.

[49]  Guy Cloutier,et al.  Segmentation method of intravascular ultrasound images of human coronary arteries , 2014, Comput. Medical Imaging Graph..

[50]  Yun Zhang,et al.  A snake-based method for segmentation of intravascular ultrasound images and its in vivo validation. , 2011, Ultrasonics.

[51]  Milan Sonka,et al.  Tissue characterization in intravascular ultrasound images , 1998, IEEE Transactions on Medical Imaging.

[52]  Taghi M. Khoshgoftaar,et al.  Comparison of Data Sampling Approaches for Imbalanced Bioinformatics Data , 2014, FLAIRS.