The Multiscale Bowler-Hat Transform for Blood Vessel Enhancement in Retinal Images

Enhancement, followed by segmentation, quantification and modelling, of blood vessels in retinal images plays an essential role in computer-aid retinopathy diagnosis. In this paper, we introduce a new vessel enhancement method which is the bowler-hat transform based on mathematical morphology. The proposed method combines different structuring elements to detect innate features of vessel-like structures. We evaluate the proposed method qualitatively and quantitatively, and compare it with the existing, state-of-the-art methods using both synthetic and real datasets. Our results show that the proposed method achieves high-quality vessel-like structure enhancement in both synthetic examples and in clinically relevant retinal images, and is shown to be able to detect fine vessels while remaining robust at junctions.

[1]  N. Otsu.  A threshold selection method from gray level histograms , 1979 .

[2]  Frank Y. Shih,et al.  Retinal vessels segmentation based on level set and region growing , 2014, Pattern Recognit..

[3]  Alejandro F. Frangi,et al.  Muliscale Vessel Enhancement Filtering , 1998, MICCAI.

[4]  George Azzopardi,et al.  Trainable COSFIRE filters for vessel delineation with application to retinal images , 2015, Medical Image Anal..

[5]  Xiaoyi Jiang,et al.  Adaptive Local Thresholding by Verification-Based Multithreshold Probing with Application to Vessel Detection in Retinal Images , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Josien P. W. Pluim,et al.  Robust Retinal Vessel Segmentation via Locally Adaptive Derivative Frames in Orientation Scores , 2016, IEEE Transactions on Medical Imaging.

[7]  Ahmad Reza Naghsh-Nilchi,et al.  Automatic wavelet-based retinal blood vessels segmentation and vessel diameter estimation , 2013, Biomed. Signal Process. Control..

[8]  Carl-Fredrik Westin,et al.  Multiscale segmentation of the aorta in 3D ultrasound images , 2003, Proceedings of the 25th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (IEEE Cat. No.03CH37439).

[9]  Xiaohui Liu,et al.  Segmentation of the Blood Vessels and Optic Disk in Retinal Images , 2014, IEEE Journal of Biomedical and Health Informatics.

[10]  Guido Gerig,et al.  Multiscale detection of curvilinear structures in 2-D and 3-D image data , 1995, Proceedings of IEEE International Conference on Computer Vision.

[11]  Guido Gerig,et al.  3D Multi-scale line filter for segmentation and visualization of curvilinear structures in medical images , 1997, CVRMed.

[12]  Andrew Hunter,et al.  An Active Contour Model for Segmenting and Measuring Retinal Vessels , 2009, IEEE Transactions on Medical Imaging.

[13]  Marek R. Ogiela,et al.  Intelligent image content semantic description for cardiac 3D visualisations , 2011, Eng. Appl. Artif. Intell..

[14]  E Meijering,et al.  Design and validation of a tool for neurite tracing and analysis in fluorescence microscopy images , 2004, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[15]  Boguslaw Obara,et al.  Contrast-independent curvilinear structure enhancement in 3D biomedical images , 2017, 2017 IEEE 14th International Symposium on Biomedical Imaging (ISBI 2017).

[16]  Enrico Grisan.  Boosted learned kernels for data-driven vesselness measure , 2017, Medical Imaging.

[17]  Joachim Weickert,et al.  Anisotropic diffusion in image processing , 1996 .

[18]  Changming Sun,et al.  A new method for linear feature and junction enhancement in 2D images based on morphological operation, oriented anisotropic Gaussian function and Hessian information , 2014, Pattern Recognit..

[19]  Bunyarit Uyyanonvara,et al.  Blood vessel segmentation methodologies in retinal images - A survey , 2012, Comput. Methods Programs Biomed..

[20]  C. R. Ethier,et al.  Automated segmentation of the lamina cribrosa using Frangi's filter: a novel approach for rapid identification of tissue volume fraction and beam orientation in a trabeculated structure in the eye , 2015, Journal of The Royal Society Interface.

[21]  Ana Maria Mendonça,et al.  Segmentation of retinal blood vessels by combining the detection of centerlines and morphological reconstruction , 2006, IEEE Transactions on Medical Imaging.

[22]  Abeer Alsadoon,et al.  Early diagnosis of breast cancer using contrast limited adaptive histogram equalization (CLAHE) and Morphology methods , 2017, 2017 8th International Conference on Information and Communication Systems (ICICS).

[23]  Qinmu Peng,et al.  Segmentation of retinal blood vessels using the radial projection and semi-supervised approach , 2011, Pattern Recognit..

[24]  Peter Kovesi,et al.  Phase Congruency Detects Corners and Edges , 2003, DICTA.

[25]  Xinhua Zhuang,et al.  Image Analysis Using Mathematical Morphology , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Vincent Lepetit,et al.  Accurate and Efficient Linear Structure Segmentation by Leveraging Ad Hoc Features with Learned Filters , 2012, MICCAI.

[27]  Max W. K. Law,et al.  Efficient Implementation for Spherical Flux Computation and Its Application to Vascular Segmentation , 2009, IEEE Transactions on Image Processing.

[28]  Patrick P. K. Chan,et al.  Vessel enhancement of low quality fundus image using mathematical morphology and combination of Gabor and matched filter , 2016, 2016 International Conference on Wavelet Analysis and Pattern Recognition (ICWAPR).

[29]  José Manuel Bravo,et al.  A New Supervised Method for Blood Vessel Segmentation in Retinal Images by Using Gray-Level and Moment Invariants-Based Features , 2011, IEEE Transactions on Medical Imaging.

[30]  Boguslaw Obara,et al.  Coherence enhancing diffusion filtering based on the Phase Congruency Tensor , 2012, 2012 9th IEEE International Symposium on Biomedical Imaging (ISBI).

[31]  Manuel González Hidalgo,et al.  A survey on curvilinear object segmentation in multiple applications , 2016, Pattern Recognit..

[32]  Bradley M. Hemminger,et al.  Contrast Limited Adaptive Histogram Equalization image processing to improve the detection of simulated spiculations in dense mammograms , 1998, Journal of Digital Imaging.

[33]  Sushanta Biswas,et al.  A new contrast enhancement method of retinal images in Diabetic Screening System , 2015, 2015 IEEE 2nd International Conference on Recent Trends in Information Systems (ReTIS).

[34]  George Azzopardi,et al.  Automatic detection of vascular bifurcations in segmented retinal images using trainable COSFIRE filters , 2013, Pattern Recognit. Lett..

[35]  Changming Sun,et al.  Junction detection for linear structures based on Hessian, correlation and shape information , 2012, Pattern Recognit..

[36]  Bostjan Likar,et al.  Enhancement of Vascular Structures in 3D and 2D Angiographic Images , 2016, IEEE Transactions on Medical Imaging.

[37]  Elli Angelopoulou,et al.  Retinal vessel segmentation by improved matched filtering: evaluation on a new high-resolution fundus image database , 2013, IET Image Process..

[38]  P. Bankhead,et al.  Fast Retinal Vessel Detection and Measurement Using Wavelets and Edge Location Refinement , 2012, PloS one.

[39]  Sérgio Shiguemi Furuie,et al.  Multiscale representation for automatic identification of structures in medical images , 2007, Comput. Biol. Medicine.

[40]  Zhuowen Tu,et al.  Detecting Object Boundaries Using Low-, Mid-, and High-level Information , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[41]  Frédéric Zana,et al.  Segmentation of vessel-like patterns using mathematical morphology and curvature evaluation , 2001, IEEE Trans. Image Process..

[42]  Erik J. Bekkers,et al.  Retinal vessel delineation using a brain-inspired wavelet transform and random forest , 2017, Pattern Recognit..

[43]  Bunyarit Uyyanonvara,et al.  An approach to localize the retinal blood vessels using bit planes and centerline detection , 2012, Comput. Methods Programs Biomed..

[44]  Emanuele Trucco,et al.  Boosting Hand-Crafted Features for Curvilinear Structure Segmentation by Learning Context Filters , 2015, MICCAI.

[45]  Max A. Viergever,et al.  Ridge-based vessel segmentation in color images of the retina , 2004, IEEE Transactions on Medical Imaging.

[46]  Bin Chen,et al.  Retinal vessel enhancement using multi-dictionary and sparse coding , 2016, 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[47]  Emanuele Trucco,et al.  Accelerating Convolutional Sparse Coding for Curvilinear Structures Segmentation by Refining SCIRD-TS Filter Banks , 2016, IEEE Transactions on Medical Imaging.

[48]  Roberto Marcondes Cesar Junior,et al.  Retinal vessel segmentation using the 2-D Gabor wavelet and supervised classification , 2005, IEEE Transactions on Medical Imaging.

[49]  Tom Fawcett,et al.  An introduction to ROC analysis , 2006, Pattern Recognit. Lett..

[50]  Emanuele Trucco,et al.  Retinal vessel segmentation using multiwavelet kernels and multiscale hierarchical decomposition , 2013, Pattern Recognit..

[51]  David Gavaghan,et al.  Contrast-Independent Curvilinear Structure Detection in Biomedical Images , 2012, IEEE Transactions on Image Processing.

[52]  Aamir Saeed Malik,et al.  Subcutaneous veins detection and backprojection method using Frangi vesselness filter , 2015, 2015 IEEE Symposium on Computer Applications & Industrial Electronics (ISCAIE).

[53]  Nicholas Ayache,et al.  Model-Based Detection of Tubular Structures in 3D Images , 2000, Comput. Vis. Image Underst..

[54]  Nicolas Passat,et al.  Curvilinear Structure Analysis by Ranking the Orientation Responses of Path Operators , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[55]  Wei Jin,et al.  Enhancing retinal image by the Contourlet transform , 2007, Pattern Recognit. Lett..

[56]  Kotagiri Ramamohanarao,et al.  An effective retinal blood vessel segmentation method using multi-scale line detection , 2013, Pattern Recognit..

[57]  Jitendra Malik,et al.  Scale-Space and Edge Detection Using Anisotropic Diffusion , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[58]  Alan Wee-Chung Liew,et al.  General Retinal Vessel Segmentation Using Regularization-Based Multiconcavity Modeling , 2010, IEEE Transactions on Medical Imaging.

[59]  Emanuele Trucco,et al.  FABC: Retinal Vessel Segmentation Using AdaBoost , 2010, IEEE Transactions on Information Technology in Biomedicine.

[60]  Héctor Benítez-Pérez,et al.  Parallel Multiscale Feature Extraction and Region Growing: Application in Retinal Blood Vessel Detection , 2010, IEEE Transactions on Information Technology in Biomedicine.

[61]  Jie Zhou,et al.  Automatic Dendritic Length Quantification for High Throughput Screening of Mature Neurons , 2015, Neuroinformatics.

[62]  Narendra Ahuja,et al.  Multiscale image segmentation by integrated edge and region detection , 1997, IEEE Trans. Image Process..

[63]  Matthew B. Blaschko,et al.  Learning Fully-Connected CRFs for Blood Vessel Segmentation in Retinal Images , 2014, MICCAI.

[64]  Ching-Hsue Cheng,et al.  Fast computation of Hessian-based enhancement filters for medical images , 2014, Comput. Methods Programs Biomed..

[65]  Jon Atli Benediktsson,et al.  Automatic retinal vessel extraction based on directional mathematical morphology and fuzzy classification , 2014, Pattern Recognit. Lett..

[66]  A.D. Hoover,et al.  Locating blood vessels in retinal images by piecewise threshold probing of a matched filter response , 2000, IEEE Transactions on Medical Imaging.

[67]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[68]  Yanli Hou,et al.  Automatic Segmentation of Retinal Blood Vessels Based on Improved Multiscale Line Detection , 2014, J. Comput. Sci. Eng..

[69]  Anil A. Bharath,et al.  Segmentation of blood vessels from red-free and fluorescein retinal images , 2007, Medical Image Anal..

[70]  Nick Efford,et al.  Digital Image Processing: A Practical Introduction Using Java , 2000 .