Improving retinal vessel segmentation with joint local loss by matting

Abstract Besides the binary segmentation, many retinal image segmentation methods also produce a score map, where a nonnegative score is assigned for each pixel to indicate the likelihood of being a vessel. This observation inspires us to propose a new approach as a post-processing step to improve existing methods by formulating segmentation as a matting problem. A trimap is obtained via a bi-level thresholding of the score map from existing methods, which is instrumental in focusing the attention to pixels of these unknown areas. A dedicated end-to-end matting algorithm is further developed to retrieve those vessel pixels in the unknown areas, and to produce the final vessel segmentation by minimizing global pixel loss and local matting loss. Our approach is shown to be particularly effective in rescuing thin and tiny vessels that may lead to disconnections of vessel fragments. Moreover, it is observed that our approach is capable of improving the overall segmentation performance across a broad range of existing methods.

[1]  Matthew B. Blaschko,et al.  A Discriminatively Trained Fully Connected Conditional Random Field Model for Blood Vessel Segmentation in Fundus Images , 2017, IEEE Transactions on Biomedical Engineering.

[2]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[3]  Bunyarit Uyyanonvara,et al.  An approach to localize the retinal blood vessels using bit planes and centerline detection , 2012, Comput. Methods Programs Biomed..

[4]  In-So Kweon,et al.  Natural Image Matting Using Deep Convolutional Neural Networks , 2016, ECCV.

[5]  Jiaya Jia,et al.  Deep Automatic Portrait Matting , 2016, ECCV.

[6]  Tianfu Wang,et al.  A Cross-Modality Learning Approach for Vessel Segmentation in Retinal Images , 2016, IEEE Transactions on Medical Imaging.

[7]  Yan Chen,et al.  Vessel extraction from non-fluorescein fundus images using orientation-aware detector , 2015, Medical Image Anal..

[8]  A.D. Hoover,et al.  Locating blood vessels in retinal images by piecewise threshold probing of a matched filter response , 2000, IEEE Transactions on Medical Imaging.

[9]  Vibhav Vineet,et al.  Conditional Random Fields as Recurrent Neural Networks , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[10]  Max A. Viergever,et al.  Ridge-based vessel segmentation in color images of the retina , 2004, IEEE Transactions on Medical Imaging.

[11]  Edoardo Ardizzone,et al.  Automatic Extraction of Blood Vessels, Bifurcations and End Points in the Retinal Vascular Tree , 2009 .

[12]  Dani Lischinski,et al.  A Closed-Form Solution to Natural Image Matting , 2008 .

[13]  Salah Bourennane,et al.  Retinal vessel segmentation using a probabilistic tracking method , 2012, Pattern Recognit..

[14]  Michael F. Cohen,et al.  Image and Video Matting: A Survey , 2007, Found. Trends Comput. Graph. Vis..

[15]  George D. C. Cavalcanti,et al.  Unsupervised Retinal Vessel Segmentation Using Combined Filters , 2016, PloS one.

[16]  Bin Fang,et al.  Reconstruction of vascular structures in retinal images , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[17]  Alejandro F. Frangi,et al.  Muliscale Vessel Enhancement Filtering , 1998, MICCAI.

[18]  P. Bankhead,et al.  Fast Retinal Vessel Detection and Measurement Using Wavelets and Edge Location Refinement , 2012, PloS one.

[19]  Jia Zhang,et al.  A retinal vessel boundary tracking method based on Bayesian theory and multi-scale line detection , 2014, Comput. Medical Imaging Graph..

[20]  Li Cheng,et al.  Supervised Segmentation of Un-Annotated Retinal Fundus Images by Synthesis , 2019, IEEE Transactions on Medical Imaging.

[21]  Luc Van Gool,et al.  Deep Retinal Image Understanding , 2016, MICCAI.

[22]  David Salesin,et al.  A Bayesian approach to digital matting , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[23]  Jeny Rajan,et al.  Automated Method for Retinal Artery/Vein Separation via Graph Search Metaheuristic Approach , 2019, IEEE Transactions on Image Processing.

[24]  Josien P. W. Pluim,et al.  Robust Retinal Vessel Segmentation via Locally Adaptive Derivative Frames in Orientation Scores , 2016, IEEE Transactions on Medical Imaging.

[25]  Qiang Wu,et al.  Retinal Vessel Segmentation Using Minimum Spanning Superpixel Tree Detector , 2019, IEEE Transactions on Cybernetics.

[26]  Stephen Lin,et al.  DeepVessel: Retinal Vessel Segmentation via Deep Learning and Conditional Random Field , 2016, MICCAI.

[27]  Keith A. Soper,et al.  Diagnosis of diabetic eye disease. , 1982, JAMA.

[28]  Martin Kraus,et al.  Automatic no-reference quality assessment for retinal fundus images using vessel segmentation , 2013, Proceedings of the 26th IEEE International Symposium on Computer-Based Medical Systems.

[29]  J. Kanski.  Clinical Ophthalmology: A Systematic Approach , 1989 .

[30]  Ke Chen,et al.  Automated Vessel Segmentation Using Infinite Perimeter Active Contour Model with Hybrid Region Information with Application to Retinal Images , 2015, IEEE Transactions on Medical Imaging.

[31]  George Azzopardi,et al.  Trainable COSFIRE filters for vessel delineation with application to retinal images , 2015, Medical Image Anal..

[32]  R. Klein,et al.  Retinal microvascular abnormalities and 10-year cardiovascular mortality: a population-based case-control study. , 2003, Ophthalmology.

[33]  Samaneh Abbasi-Sureshjani,et al.  Biologically-Inspired Supervised Vasculature Segmentation in SLO Retinal Fundus Images , 2015, ICIAR.

[34]  Frédéric Zana,et al.  Segmentation of vessel-like patterns using mathematical morphology and curvature evaluation , 2001, IEEE Trans. Image Process..

[35]  Li Cheng,et al.  Learning to Boost Filamentary Structure Segmentation , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[36]  Vincent Lepetit,et al.  Supervised Feature Learning for Curvilinear Structure Segmentation , 2013, MICCAI.

[37]  José Manuel Bravo,et al.  A Function for Quality Evaluation of Retinal Vessel Segmentations , 2012, IEEE Transactions on Medical Imaging.

[38]  Emanuele Trucco,et al.  Retinal vessel segmentation using multiwavelet kernels and multiscale hierarchical decomposition , 2013, Pattern Recognit..

[39]  Ning Xu,et al.  Deep Image Matting , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[40]  Bunyarit Uyyanonvara,et al.  An Ensemble Classification-Based Approach Applied to Retinal Blood Vessel Segmentation , 2012, IEEE Transactions on Biomedical Engineering.

[41]  Chi-Keung Tang,et al.  KNN Matting , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[42]  M. Goldbaum,et al.  Detection of blood vessels in retinal images using two-dimensional matched filters. , 1989, IEEE transactions on medical imaging.

[43]  Roberto Marcondes Cesar Junior,et al.  Retinal vessel segmentation using the 2-D Gabor wavelet and supervised classification , 2005, IEEE Transactions on Medical Imaging.

[44]  Kotagiri Ramamohanarao,et al.  An effective retinal blood vessel segmentation method using multi-scale line detection , 2013, Pattern Recognit..

[45]  Huiqi Li,et al.  Segment 2D and 3D Filaments by Learning Structured and Contextual Features , 2017, IEEE Transactions on Medical Imaging.