Comprehensive review of retinal blood vessel segmentation and classification techniques: intelligent solutions for green computing in medical images, current challenges, open issues, and knowledge gaps in fundus medical images

Recently, there has been an advancement in the development of innovative computer-aided techniques for the segmentation and classification of retinal vessels, the application of which is predominant in clinical applications. Consequently, this study aims to provide a detailed overview of the techniques available for segmentation and classification of retinal vessels. Initially, retinal fundus photography and retinal image patterns are briefly introduced. Then, an introduction to the pre-processing operations and advanced methods of identifying retinal vessels is deliberated. In addition, a discussion on the validation stage and assessment of the outcomes of retinal vessels segmentation is presented. In this paper, the proposed methods of classifying arteries and veins in fundus images are extensively reviewed, which are categorized into automatic and semi-automatic categories. There are some challenges associated with the classification of vessels in images of the retinal fundus, which include the low contrast accompanying the fundus image and the inhomogeneity of the background lighting. The inhomogeneity occurs as a result of the process of imaging, whereas the low contrast which accompanies the image is caused by the variation between the background and the contrast of the various blood vessels. This means that the contrast of thicker vessels is higher than those that are thinner. Another challenge is related to the color changes that occur in the retina from different subjects, which are rooted in biological features. Most of the techniques used for the classification of the retinal vessels are based on geometric and visual characteristics that set the veins apart from the arteries. In this study, different major contributions are summarized as review studies that adopted deep learning approaches and machine learning techniques to address each of the limitations and problems in retinal blood vessel segmentation and classification techniques. We also review the current challenges, knowledge gaps and open issues, limitations and problems in retinal blood vessel segmentation and classification techniques.

[1]  Tao Zhu,et al.  Fourier cross-sectional profile for vessel detection on retinal images , 2010, Comput. Medical Imaging Graph..

[2]  Jinkai Cui,et al.  Retinal vessel segmentation in colour fundus images using Extreme Learning Machine , 2017, Comput. Medical Imaging Graph..

[3]  Yun Jiang,et al.  A Multi-Scale Residual Attention Network for Retinal Vessel Segmentation , 2021, Symmetry.

[4]  Enrico Grisan,et al.  Luminosity and contrast normalization in retinal images , 2005, Medical Image Anal..

[5]  Jeny Rajan,et al.  Recent Advancements in Retinal Vessel Segmentation , 2017, Journal of Medical Systems.

[6]  M. Goldbaum,et al.  Detection of blood vessels in retinal images using two-dimensional matched filters. , 1989, IEEE transactions on medical imaging.

[7]  Charles V. Stewart,et al.  Retinal Vessel Centerline Extraction Using Multiscale Matched Filters, Confidence and Edge Measures , 2006, IEEE Transactions on Medical Imaging.

[8]  Michael V. McConnell,et al.  Prediction of cardiovascular risk factors from retinal fundus photographs via deep learning , 2017, Nature Biomedical Engineering.

[9]  Larry D. Hubbard,et al.  Color photography vs fluorescein angiography in the detection of diabetic retinopathy in the diabetes control and complications trial. The Diabetes Control and Complications Trial Research Group. , 1987, Archives of ophthalmology.

[10]  Daniel Kondermann,et al.  Blood vessel classification into arteries and veins in retinal images , 2007, SPIE Medical Imaging.

[11]  A.D. Hoover,et al.  Locating blood vessels in retinal images by piecewise threshold probing of a matched filter response , 2000, IEEE Transactions on Medical Imaging.

[12]  Stelios Krinidis,et al.  A Robust Fuzzy Local Information C-Means Clustering Algorithm , 2010, IEEE Transactions on Image Processing.

[13]  Tien Yin Wong,et al.  Reliability of retinal photography in the assessment of retinal microvascular characteristics: the Atherosclerosis Risk in Communities Study. , 2002, American journal of ophthalmology.

[14]  Anil A. Bharath,et al.  Retinal vascular tree morphology: a semi-automatic quantification , 2002, IEEE Transactions on Biomedical Engineering.

[15]  Manoranjan Paul,et al.  Strided fully convolutional neural network for boosting the sensitivity of retinal blood vessels segmentation , 2019, Expert Syst. Appl..

[16]  Xiaoyi Jiang,et al.  Adaptive Local Thresholding by Verification-Based Multithreshold Probing with Application to Vessel Detection in Retinal Images , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Seok-Bum Ko,et al.  Fast, accurate and robust retinal vessel segmentation system , 2017 .

[18]  Bunyarit Uyyanonvara,et al.  Blood vessel segmentation methodologies in retinal images - A survey , 2012, Comput. Methods Programs Biomed..

[19]  Farida Cheriet,et al.  A multi-scale tensor voting approach for small retinal vessel segmentation in high resolution fundus images , 2016, Comput. Medical Imaging Graph..

[20]  Farshad Tajeripour,et al.  Computerized Medical Imaging and Graphics Automated Characterization of Blood Vessels as Arteries and Veins in Retinal Images , 2022 .

[21]  Yang Song,et al.  NFN+: A novel network followed network for retinal vessel segmentation , 2020, Neural Networks.

[22]  N. Arunkumar,et al.  A real time computer aided object detection of nasopharyngeal carcinoma using genetic algorithm and artificial neural network based on Haar feature fear , 2018, Future Gener. Comput. Syst..

[23]  Francis K. H. Quek,et al.  A review of vessel extraction techniques and algorithms , 2004, CSUR.

[24]  Edgardo Manuel Felipe Riverón,et al.  Regular paper , 2005, 2005 IEEE/PES Transmission & Distribution Conference & Exposition: Asia and Pacific.

[25]  Stanley S. Ipson,et al.  A fully automated cell segmentation and morphometric parameter system for quantifying corneal endothelial cell morphology , 2018, Comput. Methods Programs Biomed..

[26]  Taghi M. Khoshgoftaar,et al.  A survey of transfer learning , 2016, Journal of Big Data.

[27]  N. Chapman,et al.  Peripheral vascular disease is associated with abnormal arteriolar diameter relationships at bifurcations in the human retina. , 2002, Clinical science.

[28]  Guy Cazuguel,et al.  FEEDBACK ON A PUBLICLY DISTRIBUTED IMAGE DATABASE: THE MESSIDOR DATABASE , 2014 .

[29]  P. Bankhead,et al.  Fast Retinal Vessel Detection and Measurement Using Wavelets and Edge Location Refinement , 2012, PloS one.

[30]  Demetri Terzopoulos,et al.  Deformable models in medical image analysis: a survey , 1996, Medical Image Anal..

[31]  Mohammed Al-Rawi,et al.  An improved matched filter for blood vessel detection of digital retinal images , 2007, Comput. Biol. Medicine.

[32]  N. Arunkumar,et al.  Computer Aided Solution for Automatic Segmenting and Measurements of Blood Leucocytes Using Static Microscope Images , 2018, Journal of Medical Systems.

[33]  Huiqi Li,et al.  Retinal image enhancement using low-pass filtering and α-rooting , 2020, Signal Process..

[34]  Rajeev Srivastava,et al.  Retinal blood vessels segmentation by using Gumbel probability distribution function based matched filter , 2016, Comput. Methods Programs Biomed..

[35]  Chao Zhou,et al.  A new robust method for blood vessel segmentation in retinal fundus images based on weighted line detector and hidden Markov model , 2019, Comput. Methods Programs Biomed..

[36]  Yanhui Guo,et al.  A Retinal Vessel Detection Approach Based on Shearlet Transform and Indeterminacy Filtering on Fundus Images , 2017, Symmetry.

[37]  Sushil Kumar Saroj,et al.  Fréchet PDF based Matched Filter Approach for Retinal Blood Vessels Segmentation , 2020, Comput. Methods Programs Biomed..

[38]  Yuan Zhang,et al.  Retinal vessel segmentation of color fundus images using multiscale convolutional neural network with an improved cross-entropy loss function , 2018, Neurocomputing.

[39]  Hong Zhang,et al.  A Fundus Retinal Vessels Segmentation Scheme Based on the Improved Deep Learning U-Net Model , 2019, IEEE Access.

[40]  N. Arunkumar,et al.  Decision-level fusion scheme for nasopharyngeal carcinoma identification using machine learning techniques , 2018, Neural Computing and Applications.

[41]  Ning Tan,et al.  Retinal Vessels Segmentation Based on Dilated Multi-Scale Convolutional Neural Network , 2019, IEEE Access.

[42]  Douglas Abreu Rocha,et al.  An unsupervised approach to improve contrast and segmentation of blood vessels in retinal images using CLAHE, 2D Gabor wavelet, and morphological operations , 2020, Research on Biomedical Engineering.

[43]  Thanh Binh Nguyen,et al.  Retinal Vessels Segmentation by Improving Salient Region Combined with Sobel Operator Condition , 2019, FDSE.

[44]  Susanto Rahardja,et al.  A New Hybrid Algorithm for Retinal Vessels Segmentation on Fundus Images , 2019, IEEE Access.

[45]  Carlo Tomasi,et al.  Tree Topology Estimation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[46]  U. Rajendra Acharya,et al.  Automated Identification of Diabetic Retinopathy Stages Using Digital Fundus Images , 2008, Journal of Medical Systems.

[47]  Stanley S. Ipson,et al.  A fully automatic nerve segmentation and morphometric parameter quantification system for early diagnosis of diabetic neuropathy in corneal images , 2016, Comput. Methods Programs Biomed..

[48]  Elli Angelopoulou,et al.  Retinal vessel segmentation by improved matched filtering: evaluation on a new high-resolution fundus image database , 2013, IET Image Process..

[49]  Tuan D. Pham,et al.  DUNet: A deformable network for retinal vessel segmentation , 2018, Knowl. Based Syst..

[50]  Mazin Abed Mohammed,et al.  K-Means clustering and neural network for object detecting and identifying abnormality of brain tumor , 2018, Soft Computing.

[51]  Exudates as Landmarks Identified through FCM Clustering in Retinal Images , 2020, Applied Sciences.

[52]  Daniel Tchiotsop,et al.  Retinal blood vessels segmentation using classical edge detection filters and the neural network , 2021, Informatics in Medicine Unlocked.

[53]  Ahmad Reza Naghsh-Nilchi,et al.  Cauchy Based Matched Filter for Retinal Vessels Detection , 2014, Journal of medical signals and sensors.

[54]  Ana Maria Mendonça,et al.  An Automatic Graph-Based Approach for Artery/Vein Classification in Retinal Images , 2014, IEEE Transactions on Image Processing.

[55]  Krzysztof Krawiec,et al.  Segmenting Retinal Blood Vessels With Deep Neural Networks , 2016, IEEE Transactions on Medical Imaging.

[56]  D Relan,et al.  Unsupervised sorting of retinal vessels using locally consistent Gaussian mixtures , 2020, Comput. Methods Programs Biomed..

[57]  Ying Sun,et al.  Back-propagation network and its configuration for blood vessel detection in angiograms , 1995, IEEE Trans. Neural Networks.

[58]  Alejandro F. Frangi,et al.  CS2-Net: Deep Learning Segmentation of Curvilinear Structures in Medical Imaging , 2020, Medical Image Anal..

[59]  Aida Mustapha,et al.  Comparative Analysis between Active Contour and Otsu Thresholding Segmentation Algorithms in Segmenting Brain Tumor Magnetic Resonance Imaging , 2020 .

[60]  Isabelle Bloch,et al.  A review of 3D vessel lumen segmentation techniques: Models, features and extraction schemes , 2009, Medical Image Anal..

[61]  Emanuele Trucco,et al.  Retinal Vessel Classification Based on Maximization of Squared-Loss Mutual Information , 2016 .

[62]  Gendry Alfonso Francia,et al.  Chaining a U-Net With a Residual U-Net for Retinal Blood Vessels Segmentation , 2020, IEEE Access.

[63]  Nanang Fakhrur Rozi,et al.  Gradient based ant spread modification on ant colony optimization method for retinal blood vessel edge detection , 2021 .

[64]  J. Dinesh Peter,et al.  Extraction of Retinal Blood Vessels on Fundus Images by Kirsch's Template and Fuzzy C-Means , 2019, Journal of medical physics.

[65]  Bunyarit Uyyanonvara,et al.  An Ensemble Classification-Based Approach Applied to Retinal Blood Vessel Segmentation , 2012, IEEE Transactions on Biomedical Engineering.

[66]  Mong-Li Lee,et al.  Automatic grading of retinal vessel caliber , 2005, IEEE Transactions on Biomedical Engineering.

[67]  Carlo Tomasi,et al.  Retinal Artery-Vein Classification via Topology Estimation , 2015, IEEE Transactions on Medical Imaging.

[68]  Hui Ma,et al.  Attention Guided U-Net With Atrous Convolution for Accurate Retinal Vessels Segmentation , 2020, IEEE Access.

[69]  Yong Yang,et al.  An Automatic Hybrid Method for Retinal Blood Vessel Extraction , 2008, Int. J. Appl. Math. Comput. Sci..

[70]  Lei Zhang,et al.  Retinal vessel extraction by matched filter with first-order derivative of Gaussian , 2010, Comput. Biol. Medicine.

[71]  Ke Chen,et al.  Automated Vessel Segmentation Using Infinite Perimeter Active Contour Model with Hybrid Region Information with Application to Retinal Images , 2015, IEEE Transactions on Medical Imaging.

[72]  Feng Lin,et al.  A Graph-Theoretical Approach for Tracing Filamentary Structures in Neuronal and Retinal Images , 2016, IEEE Transactions on Medical Imaging.

[73]  R. Luben,et al.  Circulating 25-hydroxyvitamin D concentration and the risk of type 2 diabetes: results from the European Prospective Investigation into Cancer (EPIC)-Norfolk cohort and updated meta-analysis of prospective studies , 2012, Diabetologia.

[74]  Manoranjan Paul,et al.  Impact of ICA-Based Image Enhancement Technique on Retinal Blood Vessels Segmentation , 2018, IEEE Access.

[75]  N. Arunkumar,et al.  Examining multiple feature evaluation and classification methods for improving the diagnosis of Parkinson’s disease , 2019, Cognitive Systems Research.

[76]  Hiroshi Fujita,et al.  Automated detection and classification of major retinal vessels for determination of diameter ratio of arteries and veins , 2010, Medical Imaging.

[77]  Max A. Viergever,et al.  Ridge-based vessel segmentation in color images of the retina , 2004, IEEE Transactions on Medical Imaging.

[78]  Bahram Khoobehi,et al.  Automatic Identification of Retinal Arteries and Veins From Dual-Wavelength Images Using Structural and Functional Features , 2007, IEEE Transactions on Biomedical Engineering.

[79]  Imdad Ali Ismaili,et al.  A framework for retinal vessel segmentation from fundus images using hybrid feature set and hierarchical classification , 2018, Signal, Image and Video Processing.

[80]  Xiaoyi Jiang,et al.  Separation of the retinal vascular graph in arteries and veins based upon structural knowledge , 2009, Image Vis. Comput..

[81]  Mohamed Elhoseny,et al.  A New Multi-Agent Feature Wrapper Machine Learning Approach for Heart Disease Diagnosis , 2021, Computers, Materials & Continua.

[82]  Pascale Massin,et al.  A contribution of image processing to the diagnosis of diabetic retinopathy-detection of exudates in color fundus images of the human retina , 2002, IEEE Transactions on Medical Imaging.

[83]  Yanhui Guo,et al.  A retinal vessel detection approach using convolution neural network with reinforcement sample learning strategy , 2018, Measurement.

[84]  Andrew P. Witkin,et al.  Uniqueness of the Gaussian Kernel for Scale-Space Filtering , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[85]  Ian J. Deary,et al.  Retinal image analysis: concepts, applications and potential , 2006 .

[86]  Bram van Ginneken,et al.  Automated Measurement of the Arteriolar-to-Venular Width Ratio in Digital Color Fundus Photographs , 2011, IEEE Transactions on Medical Imaging.

[87]  Manuel G. Penedo,et al.  Improving retinal artery and vein classification by means of a minimal path approach , 2012, Machine Vision and Applications.