Unsupervised sorting of retinal vessels using locally consistent Gaussian mixtures

BACKGROUND AND OBJECTIVES Retinal blood vessels classification into arterioles and venules is a major task for biomarker identification. Especially, clustering of retinal blood vessels is a challenging task due to factors affecting the images such as contrast variability, non-uniform illumination etc. Hence, a high performance automatic retinal vessel classification system is highly prized. In this paper, we propose a novel unsupervised methodology to classify retinal vessels extracted from fundus camera images into arterioles and venules. METHODS The proposed method utilises the homomorphic filtering (HF) to preprocess the input image for non-uniform illumination and denoising. In the next step, an unsupervised multiscale line operator segmentation technique is used to segment the retinal vasculature before extracting the discriminating features. Finally, the Locally Consistent Gaussian Mixture Model (LCGMM) is utilised for unsupervised sorting of retinal vessels. RESULTS The performance of the proposed unsupervised method was assessed using three publicly accessible databases: INSPIRE-AVR, VICAVR, and MESSIDOR. The proposed framework achieved 90.14%,90.3% and 93.8% classification rate in zone B for the three datasets respectively. CONCLUSIONS The proposed clustering framework provided high classification rate as compared to conventional Gaussian mixture model using Expectation-Maximisation (GMM-EM) approach, thus have a great capability to enhance computer assisted diagnosis and research in field of biomarker discovery.

[1]  Joseph M. Reinhardt,et al.  Automated artery-venous classification of retinal blood vessels based on structural mapping method , 2012, Medical Imaging.

[2]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Farshad Tajeripour,et al.  Computerized Medical Imaging and Graphics Automated Characterization of Blood Vessels as Arteries and Veins in Retinal Images , 2022 .

[4]  Pedro Costa,et al.  Deep Convolutional Artery/Vein Classification of Retinal Vessels , 2018, ICIAR.

[5]  Manuel G. Penedo,et al.  On the Automatic Computation of the Arterio-Venous Ratio in Retinal Images: Using Minimal Paths for the Artery/Vein Classification , 2010, 2010 International Conference on Digital Image Computing: Techniques and Applications.

[6]  A. Osareh,et al.  Vessel Segmentation in Retinal Images Using Multi-scale Line Operator and K-Means Clustering , 2014, Journal of medical signals and sensors.

[7]  Tien Yin Wong,et al.  Retinal vessel diameters and the incidence of gross proteinuria and renal insufficiency in people with type 1 diabetes. , 2004, Diabetes.

[8]  T. MacGillivray,et al.  Differences in retinal vessels support a distinct vasculopathy causing lacunar stroke , 2009, Neurology.

[9]  T. MacGillivraya,et al.  RETINAL VESSEL CLASSIFICATION BASED ON MAXIMIZATION OF SQUARED-LOSS MUTUAL INFORMATION , 2014 .

[10]  Hiroshi Fujita,et al.  Automated selection of major arteries and veins for measurement of arteriolar-to-venular diameter ratio on retinal fundus images , 2011, Comput. Medical Imaging Graph..

[11]  Xin Yang,et al.  A Three-Stage Deep Learning Model for Accurate Retinal Vessel Segmentation , 2019, IEEE Journal of Biomedical and Health Informatics.

[12]  Farida Cheriet,et al.  Joint segmentation and classification of retinal arteries/veins from fundus images , 2019, Artif. Intell. Medicine.

[13]  Carlo Tomasi,et al.  Retinal Artery-Vein Classification via Topology Estimation , 2015, IEEE Transactions on Medical Imaging.

[14]  Bram van Ginneken,et al.  Automated Measurement of the Arteriolar-to-Venular Width Ratio in Digital Color Fundus Photographs , 2011, IEEE Transactions on Medical Imaging.

[15]  Deng Cai,et al.  Gaussian Mixture Model with Local Consistency , 2010, AAAI.

[16]  P. Mitchell,et al.  Retinal Vascular Imaging: A New Tool in Microvascular Disease Research , 2008, Circulation. Cardiovascular imaging.

[17]  Manuel G. Penedo,et al.  Improving retinal artery and vein classification by means of a minimal path approach , 2012, Machine Vision and Applications.

[18]  Aziz Makandar,et al.  Comparative Study of Different Noise Models and Effective Filtering Techniques , 2014 .

[19]  Jie-Jin Wang,et al.  Update: Systemic diseases and the cardiovascular system (V) Retinal Vascular Signs: A Window to the Heart? , 2017 .

[20]  Xun Xu,et al.  Improving dense conditional random field for retinal vessel segmentation by discriminative feature learning and thin-vessel enhancement , 2017, Comput. Methods Programs Biomed..

[21]  Ming Li,et al.  Retinal Blood Vessel Segmentation Based on Multi-Scale Deep Learning , 2018, 2018 Federated Conference on Computer Science and Information Systems (FedCSIS).

[22]  Emanuele Trucco,et al.  Retinal vessel classification: Sorting arteries and veins , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[23]  Mikhail Belkin,et al.  Laplacian Eigenmaps and Spectral Techniques for Embedding and Clustering , 2001, NIPS.

[24]  Deng Cai,et al.  Probabilistic dyadic data analysis with local and global consistency , 2009, ICML '09.

[25]  Tao Tan,et al.  Retinal artery/vein classification using genetic-search feature selection , 2018, Comput. Methods Programs Biomed..

[26]  Gerald Liew,et al.  Manifestaciones vasculares retinianas: ¿reflejan el estado del corazón? , 2011 .

[27]  Mikhail Belkin,et al.  Manifold Regularization: A Geometric Framework for Learning from Labeled and Unlabeled Examples , 2006, J. Mach. Learn. Res..

[28]  Alicja R. Rudnicka,et al.  Automated arteriole and venule classification using deep learning for retinal images from the UK Biobank cohort , 2017, Comput. Biol. Medicine.

[29]  Manuel G. Penedo,et al.  AUTOMATIC CLASSIFICATION OF RETINAL VESSELS INTO ARTERIES AND VEINS , 2010 .

[30]  Tien Yin Wong,et al.  Hypertensive retinopathy signs as risk indicators of cardiovascular morbidity and mortality. , 2005, British medical bulletin.

[31]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[32]  A. Hofman,et al.  Retinal vascular caliber and risk of dementia , 2011, Neurology.

[33]  M. Grgic,et al.  Sub-Image Homomorphic Filtering Technique for Improving Facial Identification under Difficult Illumination Conditions , 2006 .

[34]  Elena De Momi,et al.  Blood vessel segmentation algorithms - Review of methods, datasets and evaluation metrics , 2018, Comput. Methods Programs Biomed..

[35]  Yanhui Guo,et al.  A novel retinal vessel detection approach based on multiple deep convolution neural networks , 2018, Comput. Methods Programs Biomed..

[36]  Xiaoyi Jiang,et al.  Separation of the retinal vascular graph in arteries and veins based upon structural knowledge , 2009, Image Vis. Comput..

[37]  Kotagiri Ramamohanarao,et al.  An effective automated system for grading severity of retinal arteriovenous nicking in colour retinal images , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[38]  D Relan,et al.  Multiscale self-quotient filtering for an improved unsupervised retinal blood vessels characterisation , 2018, Biomedical engineering letters.

[39]  Bjoern H. Menze,et al.  DeepVesselNet: Vessel Segmentation, Centerline Prediction, and Bifurcation Detection in 3-D Angiographic Volumes , 2018, Frontiers in Neuroscience.

[40]  Albert Hofman,et al.  Retinal Vessel Diameters and Risk of Hypertension: The Rotterdam Study , 2006 .

[41]  J. Tenenbaum,et al.  A global geometric framework for nonlinear dimensionality reduction. , 2000, Science.

[42]  Bernhard Schölkopf,et al.  Learning with Local and Global Consistency , 2003, NIPS.

[43]  David Lowe,et al.  A Generative Model for Separating Illumination and Reflectance from Images , 2003, J. Mach. Learn. Res..

[44]  A. Ruggeri,et al.  An improved system for the automatic estimation of the Arteriolar-to-Venular diameter Ratio (AVR) in retinal images , 2008, 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[45]  Daniel Kondermann,et al.  Blood vessel classification into arteries and veins in retinal images , 2007, SPIE Medical Imaging.

[46]  Qiao Hu,et al.  Automated Separation of Binary Overlapping Trees in Low-Contrast Color Retinal Images , 2013, MICCAI.

[47]  B. Wasan,et al.  Vascular network changes in the retina with age and hypertension , 1995, Journal of hypertension.

[48]  Widodo Budiharto,et al.  The Classification of Hypertensive Retinopathy using Convolutional Neural Network , 2017, ICCSCI.

[49]  Kotagiri Ramamohanarao,et al.  An effective retinal blood vessel segmentation method using multi-scale line detection , 2013, Pattern Recognit..

[50]  He Zhao,et al.  Retinal vascular junction detection and classification via deep neural networks , 2020, Comput. Methods Programs Biomed..

[51]  Chin-Chen Chang,et al.  A Novel Retinal Blood Vessel Segmentation Method Based on Line Operator and Edge Detector , 2009, 2009 Fifth International Conference on Intelligent Information Hiding and Multimedia Signal Processing.

[52]  Alfredo Ruggeri,et al.  A divide et impera strategy for automatic classification of retinal vessels into arteries and veins , 2003, Proceedings of the 25th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (IEEE Cat. No.03CH37439).

[53]  Haidi Ibrahim,et al.  Mathematical Equations for Homomorphic Filtering in Frequency Domain: A Literature Survey , 2012 .

[54]  Amel H.Abbas,et al.  Image Enhancement By Using Homomorphic Filtering Model , 2017, ICIT 2017.

[55]  Ana Maria Mendonça,et al.  An Automatic Graph-Based Approach for Artery/Vein Classification in Retinal Images , 2014, IEEE Transactions on Image Processing.

[56]  C. Rowe,et al.  Retinal vascular biomarkers for early detection and monitoring of Alzheimer's disease , 2013, Translational Psychiatry.

[57]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[58]  Tien Yin Wong,et al.  Is retinal photography useful in the measurement of stroke risk? , 2004, The Lancet Neurology.

[59]  M. Sonka,et al.  Retinal Imaging and Image Analysis , 2010, IEEE Reviews in Biomedical Engineering.

[60]  A. Proia,et al.  Intraretinal neovascularization in diabetic retinopathy. , 2010, Archives of ophthalmology.

[61]  R. Klein,et al.  Relationships between age, blood pressure, and retinal vessel diameters in an older population. , 2003, Investigative ophthalmology & visual science.

[62]  Michael D. Abràmoff,et al.  An improved arteriovenous classification method for the early diagnostics of various diseases in retinal image , 2017, Comput. Methods Programs Biomed..

[63]  M. Usman Akram,et al.  Arteriovenous ratio and papilledema based hybrid decision support system for detection and grading of hypertensive retinopathy , 2018, Comput. Methods Programs Biomed..

[64]  Andrea Giachetti,et al.  Effective features for artery-vein classification in digital fundus images , 2012, 2012 25th IEEE International Symposium on Computer-Based Medical Systems (CBMS).

[65]  Keshab K. Parhi,et al.  Artery/vein classification of retinal blood vessels using feature selection , 2016, 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[66]  Michael H. Goldbaum,et al.  Automatic Identification of Retinal Arteries and Veins in Fundus Images using Local Binary Patterns , 2016, ArXiv.

[67]  Ching Y. Suen,et al.  Thinning Methodologies - A Comprehensive Survey , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[68]  Elisa Ricci,et al.  Retinal Blood Vessel Segmentation Using Line Operators and Support Vector Classification , 2007, IEEE Transactions on Medical Imaging.

[69]  Terry Taewoong Um,et al.  Multi-categorical deep learning neural network to classify retinal images: A pilot study employing small database , 2017, PloS one.

[70]  E. R. Davies,et al.  Machine vision - theory, algorithms, practicalities , 2004 .

[71]  Akitoshi Yoshida,et al.  Characteristics of Retinal Neovascularization in Proliferative Diabetic Retinopathy Imaged by Optical Coherence Tomography Angiography. , 2016, Investigative ophthalmology & visual science.

[72]  R. Klein,et al.  Retinal microvascular abnormalities and incident stroke: the Atherosclerosis Risk in Communities Study , 2001, The Lancet.

[73]  T. Wong,et al.  Retinal Signs and Stroke: Revisiting the Link Between the Eye and Brain , 2008, Stroke.

[74]  U. Feige,et al.  Spectral Graph Theory , 2015 .

[75]  Manuel G. Penedo,et al.  Development of an automated system to classify retinal vessels into arteries and veins , 2012, Comput. Methods Programs Biomed..

[76]  Bunyarit Uyyanonvara,et al.  Blood vessel segmentation methodologies in retinal images - A survey , 2012, Comput. Methods Programs Biomed..

[77]  reza kharghanian,et al.  Retinal Blood Vessel Segmentation Using Gabor Wavelet and Line Operator , 2012 .

[78]  Xiaojin Zhu,et al.  Harmonic mixtures: combining mixture models and graph-based methods for inductive and scalable semi-supervised learning , 2005, ICML.

[79]  Vismay Jain,et al.  Additive and Multiplicative Noise Removal by using Gradient Histogram Preservations Approach , 2015 .

[80]  Sang Jun Park,et al.  Scale-space approximated convolutional neural networks for retinal vessel segmentation , 2019, Comput. Methods Programs Biomed..

[81]  Mong-Li Lee,et al.  Automatic grading of retinal vessel caliber , 2005, IEEE Transactions on Biomedical Engineering.