A fully automated tortuosity quantification system with application to corneal nerve fibres in confocal microscopy images

Recent clinical research has highlighted important links between a number of diseases and the tortuosity of curvilinear anatomical structures like corneal nerve fibres, suggesting that tortuosity changes might detect early stages of specific conditions. Currently, clinical studies are mainly based on subjective, visual assessment, with limited repeatability and inter-observer agreement. To address these problems, we propose a fully automated framework for image-level tortuosity estimation, consisting of a hybrid segmentation method and a highly adaptable, definition-free tortuosity estimation algorithm. The former combines an appearance model, based on a Scale and Curvature-Invariant Ridge Detector (SCIRD), with a context model, including multi-range learned context filters. The latter is based on a novel tortuosity estimation paradigm in which discriminative, multi-scale features can be automatically learned for specific anatomical objects and diseases. Experimental results on 140 in vivo confocal microscopy images of corneal nerve fibres from healthy and unhealthy subjects demonstrate the excellent performance of our method compared to state-of-the-art approaches and ground truth annotations from 3 expert observers.

[1]  Antonio Criminisi,et al.  Decision Forests: A Unified Framework for Classification, Regression, Density Estimation, Manifold Learning and Semi-Supervised Learning , 2012, Found. Trends Comput. Graph. Vis..

[2]  R. Klein,et al.  Retinal vascular tortuosity, blood pressure, and cardiovascular risk factors. , 2011, Ophthalmology.

[3]  Roberto Marcondes Cesar Junior,et al.  Retinal vessel segmentation using the 2-D Gabor wavelet and supervised classification , 2005, IEEE Transactions on Medical Imaging.

[4]  Emanuele Trucco,et al.  Scale and Curvature Invariant Ridge Detector for Tortuous and Fragmented Structures , 2015, MICCAI.

[5]  Emanuele Trucco,et al.  Modeling the Tortuosity of Retinal Vessels: Does Caliber Play a Role? , 2010, IEEE Transactions on Biomedical Engineering.

[6]  Nasser M. Nasrabadi,et al.  Pattern Recognition and Machine Learning , 2006, Technometrics.

[7]  Ernesto Bribiesca,et al.  A measure of tortuosity based on chain coding , 2013, Pattern Recognit..

[8]  J. J. Wang,et al.  Retinal vascular tortuosity in persons with diabetes and diabetic retinopathy , 2011, Diabetologia.

[9]  Ioannis A. Kakadiaris,et al.  Automatic Centerline Extraction of Irregular Tubular Structures Using Probability Volumes from Multiphoton Imaging , 2007, MICCAI.

[10]  Vincent Lepetit,et al.  Multiscale Centerline Detection by Learning a Scale-Space Distance Transform , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[11]  Baljean Dhillon,et al.  Retinal changes in visceral leishmaniasis by retinal photography , 2014, BMC Infectious Diseases.

[12]  P. Dayan,et al.  Curved Gaussian models with application to modeling foreign exchange rates , 2000 .

[13]  Joseph M. Reinhardt,et al.  Automated measurement of retinal blood vessel tortuosity , 2010, Medical Imaging.

[14]  Alfredo Ruggeri,et al.  Focused Tortuosity Definitions Based on Expert Clinical Assessment of Corneal Subbasal Nerves. , 2015, Investigative ophthalmology & visual science.

[15]  Isabelle Bloch,et al.  A review of 3D vessel lumen segmentation techniques: Models, features and extraction schemes , 2009, Medical Image Anal..

[16]  Guy Lapalme,et al.  A systematic analysis of performance measures for classification tasks , 2009, Inf. Process. Manag..

[17]  Fuhui Long,et al.  Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy , 2003, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[19]  S. Pizer,et al.  Measuring tortuosity of the intracerebral vasculature from MRA images , 2003, IEEE Transactions on Medical Imaging.

[20]  Roberto Marcondes Cesar Junior,et al.  Retinal Vessel Segmentation Using the 2-D Morlet Wavelet and Supervised Classification , 2005, ArXiv.

[21]  Pedram Hamrah,et al.  Corneal sensation and subbasal nerve alterations in patients with herpes simplex keratitis: an in vivo confocal microscopy study. , 2010, Ophthalmology.

[22]  Joachim Hornegger,et al.  Multiscale Approach for Blood Vessel Segmentation on Retinal Fundus Images , 2009 .

[23]  R. Dana,et al.  Unilateral herpes zoster ophthalmicus results in bilateral corneal nerve alteration: an in vivo confocal microscopy study. , 2013, Ophthalmology.

[24]  N Efron,et al.  Morphology of Corneal Nerves Using Confocal Microscopy , 2001, Cornea.

[25]  G. Dougherty,et al.  A quantitative index for the measurement of the tortuosity of blood vessels. , 2000, Medical engineering & physics.

[26]  Kazuaki Miyamoto,et al.  Retinal vessel tortuosity associated with central retinal vein occlusion: an optical coherence tomography study. , 2014, Investigative ophthalmology & visual science.

[27]  Vincent Lepetit,et al.  Supervised Feature Learning for Curvilinear Structure Segmentation , 2013, MICCAI.

[28]  John Flynn,et al.  Characterization of changes in blood vessel width and tortuosity in retinopathy of prematurity using image analysis , 2002, Medical Image Anal..

[29]  P. Hamrah,et al.  Corneal nerve alterations in acute Acanthamoeba and fungal keratitis: an in vivo confocal microscopy study , 2009, Eye.

[30]  Zhuowen Tu,et al.  Auto-Context and Its Application to High-Level Vision Tasks and 3D Brain Image Segmentation , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  Alfredo Ruggeri,et al.  Automatic evaluation of corneal nerve tortuosity in images from in vivo confocal microscopy. , 2011, Investigative ophthalmology & visual science.

[32]  Tien Yin Wong,et al.  Retinal Vessel Tortuosity and Its Relation to Traditional and Novel Vascular Risk Markers in Persons with Diabetes , 2015, Current eye research.

[33]  Pedram Hamrah,et al.  Inflammation and the nervous system: the connection in the cornea in patients with infectious keratitis. , 2011, Investigative ophthalmology & visual science.

[34]  G M Raab,et al.  Design and Analysis of Reliability Studies—the Statistical Evaluation of Measurement Errors , 1991 .

[35]  Nicholas Ayache,et al.  Medical Image Computing and Computer-Assisted Intervention – MICCAI 2012 , 2012, Lecture Notes in Computer Science.

[36]  Francesco Torella,et al.  The impact of endovascular aneurysm repair on aortoiliac tortuosity and its use as a predictor of iliac limb complications. , 2014, Journal of vascular surgery.

[37]  Gerhard Goos,et al.  Medical Image Computing and Computer-Assisted Intervention – MICCAI 2014 , 2014, Lecture Notes in Computer Science.

[38]  Enrico Grisan,et al.  A Novel Method for the Automatic Grading of Retinal Vessel Tortuosity , 2008, IEEE Transactions on Medical Imaging.

[39]  Zhuowen Tu,et al.  Auto-context and its application to high-level vision tasks , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[40]  Nikos Paragios,et al.  Graph-Based Geometric-Iconic Guide-Wire Tracking , 2011, MICCAI.

[41]  G H Edington Tortuosity of both Internal Carotid Arteries , 1901, British medical journal.

[42]  Max W. K. Law,et al.  Three Dimensional Curvilinear Structure Detection Using Optimally Oriented Flux , 2008, ECCV.

[43]  Alejandro F. Frangi,et al.  Muliscale Vessel Enhancement Filtering , 1998, MICCAI.

[44]  N. Pritchard,et al.  Standardizing corneal nerve fibre length for nerve tortuosity increases its association with measures of diabetic neuropathy , 2014, Diabetic medicine : a journal of the British Diabetic Association.

[45]  Isabelle Guyon,et al.  An Introduction to Variable and Feature Selection , 2003, J. Mach. Learn. Res..

[46]  LeCunYann,et al.  Learning Hierarchical Features for Scene Labeling , 2013 .

[47]  Emanuele Trucco,et al.  Boosting Hand-Crafted Features for Curvilinear Structure Segmentation by Learning Context Filters , 2015, MICCAI.

[48]  Michael H. Goldbaum,et al.  Measurement and classification of retinal vascular tortuosity , 1999, Int. J. Medical Informatics.

[49]  Andrew Y. Ng,et al.  Learning Feature Representations with K-Means , 2012, Neural Networks: Tricks of the Trade.

[50]  RatesJuan K. LinDepartment Curved Gaussian Models with Application to the Modelingof Foreign Exchange , 1999 .

[51]  Guido Gerig,et al.  Abnormal Vessel Tortuosity as a Marker of Treatment Response of Malignant Gliomas: Preliminary Report , 2004, Technology in cancer research & treatment.

[52]  T. Wong,et al.  Retinal Vascular Caliber Measurements: Clinical Significance, Current Knowledge and Future Perspectives , 2012, Ophthalmologica.

[53]  Amir Lerman,et al.  Coronary Artery Tortuosity in Spontaneous Coronary Artery Dissection: Angiographic Characteristics and Clinical Implications , 2014, Circulation. Cardiovascular interventions.

[54]  J Cairney,et al.  Tortuosity of the Cervical Segment of the Internal Carotid Artery. , 1924, Journal of anatomy.

[55]  Henk Marquering,et al.  Increased aortic tortuosity indicates a more severe aortic phenotype in adults with Marfan syndrome. , 2015, International journal of cardiology.

[56]  Gábor Székely,et al.  Joint 3-D vessel segmentation and centerline extraction using oblique Hough forests with steerable filters , 2015, Medical Image Anal..

[57]  Michael D Abràmoff,et al.  Retinal arterial but not venous tortuosity correlates with facioscapulohumeral muscular dystrophy severity. , 2009, Journal of AAPOS : the official publication of the American Association for Pediatric Ophthalmology and Strabismus.

[58]  Nassir Navab,et al.  Medical Image Computing and Computer-Assisted Intervention – MICCAI 2013 , 2013, Lecture Notes in Computer Science.

[59]  Alejandro F. Frangi,et al.  Automated landmarking and geometric characterization of the carotid siphon , 2012, Medical Image Anal..

[60]  Anil A. Bharath,et al.  Segmentation of blood vessels from red-free and fluorescein retinal images , 2007, Medical Image Anal..

[61]  Nathan Efron,et al.  Corneal nerve tortuosity in diabetic patients with neuropathy. , 2004, Investigative ophthalmology & visual science.

[62]  Shruti Aggarwal,et al.  Tortuosity classification of corneal nerves images using a multiple-scale-multiple-window approach , 2014 .

[63]  Vincent Lepetit,et al.  Accurate and Efficient Linear Structure Segmentation by Leveraging Ad Hoc Features with Learned Filters , 2012, MICCAI.

[64]  Emanuele Trucco,et al.  Leveraging Multiscale Hessian-Based Enhancement With a Novel Exudate Inpainting Technique for Retinal Vessel Segmentation , 2016, IEEE Journal of Biomedical and Health Informatics.

[65]  Camille Couprie,et al.  Learning Hierarchical Features for Scene Labeling , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[66]  Hugues Bersini,et al.  A Survey on Filter Techniques for Feature Selection in Gene Expression Microarray Analysis , 2012, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[67]  Feng Gao,et al.  Optic nerve tortuosity in children with neurofibromatosis type 1 , 2013, Pediatric Radiology.

[68]  Aneta Lisowska,et al.  An experimental assessment of five indices of retinal vessel tortuosity with the RET-TORT public dataset , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[69]  Zygmunt Wróbel,et al.  Fully automatic algorithm for the analysis of vessels in the angiographic image of the eye fundus , 2012, Biomedical engineering online.

[70]  Stephen R. Aylward,et al.  Analyzing attributes of vessel populations , 2005, Medical Image Anal..

[71]  Julius Hannink,et al.  Crossing-Preserving Multi-scale Vesselness , 2014, MICCAI.

[72]  Christopher G Owen,et al.  Diabetes and the tortuosity of vessels of the bulbar conjunctiva. , 2008, Ophthalmology.