Automated Tortuosity Analysis of Nerve Fibers in Corneal Confocal Microscopy

Precise characterization and analysis of corneal nerve fiber tortuosity are of great importance in facilitating examination and diagnosis of many eye-related diseases. In this paper we propose a fully automated method for image-level tortuosity estimation, comprising image enhancement, exponential curvature estimation, and tortuosity level classification. The image enhancement component is based on an extended Retinex model, which not only corrects imbalanced illumination and improves image contrast in an image, but also models noise explicitly to aid removal of imaging noise. Afterwards, we take advantage of exponential curvature estimation in the 3D space of positions and orientations to directly measure curvature based on the enhanced images, rather than relying on the explicit segmentation and skeletonization steps in a conventional pipeline usually with accumulated pre-processing errors. The proposed method has been applied over two corneal nerve microscopy datasets for the estimation of a tortuosity level for each image. The experimental results show that it performs better than several selected state-of-the-art methods. Furthermore, we have performed manual gradings at tortuosity level of four hundred and three corneal nerve microscopic images, and this dataset has been released for public access to facilitate other researchers in the community in carrying out further research on the same and related topics.

[1]  Xiao-Ping Zhang,et al.  A Probabilistic Method for Image Enhancement With Simultaneous Illumination and Reflectance Estimation , 2015, IEEE Transactions on Image Processing.

[2]  Alfredo Ruggeri,et al.  Automatic evaluation of corneal nerve tortuosity in images from in vivo confocal microscopy. , 2011, Investigative ophthalmology & visual science.

[3]  John Flynn,et al.  Characterization of changes in blood vessel width and tortuosity in retinopathy of prematurity using image analysis , 2002, Medical Image Anal..

[4]  N Efron,et al.  Morphology of Corneal Nerves Using Confocal Microscopy , 2001, Cornea.

[5]  Michael Elad,et al.  Retinex by Two Bilateral Filters , 2005, Scale-Space.

[6]  Jiang Liu,et al.  Retinal Vascular Network Topology Reconstruction and Artery/Vein Classification via Dominant Set Clustering , 2020, IEEE Transactions on Medical Imaging.

[7]  Kai Liu,et al.  Retinex-based image enhancement framework by using region covariance filter , 2018, Soft Comput..

[8]  Josien P. W. Pluim,et al.  Robust Retinal Vessel Segmentation via Locally Adaptive Derivative Frames in Orientation Scores , 2016, IEEE Transactions on Medical Imaging.

[9]  Yalin Zheng,et al.  Retinal Vessel Segmentation: An Efficient Graph Cut Approach with Retinex and Local Phase , 2015, PloS one.

[10]  Takao Nishitani,et al.  Efficient multi-scale retinex algorithm using multi-rate image processing , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[11]  Ernesto Bribiesca,et al.  A measure of tortuosity based on chain coding , 2013, Pattern Recognit..

[12]  Martin Aastrup Olsen,et al.  Improving Uncertainty Estimation in Convolutional Neural Networks Using Inter-rater Agreement , 2019, MICCAI.

[13]  Remco Duits,et al.  Crossing-Preserving Coherence-Enhancing Diffusion on Invertible Orientation Scores , 2009, International Journal of Computer Vision.

[14]  Michael Elad,et al.  A Variational Framework for Retinex , 2002, IS&T/SPIE Electronic Imaging.

[15]  Giovanni Staurenghi,et al.  Automated software analysis of corneal micrographs for peripheral neuropathy. , 2010, Investigative ophthalmology & visual science.

[16]  Ernesto Bribiesca,et al.  2D tree object representation via the slope chain code , 2014, Pattern Recognit..

[17]  Yongtian Wang,et al.  Region-based saliency estimation for 3D shape analysis and understanding , 2016, Neurocomputing.

[18]  Remco Duits,et al.  A Multi-Orientation Analysis Approach to Retinal Vessel Tracking , 2012, Journal of Mathematical Imaging and Vision.

[19]  Ke Chen,et al.  Automated Vessel Segmentation Using Infinite Perimeter Active Contour Model with Hybrid Region Information with Application to Retinal Images , 2015, IEEE Transactions on Medical Imaging.

[20]  Yongtian Wang,et al.  Intensity and Compactness Enabled Saliency Estimation for Leakage Detection in Diabetic and Malarial Retinopathy , 2017, IEEE Transactions on Medical Imaging.

[21]  O Smedby,et al.  Two-dimensional tortuosity of the superficial femoral artery in early atherosclerosis. , 1993, Journal of vascular research.

[22]  L. Joskowicz,et al.  Inter-observer variability of manual contour delineation of structures in CT , 2018, European Radiology.

[23]  Xiaoyan Sun,et al.  Structure-Revealing Low-Light Image Enhancement Via Robust Retinex Model , 2018, IEEE Transactions on Image Processing.

[24]  Joongkyu Kim,et al.  Retinex method based on adaptive smoothing for illumination invariant face recognition , 2008, Signal Process..

[25]  K. G. Goh,et al.  ADRIS : an Automatic Diabetic Retinal Image Screening system , 2001 .

[26]  Nathan Efron,et al.  Corneal nerve tortuosity in diabetic patients with neuropathy. , 2004, Investigative ophthalmology & visual science.

[27]  E. Land,et al.  Lightness and retinex theory. , 1971, Journal of the Optical Society of America.

[28]  Shruti Aggarwal,et al.  A fully automated tortuosity quantification system with application to corneal nerve fibres in confocal microscopy images , 2016, Medical Image Anal..

[29]  Yalin Zheng,et al.  Exploiting Reliability-Guided Aggregation for the Assessment of Curvilinear Structure Tortuosity , 2019, MICCAI.

[30]  Yonghuai Liu,et al.  A Retinex theory based points sampling method for mesh simplification , 2011, 2011 7th International Symposium on Image and Signal Processing and Analysis (ISPA).

[31]  M. C. Hanumantharaju,et al.  Development of multiscale retinex algorithm for medical image enhancement based on multi-rate sampling , 2013, 2013 International Conference on Signal Processing , Image Processing & Pattern Recognition.

[32]  S. Pizer,et al.  Measuring tortuosity of the intracerebral vasculature from MRA images , 2003, IEEE Transactions on Medical Imaging.

[33]  Nathan Efron,et al.  Optimal Image Sample Size for Corneal Nerve Morphometry , 2012, Optometry and vision science : official publication of the American Academy of Optometry.

[34]  Alejandro F. Frangi,et al.  CS-Net: Channel and Spatial Attention Network for Curvilinear Structure Segmentation , 2019, MICCAI.

[35]  Alfredo Ruggeri,et al.  Development of Clinically Based Corneal Nerves Tortuosity Indexes , 2017, FIFI/OMIA@MICCAI.

[36]  Wotao Yin,et al.  Global Convergence of ADMM in Nonconvex Nonsmooth Optimization , 2015, Journal of Scientific Computing.

[37]  Tom Goldstein,et al.  The Split Bregman Method for L1-Regularized Problems , 2009, SIAM J. Imaging Sci..

[38]  Yalin Zheng,et al.  Retinal Artery and Vein Classification via Dominant Sets Clustering-Based Vascular Topology Estimation , 2018, MICCAI.

[39]  Jian Sun,et al.  Guided Image Filtering , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[40]  Xiao-Ping Zhang,et al.  A Weighted Variational Model for Simultaneous Reflectance and Illumination Estimation , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[41]  B. H. Romeny,et al.  Curvature Based Biomarkers for Diabetic Retinopathy via Exponential Curve Fits in SE(2) , 2015 .

[42]  Shruti Aggarwal,et al.  Tortuosity classification of corneal nerves images using a multiple-scale-multiple-window approach , 2014 .

[43]  Bryan M. Williams,et al.  An artificial intelligence-based deep learning algorithm for the diagnosis of diabetic neuropathy using corneal confocal microscopy: a development and validation study , 2019, Diabetologia.

[44]  Enrico Grisan,et al.  A Novel Method for the Automatic Grading of Retinal Vessel Tortuosity , 2008, IEEE Transactions on Medical Imaging.

[45]  Zia-ur Rahman,et al.  Properties and performance of a center/surround retinex , 1997, IEEE Trans. Image Process..

[46]  Henkjan Huisman,et al.  Supervised Uncertainty Quantification for Segmentation with Multiple Annotations , 2019, MICCAI.

[47]  N. Pritchard,et al.  Standardizing corneal nerve fibre length for nerve tortuosity increases its association with measures of diabetic neuropathy , 2014, Diabetic medicine : a journal of the British Diabetic Association.

[48]  Juno Kim,et al.  Automatic analysis of corneal nerves imaged using in vivo confocal microscopy , 2018, Clinical & experimental optometry.

[49]  M. Ali Akber Dewan,et al.  A Dynamic Histogram Equalization for Image Contrast Enhancement , 2007, IEEE Transactions on Consumer Electronics.

[50]  Yongtian Wang,et al.  Automatic 2-D/3-D Vessel Enhancement in Multiple Modality Images Using a Weighted Symmetry Filter , 2018, IEEE Transactions on Medical Imaging.

[51]  Aaron Carass,et al.  Why rankings of biomedical image analysis competitions should be interpreted with care , 2018, Nature Communications.

[52]  D. Bracher,et al.  Changes in peripapillary tortuosity of the central retinal arteries in newborns , 1982, Graefe's Archive for Clinical and Experimental Ophthalmology.

[53]  Tingfa Xu,et al.  Non-uniform illumination endoscopic imaging enhancement via anti-degraded model and L1L2-based variational retinex , 2017, EURASIP J. Wirel. Commun. Netw..

[54]  Jiang Liu,et al.  Topology Reconstruction of Tree-Like Structure in Images via Structural Similarity Measure and Dominant Set Clustering , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[55]  Nathan Efron,et al.  Corneal Confocal Microscopy Predicts 4-Year Incident Peripheral Neuropathy in Type 1 Diabetes , 2015, Diabetes Care.

[56]  Michael H. Goldbaum,et al.  Measurement and classification of retinal vascular tortuosity , 1999, Int. J. Medical Informatics.