The multiscale top-hat tensor enables specific enhancement of curvilinear structures in 2D and 3D images.

Quantification and modelling of curvilinear structures in 2D and 3D images is a common challenge in a wide range of biomedical applications. Image enhancement is a crucial pre-processing step for curvilinear structure quantification. Many of the existing state-of-the-art enhancement approaches still suffer from contrast variations and noise. In this paper, we propose to address such problems via the use of a multiscale image processing approach, called Multiscale Top-Hat Tensor (MTHT). MTHT produces a better quality enhancement of curvilinear structures in low contrast and noisy images compared with other approaches in a range of 2D and 3D biomedical images. The proposed approach combines multiscale morphological filtering with a local tensor representation of curvilinear structure. The MTHT approach is validated on 2D and 3D synthetic and real images, and is also compared to the state-of-the-art curvilinear structure enhancement approaches. The obtained results demonstrate that the proposed approach provides high-quality curvilinear structure enhancement, allowing high accuracy segmentation and quantification in a wide range of 2D and 3D image datasets.

[1]  Emanuele Trucco,et al.  Scale and Curvature Invariant Ridge Detector for Tortuous and Fragmented Structures , 2015, MICCAI.

[2]  Mark S. Nixon,et al.  Feature extraction & image processing for computer vision , 2012 .

[3]  Jon Atli Benediktsson,et al.  Automatic retinal vessel extraction based on directional mathematical morphology and fuzzy classification , 2014, Pattern Recognit. Lett..

[4]  Edward H. Adelson,et al.  Steerable filters for early vision, image analysis, and wavelet decomposition , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[5]  Emanuele Trucco,et al.  FABC: Retinal Vessel Segmentation Using AdaBoost , 2010, IEEE Transactions on Information Technology in Biomedicine.

[6]  Héctor Benítez-Pérez,et al.  Parallel Multiscale Feature Extraction and Region Growing: Application in Retinal Blood Vessel Detection , 2010, IEEE Transactions on Information Technology in Biomedicine.

[7]  Boguslaw Obara,et al.  A bioimage informatics approach to automatically extract complex fungal networks , 2012, Bioinform..

[8]  Peng-Lang Shui,et al.  Noise-robust edge detector combining isotropic and anisotropic Gaussian kernels , 2012, Pattern Recognit..

[9]  Bostjan Likar,et al.  Enhancement of Vascular Structures in 3D and 2D Angiographic Images , 2016, IEEE Transactions on Medical Imaging.

[10]  Ghassan Hamarneh,et al.  VascuSynth: Simulating vascular trees for generating volumetric image data with ground-truth segmentation and tree analysis , 2010, Comput. Medical Imaging Graph..

[11]  Jan Kautz,et al.  Local Laplacian filters: edge-aware image processing with a Laplacian pyramid , 2011, SIGGRAPH 2011.

[12]  Mohammad Ghanbari,et al.  Gaussian mixture model-based contrast enhancement , 2015, IET Image Process..

[13]  A.D. Hoover,et al.  Locating blood vessels in retinal images by piecewise threshold probing of a matched filter response , 2000, IEEE Transactions on Medical Imaging.

[14]  George Azzopardi,et al.  Trainable COSFIRE filters for vessel delineation with application to retinal images , 2015, Medical Image Anal..

[15]  J. Yerushalmy Statistical problems in assessing methods of medical diagnosis, with special reference to X-ray techniques. , 1947, Public health reports.

[16]  Xiaoyi Jiang,et al.  Adaptive Local Thresholding by Verification-Based Multithreshold Probing with Application to Vessel Detection in Retinal Images , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  B. S. Manjunath,et al.  Evaluation and benchmark for biological image segmentation , 2008, 2008 15th IEEE International Conference on Image Processing.

[18]  A. Osareh,et al.  Vessel Segmentation in Retinal Images Using Multi-scale Line Operator and K-Means Clustering , 2014, Journal of medical signals and sensors.

[19]  Ana Maria Mendonça,et al.  Segmentation of retinal blood vessels by combining the detection of centerlines and morphological reconstruction , 2006, IEEE Transactions on Medical Imaging.

[20]  Kotagiri Ramamohanarao,et al.  An effective retinal blood vessel segmentation method using multi-scale line detection , 2013, Pattern Recognit..

[21]  Josien P. W. Pluim,et al.  Robust Retinal Vessel Segmentation via Locally Adaptive Derivative Frames in Orientation Scores , 2016, IEEE Transactions on Medical Imaging.

[22]  Miao Liao,et al.  Retinal vessel enhancement based on multi-scale top-hat transformation and histogram fitting stretching , 2014 .

[23]  Emanuele Trucco,et al.  Retinal vessel segmentation using multiwavelet kernels and multiscale hierarchical decomposition , 2013, Pattern Recognit..

[24]  David Gavaghan,et al.  Contrast-Independent Curvilinear Structure Detection in Biomedical Images , 2012, IEEE Transactions on Image Processing.

[25]  Qinmu Peng,et al.  Segmentation of retinal blood vessels using the radial projection and semi-supervised approach , 2011, Pattern Recognit..

[26]  Hugues Talbot,et al.  2D Filtering of Curvilinear Structures by Ranking the Orientation Responses of Path Operators (RORPO) , 2017, Image Process. Line.

[27]  Anil K. Jain,et al.  Handbook of Fingerprint Recognition , 2005, Springer Professional Computing.

[28]  Nicolas Passat,et al.  Curvilinear Structure Analysis by Ranking the Orientation Responses of Path Operators , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  Xinhua Zhuang,et al.  Image Analysis Using Mathematical Morphology , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Anil A. Bharath,et al.  Segmentation of blood vessels from red-free and fluorescein retinal images , 2007, Medical Image Anal..

[31]  George Azzopardi,et al.  Supervised vessel delineation in retinal fundus images with the automatic selection of B-COSFIRE filters , 2016, Machine Vision and Applications.

[32]  Martin J. Wainwright,et al.  Image denoising using scale mixtures of Gaussians in the wavelet domain , 2003, IEEE Trans. Image Process..

[33]  E Meijering,et al.  Design and validation of a tool for neurite tracing and analysis in fluorescence microscopy images , 2004, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[34]  Hugues Talbot,et al.  Directional Morphological Filtering , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[35]  Alejandro F. Frangi,et al.  Muliscale Vessel Enhancement Filtering , 1998, MICCAI.

[36]  Roberto Marcondes Cesar Junior,et al.  Retinal vessel segmentation using the 2-D Gabor wavelet and supervised classification , 2005, IEEE Transactions on Medical Imaging.

[37]  David M. W. Powers,et al.  Evaluation: from precision, recall and F-measure to ROC, informedness, markedness and correlation , 2011, ArXiv.

[38]  Bradley M. Hemminger,et al.  Contrast Limited Adaptive Histogram Equalization image processing to improve the detection of simulated spiculations in dense mammograms , 1998, Journal of Digital Imaging.

[39]  Bunyarit Uyyanonvara,et al.  An approach to localize the retinal blood vessels using bit planes and centerline detection , 2012, Comput. Methods Programs Biomed..

[40]  Tariq M. Khan,et al.  A generalized multi-scale line-detection method to boost retinal vessel segmentation sensitivity , 2018, Pattern Analysis and Applications.

[41]  Tom Fawcett,et al.  An introduction to ROC analysis , 2006, Pattern Recognit. Lett..

[42]  Max A. Viergever,et al.  Ridge-based vessel segmentation in color images of the retina , 2004, IEEE Transactions on Medical Imaging.

[43]  José Manuel Bravo,et al.  A New Supervised Method for Blood Vessel Segmentation in Retinal Images by Using Gray-Level and Moment Invariants-Based Features , 2011, IEEE Transactions on Medical Imaging.

[44]  P. Bankhead,et al.  Fast Retinal Vessel Detection and Measurement Using Wavelets and Edge Location Refinement , 2012, PloS one.

[45]  Jose Luis Vazquez Noguera,et al.  Top-Hat Transform for Enhancement of Aerial Thermal Images , 2017, 2017 30th SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI).

[46]  Frank Y. Shih,et al.  Retinal vessels segmentation based on level set and region growing , 2014, Pattern Recognit..

[47]  Bernard De Baets,et al.  Unsupervised ridge detection using second order anisotropic Gaussian kernels , 2015, Signal Process..

[48]  Yanli Hou,et al.  Automatic Segmentation of Retinal Blood Vessels Based on Improved Multiscale Line Detection , 2014, J. Comput. Sci. Eng..

[49]  David E. Goldberg,et al.  Genetic algorithms and Machine Learning , 1988, Machine Learning.

[50]  Yaonan Wang,et al.  Multiscale Bi-Gaussian Filter for Adjacent Curvilinear Structures Detection With Application to Vasculature Images , 2013, IEEE Transactions on Image Processing.

[51]  Gholamreza Anbarjafari,et al.  IMAGE Resolution Enhancement by Using Discrete and Stationary Wavelet Decomposition , 2011, IEEE Transactions on Image Processing.

[52]  Andrew Hunter,et al.  An Active Contour Model for Segmenting and Measuring Retinal Vessels , 2009, IEEE Transactions on Medical Imaging.

[53]  George D. C. Cavalcanti,et al.  Unsupervised Retinal Vessel Segmentation Using Combined Filters , 2016, PloS one.

[54]  Ju Lu,et al.  The DIADEM Data Sets: Representative Light Microscopy Images of Neuronal Morphology to Advance Automation of Digital Reconstructions , 2011, Neuroinformatics.

[55]  Manuel González Hidalgo,et al.  General-purpose curvilinear object detection with fuzzy mathematical morphology , 2017, Appl. Soft Comput..

[56]  Elli Angelopoulou,et al.  Retinal vessel segmentation by improved matched filtering: evaluation on a new high-resolution fundus image database , 2013, IET Image Process..

[57]  Pietro Perona Steerable-scalable kernels for edge detection and junction analysis , 1992, Image Vis. Comput..

[58]  Frédéric Zana,et al.  Segmentation of vessel-like patterns using mathematical morphology and curvature evaluation , 2001, IEEE Trans. Image Process..

[59]  Matthew B. Blaschko,et al.  Learning Fully-Connected CRFs for Blood Vessel Segmentation in Retinal Images , 2014, MICCAI.

[60]  Vikrant Bhateja,et al.  Combination of Wavelet Transform and Morphological Filtering for Enhancement of Magnetic Resonance Images , 2011, ICDIPC.