Robust Inhibition-Augmented Operator for Delineation of Curvilinear Structures

Delineation of curvilinear structures in images is an important basic step of several image processing applications, such as segmentation of roads or rivers in aerial images, vessels or staining membranes in medical images, and cracks in pavements and roads, among others. Existing methods suffer from insufficient robustness to noise. In this paper, we propose a novel operator for the detection of curvilinear structures in images, which we demonstrate to be robust to various types of noise and effective in several applications. We call it RUSTICO, which stands for RobUST Inhibition-augmented Curvilinear Operator. It is inspired by the push–pull inhibition in visual cortex and takes as input the responses of two trainable B-COSFIRE filters of opposite polarity. The output of RUSTICO consists of a magnitude map and an orientation map. We carried out experiments on a data set of synthetic stimuli with noise drawn from different distributions, as well as on several benchmark data sets of retinal fundus images, crack pavements, and aerial images and a new data set of rose bushes used for automatic gardening. We evaluated the performance of RUSTICO by a metric that considers the structural properties of line networks (connectivity, area, and length) and demonstrated that RUSTICO outperforms many existing methods with high statistical significance. RUSTICO exhibits high robustness to noise and texture.

[1]  Xin Zhao,et al.  Deep Crisp Boundaries , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Alan Wee-Chung Liew,et al.  General Retinal Vessel Segmentation Using Regularization-Based Multiconcavity Modeling , 2010, IEEE Transactions on Medical Imaging.

[3]  Jing Tian,et al.  Retinal image registration using topological vascular tree segmentation and bifurcation structures , 2015, Biomed. Signal Process. Control..

[4]  Nicolai Petkov,et al.  Learning sound representations using trainable COPE feature extractors , 2019, Pattern Recognit..

[5]  Jitendra Malik,et al.  A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[6]  D. Hubel,et al.  Receptive fields, binocular interaction and functional architecture in the cat's visual cortex , 1962, The Journal of physiology.

[7]  George Azzopardi,et al.  Increased generalization capability of trainable COSFIRE filters with application to machine vision , 2016, 2016 23rd International Conference on Pattern Recognition (ICPR).

[8]  A.D. Hoover,et al.  Locating blood vessels in retinal images by piecewise threshold probing of a matched filter response , 2000, IEEE Transactions on Medical Imaging.

[9]  Stephen Lin,et al.  DeepVessel: Retinal Vessel Segmentation via Deep Learning and Conditional Random Field , 2016, MICCAI.

[10]  Elisa Ricci,et al.  Retinal Blood Vessel Segmentation Using Line Operators and Support Vector Classification , 2007, IEEE Transactions on Medical Imaging.

[11]  Qingquan Li,et al.  FoSA: F* Seed-growing Approach for crack-line detection from pavement images , 2011, Image Vis. Comput..

[12]  Max A. Viergever,et al.  Ridge-based vessel segmentation in color images of the retina , 2004, IEEE Transactions on Medical Imaging.

[13]  Ana Maria Mendonça,et al.  Segmentation of retinal blood vessels by combining the detection of centerlines and morphological reconstruction , 2006, IEEE Transactions on Medical Imaging.

[14]  Ke Chen,et al.  Automated Vessel Segmentation Using Infinite Perimeter Active Contour Model with Hybrid Region Information with Application to Retinal Images , 2015, IEEE Transactions on Medical Imaging.

[15]  George Azzopardi,et al.  Color-blob-based COSFIRE filters for object recognition , 2017, Image Vis. Comput..

[16]  Nicolai Petkov,et al.  Bio-Inspired Filters for Audio Analysis , 2015, BrainComp.

[17]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Florent Lafarge,et al.  Recovering Line-Networks in Images by Junction-Point Processes , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[19]  George Azzopardi,et al.  Trainable COSFIRE filters for vessel delineation with application to retinal images , 2015, Medical Image Anal..

[20]  Mohammed Al-Rawi,et al.  An improved matched filter for blood vessel detection of digital retinal images , 2007, Comput. Biol. Medicine.

[21]  Denis G. Pelli,et al.  The visual filter mediating letter identification , 1994, Nature.

[22]  Nicolai Petkov,et al.  Delineation of line patterns in images using B-COSFIRE filters , 2017, 2017 International Conference and Workshop on Bioinspired Intelligence (IWOBI).

[23]  Nicholas Ayache,et al.  Model-Based Detection of Tubular Structures in 3D Images , 2000, Comput. Vis. Image Underst..

[24]  Yixian Yang,et al.  Novel Approach to Pavement Cracking Automatic Detection Based on Segment Extending , 2008, 2008 International Symposium on Knowledge Acquisition and Modeling.

[25]  Li I. Zhang,et al.  Broad Inhibition Sharpens Orientation Selectivity by Expanding Input Dynamic Range in Mouse Simple Cells , 2011, Neuron.

[26]  R. W. Rodieck Quantitative analysis of cat retinal ganglion cell response to visual stimuli. , 1965, Vision research.

[27]  M. Carandini,et al.  Suppression without Inhibition in Visual Cortex , 2002, Neuron.

[28]  Nicolai Petkov,et al.  Learning skeleton representations for human action recognition , 2019, Pattern Recognition Letters.

[29]  Deukhee Lee,et al.  Automatic spine segmentation from CT images using Convolutional Neural Network via redundant generation of class labels , 2019, J. Comput. Des. Eng..

[30]  Sabri Boughorbel,et al.  Optimal classifier for imbalanced data using Matthews Correlation Coefficient metric , 2017, PloS one.

[31]  Roberto Marcondes Cesar Junior,et al.  Retinal vessel segmentation using the 2-D Gabor wavelet and supervised classification , 2005, IEEE Transactions on Medical Imaging.

[32]  Bram van Ginneken,et al.  Comparative study of retinal vessel segmentation methods on a new publicly available database , 2004, SPIE Medical Imaging.

[33]  Josiane Zerubia,et al.  Point processes for unsupervised line network extraction in remote sensing , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[34]  Chenyu Shi,et al.  Inhibition-augmented trainable COSFIRE filters for keypoint detection and object recognition , 2016, Machine Vision and Applications.

[35]  Hugues Talbot,et al.  2D Filtering of Curvilinear Structures by Ranking the Orientation Responses of Path Operators (RORPO) , 2017, Image Process. Line.

[36]  Nicolas Passat,et al.  Curvilinear Structure Analysis by Ranking the Orientation Responses of Path Operators , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[37]  M. Goldbaum,et al.  Detection of blood vessels in retinal images using two-dimensional matched filters. , 1989, IEEE transactions on medical imaging.

[38]  Ad Aertsen,et al.  Push-Pull Receptive Field Organization and Synaptic Depression: Mechanisms for Reliably Encoding Naturalistic Stimuli in V1 , 2016, Front. Neural Circuits.

[39]  Matthew B. Blaschko,et al.  A Discriminatively Trained Fully Connected Conditional Random Field Model for Blood Vessel Segmentation in Fundus Images , 2017, IEEE Transactions on Biomedical Engineering.

[40]  Martha Elizabeth Shenton,et al.  On evaluating brain tissue classifiers without a ground truth , 2007, NeuroImage.

[41]  Matthew B. Blaschko,et al.  Learning Fully-Connected CRFs for Blood Vessel Segmentation in Retinal Images , 2014, MICCAI.

[42]  Elli Angelopoulou,et al.  Retinal vessel segmentation by improved matched filtering: evaluation on a new high-resolution fundus image database , 2013, IET Image Process..

[43]  Florent Lafarge,et al.  Geometric Feature Extraction by a Multimarked Point Process , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[44]  Frédéric Zana,et al.  Segmentation of vessel-like patterns using mathematical morphology and curvature evaluation , 2001, IEEE Trans. Image Process..

[45]  Gregg E. Irvin,et al.  Center/surround relationships of magnocellular, parvocellular, and koniocellular relay cells in primate lateral geniculate nucleus , 1993, Visual Neuroscience.

[46]  George Azzopardi,et al.  Multiscale Blood Vessel Delineation Using B-COSFIRE Filters , 2015, CAIP.

[47]  Florent Lafarge,et al.  Efficient Monte Carlo Sampler for Detecting Parametric Objects in Large Scenes , 2012, ECCV.

[48]  Guido Gerig,et al.  Three-dimensional multi-scale line filter for segmentation and visualization of curvilinear structures in medical images , 1998, Medical Image Anal..

[49]  George Azzopardi,et al.  Trainable COSFIRE Filters for Keypoint Detection and Pattern Recognition , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[50]  Yan Wang,et al.  DeepContour: A deep convolutional feature learned by positive-sharing loss for contour detection , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[51]  Alejandro F. Frangi,et al.  Muliscale Vessel Enhancement Filtering , 1998, MICCAI.

[52]  Stanislaw Osowski,et al.  Novel segmentation algorithm for identification of cell membrane staining in HER2 images , 2016, Pattern Recognit. Lett..

[53]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[54]  George Azzopardi,et al.  Unsupervised delineation of the vessel tree in retinal fundus images , 2016 .

[55]  Nicolai Petkov,et al.  Modifications of center-surround, spot detection and dot-pattern selective operators , 2005 .

[56]  Xiaoyi Jiang,et al.  Adaptive Local Thresholding by Verification-Based Multithreshold Probing with Application to Vessel Detection in Retinal Images , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[57]  Chenyu Shi,et al.  Inhibition-augmented COSFIRE model of shape-selective neurons , 2017, IBM J. Res. Dev..

[58]  Josien P. W. Pluim,et al.  Robust Retinal Vessel Segmentation via Locally Adaptive Derivative Frames in Orientation Scores , 2016, IEEE Transactions on Medical Imaging.

[59]  Yanning Zhang,et al.  Adaptive river segmentation in SAR images , 2009 .

[60]  Nicolai Petkov,et al.  Learning sound representations using trainable COPE feature extractors , 2019, ArXiv.

[61]  Qingquan Li,et al.  CrackTree: Automatic crack detection from pavement images , 2012, Pattern Recognit. Lett..

[62]  George Azzopardi,et al.  Detection of curved lines with B-COSFIRE filters: A case study on crack delineation , 2017, CAIP.

[63]  Wang Qian,et al.  Path voting based pavement crack detection from laser range images , 2016 .

[64]  José Manuel Bravo,et al.  A Function for Quality Evaluation of Retinal Vessel Segmentations , 2012, IEEE Transactions on Medical Imaging.

[65]  Pascal Fua,et al.  Reconstructing Curvilinear Networks Using Path Classifiers and Integer Programming , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[66]  Robert B. Fisher,et al.  TrimBot2020: an outdoor robot for automatic gardening , 2018, ArXiv.

[67]  Anil A. Bharath,et al.  Segmentation of blood vessels from red-free and fluorescein retinal images , 2007, Medical Image Anal..

[68]  C. Paterson,et al.  Measuring retinal vessel tortuosity in 10-year-old children: validation of the Computer-Assisted Image Analysis of the Retina (CAIAR) program. , 2009, Investigative ophthalmology & visual science.

[69]  George Azzopardi,et al.  Supervised vessel delineation in retinal fundus images with the automatic selection of B-COSFIRE filters , 2016, Machine Vision and Applications.

[70]  U. C. Pati,et al.  A novel technique for wall crack detection using image fusion , 2013, 2013 International Conference on Computer Communication and Informatics.

[71]  Josiane Zerubia,et al.  Higher Order Active Contours , 2006, International Journal of Computer Vision.

[72]  Alexandre Fioravante de Siqueira,et al.  An automatic method for segmentation of fission tracks in epidote crystal photomicrographs , 2014, Comput. Geosci..

[73]  Sil. C. van de Leemput,et al.  Robust Segmentation of the Full Cerebral Vasculature in 4D CT of Suspected Stroke Patients , 2017, Scientific Reports.

[74]  Manuel González Hidalgo,et al.  A survey on curvilinear object segmentation in multiple applications , 2016, Pattern Recognit..

[75]  José Manuel Bravo,et al.  A New Supervised Method for Blood Vessel Segmentation in Retinal Images by Using Gray-Level and Moment Invariants-Based Features , 2011, IEEE Transactions on Medical Imaging.

[76]  Leena A. Ibrahim,et al.  Broadening of Inhibitory Tuning Underlies Contrast-Dependent Sharpening of Orientation Selectivity in Mouse Visual Cortex , 2012, The Journal of Neuroscience.

[77]  Charles E Connor,et al.  Underlying principles of visual shape selectivity in posterior inferotemporal cortex , 2004, Nature Neuroscience.