Detection of curved lines with B-COSFIRE filters: A case study on crack delineation

The detection of curvilinear structures is an important step for various computer vision applications, ranging from medical image analysis for segmentation of blood vessels, to remote sensing for the identification of roads and rivers, and to biometrics and robotics, among others. This is a nontrivial task especially for the detection of thin or incomplete curvilinear structures surrounded with noise. We propose a general purpose curvilinear structure detector that uses the brain-inspired trainable B-COSFIRE filters. It consists of four main steps, namely nonlinear filtering with B-COSFIRE, thinning with non-maximum suppression, hysteresis thresholding and morphological closing. We demonstrate its effectiveness on a data set of noisy images with cracked pavements, where we achieve state-of-the-art results (F-measure \(=0.865\)). The proposed method can be employed in any computer vision methodology that requires the delineation of curvilinear and elongated structures.

[1]  George Azzopardi,et al.  Multiscale Blood Vessel Delineation Using B-COSFIRE Filters , 2015, CAIP.

[2]  Florent Lafarge,et al.  Efficient Monte Carlo Sampler for Detecting Parametric Objects in Large Scenes , 2012, ECCV.

[3]  George Azzopardi,et al.  Trainable COSFIRE Filters for Keypoint Detection and Pattern Recognition , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Alejandro F. Frangi,et al.  Muliscale Vessel Enhancement Filtering , 1998, MICCAI.

[5]  Florent Lafarge,et al.  Geometric Feature Extraction by a Multimarked Point Process , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Krzysztof Krawiec,et al.  Segmenting Retinal Blood Vessels With Deep Neural Networks , 2016, IEEE Transactions on Medical Imaging.

[7]  Nicolai Petkov,et al.  Contour and boundary detection improved by surround suppression of texture edges , 2004, Image Vis. Comput..

[8]  George Azzopardi,et al.  Unsupervised delineation of the vessel tree in retinal fundus images , 2016 .

[9]  A.D. Hoover,et al.  Locating blood vessels in retinal images by piecewise threshold probing of a matched filter response , 2000, IEEE Transactions on Medical Imaging.

[10]  Anil A. Bharath,et al.  Segmentation of blood vessels from red-free and fluorescein retinal images , 2007, Medical Image Anal..

[11]  George Azzopardi,et al.  Supervised vessel delineation in retinal fundus images with the automatic selection of B-COSFIRE filters , 2016, Machine Vision and Applications.

[12]  Max A. Viergever,et al.  Ridge-based vessel segmentation in color images of the retina , 2004, IEEE Transactions on Medical Imaging.

[13]  Qingquan Li,et al.  FoSA: F* Seed-growing Approach for crack-line detection from pavement images , 2011, Image Vis. Comput..

[14]  Pascal Fua,et al.  Reconstructing Curvilinear Networks Using Path Classifiers and Integer Programming , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Ana Maria Mendonça,et al.  Segmentation of retinal blood vessels by combining the detection of centerlines and morphological reconstruction , 2006, IEEE Transactions on Medical Imaging.

[16]  Nicolai Petkov,et al.  Modifications of center-surround, spot detection and dot-pattern selective operators , 2005 .

[17]  Manuel González Hidalgo,et al.  A survey on curvilinear object segmentation in multiple applications , 2016, Pattern Recognit..

[18]  Roberto Marcondes Cesar Junior,et al.  Retinal vessel segmentation using the 2-D Gabor wavelet and supervised classification , 2005, IEEE Transactions on Medical Imaging.

[19]  Bram van Ginneken,et al.  Comparative study of retinal vessel segmentation methods on a new publicly available database , 2004, SPIE Medical Imaging.

[20]  Josiane Zerubia,et al.  Point processes for unsupervised line network extraction in remote sensing , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Florent Lafarge,et al.  Recovering Line-Networks in Images by Junction-Point Processes , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[22]  Roberto Marcondes Cesar Junior,et al.  Retinal Vessel Segmentation Using the 2-D Morlet Wavelet and Supervised Classification , 2005, ArXiv.

[23]  George Azzopardi,et al.  A CORF computational model of a simple cell that relies on LGN input outperforms the Gabor function model , 2012, Biological Cybernetics.

[24]  Qingquan Li,et al.  CrackTree: Automatic crack detection from pavement images , 2012, Pattern Recognit. Lett..

[25]  Qingquan Li,et al.  Path voting based pavement crack detection from laser range images , 2016, 2016 IEEE International Conference on Digital Signal Processing (DSP).

[26]  George Azzopardi,et al.  Color-blob-based COSFIRE filters for object recognition , 2017, Image Vis. Comput..

[27]  Nicolai Petkov,et al.  Bio-Inspired Filters for Audio Analysis , 2015, BrainComp.

[28]  George Azzopardi,et al.  Trainable COSFIRE filters for vessel delineation with application to retinal images , 2015, Medical Image Anal..