Detection and matching of curvilinear structures

We propose an approach to curvilinear and wiry object detection and matching based on a new curvilinear region detector (CRD) and a shape context-like descriptor (COH). Standard methods for local patch detection and description are not directly applicable to wiry objects and curvilinear structures, such as roads, railroads and rivers in satellite and aerial images, vessels and veins in medical images, cables, poles and fences in urban scenes, stems and tree branches in natural images, since they assume the object is compact, i.e. that most elliptical patches around features cover only the object. However, wiry objects often have no flat parts and most neighborhoods include both foreground and background. The detection process is first evaluated in terms of segmentation quality of curvilinear regions. The repeatability of the detection is then assessed using the protocol introduced in Mikolajczyk et al. [1]. Experiments show that the CRD is at least as robust as to several image acquisition conditions changes (viewpoint, scale, illumination, compression, blur) as the commonly used affine-covariant detectors. The paper also introduces an image collection containing wiry objects and curvilinear structures (the W-CS dataset).

[1]  Jiri Matas,et al.  Geometric Hashing with Local Affine Frames , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[2]  Luc Van Gool,et al.  Wide Baseline Stereo Matching based on Local, Affinely Invariant Regions , 2000, BMVC.

[3]  Azriel Rosenfeld,et al.  Robust detection of straight and circular road segments in noisy aerial images' , 1997, Pattern Recognit..

[4]  Stepán Obdrzálek,et al.  Object Recognition using Local Affine Frames on Distinguished Regions , 2002, BMVC.

[5]  Michael Isard,et al.  Total Recall: Automatic Query Expansion with a Generative Feature Model for Object Retrieval , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[6]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[7]  Andrew Zisserman,et al.  Video Google: a text retrieval approach to object matching in videos , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[8]  Rachid Deriche,et al.  Using Canny's criteria to derive a recursively implemented optimal edge detector , 1987, International Journal of Computer Vision.

[9]  Martial Hebert,et al.  Discriminative techniques for the recognition of complex-shaped objects , 2003 .

[10]  Xiaoyi Jiang,et al.  Adaptive Local Thresholding by Verification-Based Multithreshold Probing with Application to Vessel Detection in Retinal Images , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Jiri Matas,et al.  Definition of a Model-Based Detector of Curvilinear Regions , 2007, CAIP.

[12]  Jitendra Malik,et al.  Shape matching and object recognition using shape contexts , 2010, 2010 3rd International Conference on Computer Science and Information Technology.

[13]  José A. Malpica,et al.  An automatic method for road extraction in rural and semi-urban areas starting from high resolution satellite imagery , 2005, Pattern Recognit. Lett..

[14]  Cordelia Schmid,et al.  A Performance Evaluation of Local Descriptors , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Andrew Zisserman,et al.  Multi-view Matching for Unordered Image Sets, or "How Do I Organize My Holiday Snaps?" , 2002, ECCV.

[16]  J. Koenderink,et al.  Representation of local geometry in the visual system , 1987, Biological Cybernetics.

[17]  Karim Faez,et al.  Face recognition using adaptively weighted patch PZM array from a single exemplar image per person , 2008, Pattern Recognit..

[18]  Djemel Ziou,et al.  Detection of line junctions and line terminations using curvilinear features , 2000, Pattern Recognit. Lett..

[19]  Thomas G. Dietterich,et al.  Principal Curvature-Based Region Detector for Object Recognition , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[20]  Edward H. Adelson,et al.  The Design and Use of Steerable Filters , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  Jiri Matas,et al.  Robust wide-baseline stereo from maximally stable extremal regions , 2004, Image Vis. Comput..

[22]  Yan Ke,et al.  PCA-SIFT: a more distinctive representation for local image descriptors , 2004, CVPR 2004.

[23]  Djemel Ziou,et al.  Optimal line detector , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[24]  Jean-Paul Gauthier,et al.  Generalized Fourier Descriptors with Applications to Objects Recognition in SVM Context , 2007, Journal of Mathematical Imaging and Vision.

[25]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Jitendra Malik,et al.  A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[27]  Cordelia Schmid,et al.  Scale & Affine Invariant Interest Point Detectors , 2004, International Journal of Computer Vision.

[28]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[29]  Cordelia Schmid,et al.  Shape recognition with edge-based features , 2003, BMVC.

[30]  Djemel Ziou,et al.  Detection of line junctions in gray-level images , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[31]  Cordelia Schmid,et al.  A Comparison of Affine Region Detectors , 2005, International Journal of Computer Vision.

[32]  Bram van Ginneken,et al.  Comparative study of retinal vessel segmentation methods on a new publicly available database , 2004, SPIE Medical Imaging.

[33]  Anil A. Bharath,et al.  Retinal Blood Vessel Segmentation by Means of Scale-Space Analysis and Region Growing , 1999, MICCAI.

[34]  Francisco Javier Ariza-López,et al.  Generalization-oriented road line segmentation by means of an artificial neural network applied over a moving window , 2008, Pattern Recognit..

[35]  Luc Van Gool,et al.  Affine/ Photometric Invariants for Planar Intensity Patterns , 1996, ECCV.

[36]  Carsten Steger,et al.  An Unbiased Detector of Curvilinear Structures , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[37]  Max A. Viergever,et al.  Ridge-based vessel segmentation in color images of the retina , 2004, IEEE Transactions on Medical Imaging.

[38]  Cordelia Schmid,et al.  An Affine Invariant Interest Point Detector , 2002, ECCV.

[39]  Frédéric Zana,et al.  Segmentation of vessel-like patterns using mathematical morphology and curvature evaluation , 2001, IEEE Trans. Image Process..

[40]  Ki-Sang Hong,et al.  Detection of curvilinear structures and reconstruction of their regions in gray-scale images , 2002, Pattern Recognit..