Robust Visual Method for Assessing the Relative Performance of Edge-Detection Algorithms

A new method for evaluating edge detection algorithms is presented and applied to measure the relative performance of algorithms by Canny, Nalwa-Binford, Iverson-Zucker, Bergholm, and Rothwell. The basic measure of performance is a visual rating score which indicates the perceived quality of the edges for identifying an object. The process of evaluating edge detection algorithms with this performance measure requires the collection of a set of gray-scale images, optimizing the input parameters for each algorithm, conducting visual evaluation experiments and applying statistical analysis methods. The novel aspect of this work is the use of a visual task and real images of complex scenes in evaluating edge detectors. The method is appealing because, by definition, the results agree with visual evaluations of the edge images.

[1]  Lawrence G. Roberts,et al.  Machine Perception of Three-Dimensional Solids , 1963, Outstanding Dissertations in the Computer Sciences.

[2]  Irwin Edward Sobel,et al.  Camera Models and Machine Perception , 1970 .

[3]  Edward S. Deutsch,et al.  On the Quantitative Evaluation of Edge Detection Schemes and their Comparison with Human Performance , 1975, IEEE Transactions on Computers.

[4]  C. Mercier.  Reply to the paper , 1978 .

[5]  I.E. Abdou,et al.  Quantitative design and evaluation of enhancement/thresholding edge detectors , 1979, Proceedings of the IEEE.

[6]  J. Fleiss,et al.  Intraclass correlations: uses in assessing rater reliability. , 1979, Psychological bulletin.

[7]  J. Galayda.  Edge Focusing , 1981, IEEE Transactions on Nuclear Science.

[8]  Azriel Rosenfeld,et al.  Edge Evaluation Using Local Edge Coherence , 1981, IEEE Transactions on Systems, Man, and Cybernetics.

[9]  Dana H. Ballard,et al.  Computer Vision , 1982 .

[10]  Thomas O. Binford,et al.  On Detecting Edges , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Rama Chellappa,et al.  Edge Detection and Linear Feature Extraction Using a 2-D Random Field Model , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Robin N. Strickland,et al.  Adaptable edge quality metric , 1990, Other Conferences.

[14]  Kim L. Boyer,et al.  Optimal infinite impulse response zero crossing based edge detectors , 1991, CVGIP Image Underst..

[15]  Robert M. Haralick,et al.  Performance characterization of edge detectors , 1992, Defense, Security, and Sensing.

[16]  Kim L. Boyer,et al.  Assessing the state of the art in edge detection: 1992 , 1992, Defense, Security, and Sensing.

[17]  David Sher,et al.  Chi2 Test for Feature Detection , 1993, Pattern Recognit..

[18]  D. Vu,et al.  Edge detection using neural networks , 1993, Proceedings of 27th Asilomar Conference on Signals, Systems and Computers.

[19]  Muhittin Gökmen,et al.  Edge Detection and Surface Reconstruction Using Refined Regularization , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  P. H. Gregson,et al.  Using Angular Dispersion of Gradient Direction for Detecting Edge Ribbons , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  Vishvjit S. Nalwa,et al.  A guided tour of computer vision , 1993 .

[22]  Salvatore Tabbone,et al.  A multi-scale edge detector , 1993, Pattern Recognit..

[23]  Elizabeth R. Stuck,et al.  Detecting Moving Objects Using the Rigidity Constraint , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  K. Raghunath Rao,et al.  Optimal Edge Detection using Expansion Matching and Restoration , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[25]  Luigi Cinque,et al.  On the paper by R. M. Haralick , 1994 .

[26]  Suchendra M. Bhandarkar,et al.  An edge detection technique using genetic algorithm-based optimization , 1994, Pattern Recognit..

[27]  William E. Higgins,et al.  Edge detection using two-dimensional local structure information , 1994, Pattern Recognit..

[28]  Rae-Hong Park,et al.  Edge detection in noisy images based on the co-occurrence matrix , 1994, Pattern Recognit..

[29]  Sim Heng Ong,et al.  Edge detection using a neural network , 1994, Pattern Recognit..

[30]  D. Mintz.  Robust consensus based edge detection , 1994 .

[31]  Paul J. Tadrous.  A simple and sensitive method for directional edge detection in noisy images , 1995, Pattern Recognit..

[32]  JUN SHEN,et al.  Image smoothing and edge detection by Hermite integration , 1995, Pattern Recognit..

[33]  Tieniu Tan,et al.  Texture edge detection by modelling visual cortical channels , 1995, Pattern Recognit..

[34]  Peter Meer,et al.  Quantitative evaluation of performance through bootstrapping: edge detection , 1995, Proceedings of International Symposium on Computer Vision - ISCV.

[35]  Rae-Hong Park,et al.  Multiresolution edge detection techniques , 1995, Pattern Recognit..

[36]  J. Mundy,et al.  Driving vision by topology , 1995, Proceedings of International Symposium on Computer Vision - ISCV.

[37]  Steven W. Zucker,et al.  Logical/Linear Operators for Image Curves , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[38]  Robert M. Haralick,et al.  A methodology for quantitative performance evaluation of detection algorithms , 1995, IEEE Trans. Image Process..

[39]  Jun Shen,et al.  Multi-edge detection by isotropical 2-D ISEF cascade , 1995, Pattern Recognit..

[40]  Ferdinand van der Heijden,et al.  Edge and Line Feature Extraction Based on Covariance Models , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[41]  Aly A. Farag,et al.  Edge linking by sequential search , 1995, Pattern Recognit..

[42]  Qiuming Zhu,et al.  Efficient evaluations of edge connectivity and width uniformity , 1996, Image Vis. Comput..

[43]  Sudeep Sarkar,et al.  Comparison of edge detectors: a methodology and initial study , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[44]  Josef Kittler,et al.  A Performance Measure for Boundary Detection Algorithms , 1996, Comput. Vis. Image Underst..