A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics

This paper presents a database containing 'ground truth' segmentations produced by humans for images of a wide variety of natural scenes. We define an error measure which quantifies the consistency between segmentations of differing granularities and find that different human segmentations of the same image are highly consistent. Use of this dataset is demonstrated in two applications: (1) evaluating the performance of segmentation algorithms and (2) measuring probability distributions associated with Gestalt grouping factors as well as statistics of image region properties.

[1]  E. Brunswik,et al.  Ecological cue-validity of proximity and of other Gestalt factors. , 1953, The American journal of psychology.

[2]  Susan J. Eggers,et al.  Techniques for efficient inline tracing on a shared-memory multiprocessor , 1990, SIGMETRICS '90.

[3]  James Archibald,et al.  Estimation of simulation error due to trace inaccuracies , 1992, [1992] Conference Record of the Twenty-Sixth Asilomar Conference on Signals, Systems & Computers.

[4]  James K. Archibald,et al.  BACH: a hardware monitor for tracing microprocessor-based systems , 1993, Microprocessors and microsystems.

[5]  James K. Archibald,et al.  Incomplete Trace Data and Trace Driven Simulation , 1993, MASCOTS.

[6]  David A. Patterson,et al.  Computer Organization & Design: The Hardware/Software Interface , 1993 .

[7]  D. Ruderman.  The statistics of natural images , 1994 .

[8]  Fritz Albregtsen,et al.  A Supervised Approach to the Evaluation of Image Segmentation Methods , 1995, CAIP.

[9]  J. Kelly Flanagan,et al.  Constructing instruction traces from cache-filtered address traces (CITCAT) , 1996, CARN.

[10]  Andrew W. Fitzgibbon,et al.  An Experimental Comparison of Range Image Segmentation Algorithms , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Richard M. Fujimoto,et al.  Accuracy of Multiprocessor Tracing Techniques , 1996, International Journal in Computer Simulation.

[12]  James K. Archibald,et al.  The inaccuracy of trace-driven simulation using incomplete multiprogramming trace data , 1996, Proceedings of MASCOTS '96 - 4th International Workshop on Modeling, Analysis and Simulation of Computer and Telecommunication Systems.

[13]  Sudeep Sarkar,et al.  Robust Visual Method for Assessing the Relative Performance of Edge-Detection Algorithms , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Sudeep Sarkar,et al.  A Framework for Performance Characterization of Intermediate-Level Grouping Modules , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Daniel L. Ruderman,et al.  Origins of scaling in natural images , 1996, Vision Research.

[16]  Jitendra Malik,et al.  Normalized cuts and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[17]  J. V. van Hateren,et al.  Independent component filters of natural images compared with simple cells in primary visual cortex , 1998, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[18]  Eero P. Simoncelli,et al.  Image compression via joint statistical characterization in the wavelet domain , 1999, IEEE Trans. Image Process..

[19]  Yann Gousseau,et al.  Scales in Natural Images and a Consequence on their Bounded Variation Norm , 1999, Scale-Space.

[20]  Alan L. Yuille,et al.  Fundamental bounds on edge detection: an information theoretic evaluation of different edge cues , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[21]  David Mumford,et al.  Statistics of natural images and models , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[22]  Patrick Haffner,et al.  Support vector machines for histogram-based image classification , 1999, IEEE Trans. Neural Networks.

[23]  Jitendra Malik,et al.  Blobworld: A System for Region-Based Image Indexing and Retrieval , 1999, VISUAL.

[24]  S. Zucker,et al.  The Curve Indicator Random Field: Curve Organization Via Edge Correlation , 2000 .

[25]  K. Boyer,et al.  Perceptual Organization for Artificial Vision Systems , 2000 .

[26]  David Mumford,et al.  Statistics of range images , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[27]  H. Liu,et al.  Conference on Measurement and modeling of computer systems , 2001 .

[28]  Song Mao,et al.  Empirical Performance Evaluation Methodology and Its Application to Page Segmentation Algorithms , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[29]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..