Measuring visual clutter.

Visual clutter concerns designers of user interfaces and information visualizations. This should not surprise visual perception researchers because excess and/or disorganized display items can cause crowding, masking, decreased recognition performance due to occlusion, greater difficulty at both segmenting a scene and performing visual search, and so on. Given a reliable measure of the visual clutter in a display, designers could optimize display clutter. Furthermore, a measure of visual clutter could help generalize models like Guided Search (J. M. Wolfe, 1994) by providing a substitute for "set size" more easily computable on more complex and natural imagery. In this article, we present and test several measures of visual clutter, which operate on arbitrary images as input. The first is a new version of the Feature Congestion measure of visual clutter presented in R. Rosenholtz, Y. Li, S. Mansfield, and Z. Jin (2005). This Feature Congestion measure of visual clutter is based on the analogy that the more cluttered a display or scene is, the more difficult it would be to add a new item that would reliably draw attention. A second measure of visual clutter, Subband Entropy, is based on the notion that clutter is related to the visual information in the display. Finally, we test a third measure, Edge Density, used by M. L. Mack and A. Oliva (2004) as a measure of subjective visual complexity. We explore the use of these measures as stand-ins for set size in visual search models and demonstrate that they correlate well with search performance in complex imagery. This includes the search-in-clutter displays of J. M. Wolfe, A. Oliva, T. S. Horowitz, S. Butcher, and A. Bompas (2002) and Bravo and Farid (2004), as well as new search experiments. An additional experiment suggests that color variability, accounted for by Feature Congestion but not the Edge Density measure or the Subband Entropy measure, does matter for visual clutter.

[1]  G. A. Miller.  THE PSYCHOLOGICAL REVIEW THE MAGICAL NUMBER SEVEN, PLUS OR MINUS TWO: SOME LIMITS ON OUR CAPACITY FOR PROCESSING INFORMATION 1 , 1956 .

[2]  H. Burian,et al.  A study of separation difficulty. Its relationship to visual acuity in normal and amblyopic eyes. , 1962, American journal of ophthalmology.

[3]  U. Neisser.  VISUAL SEARCH. , 1964, Scientific American.

[4]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[5]  J. M. Foley,et al.  Contrast masking in human vision. , 1980, Journal of the Optical Society of America.

[6]  R. Phillips,et al.  An Investigation of Visual Clutter in the Topographic Base of a Geological Map , 1982 .

[7]  A. Treisman.  Perceptual grouping and attention in visual search for features and for objects. , 1982, Journal of experimental psychology. Human perception and performance.

[8]  Edward H. Adelson,et al.  The Laplacian Pyramid as a Compact Image Code , 1983, IEEE Trans. Commun..

[9]  Edward Rolf Tufte,et al.  The visual display of quantitative information , 1985 .

[10]  Carla J. Springer,et al.  Retrieval of Information from Complex Alphanumeric Displays: Screen Formatting Variables' Effects on Target Identification Time , 1987, HCI.

[11]  J. Duncan,et al.  Visual search and stimulus similarity. , 1989, Psychological review.

[12]  T. Callaghan.  Interference and dominance in texture segregation: Hue, geometric form, and line orientation , 1989, Perception & psychophysics.

[13]  P Perona,et al.  Preattentive texture discrimination with early vision mechanisms. , 1990, Journal of the Optical Society of America. A, Optics and image science.

[14]  Michael S. Landy,et al.  Computational models of visual processing , 1991 .

[15]  J. Bergen,et al.  Computational Modeling of Visual Texture Segregation , 1991 .

[16]  J. Palmer,et al.  Measuring the effect of attention on simple visual search. , 1993, Journal of experimental psychology. Human perception and performance.

[17]  H. Nothdurft.  The role of features in preattentive vision: Comparison of orientation, motion and color cues , 1993, Vision Research.

[18]  Andrew U. Frank,et al.  Multiple representations for cartographic objects in a multi-scale tree - An intelligent graphical zoom , 1994, Comput. Graph..

[19]  J. Wolfe,et al.  Guided Search 2.0 A revised model of visual search , 1994, Psychonomic bulletin & review.

[20]  J. Palmer.  Set-size effects in visual search: The effect of attention is independent of the stimulus for simple tasks , 1994, Vision Research.

[21]  B. Treutwein.  Adaptive psychophysical procedures , 1995, Vision Research.

[22]  Jeffrey V. Nickerson.  Visual programming , 1995 .

[23]  William T. Freeman,et al.  Presented at: 2nd Annual IEEE International Conference on Image , 1995 .

[24]  D. Field,et al.  Natural image statistics and efficient coding. , 1996, Network.

[25]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[26]  D G Pelli,et al.  The VideoToolbox software for visual psychophysics: transforming numbers into movies. , 1997, Spatial vision.

[27]  Michael Stonebraker,et al.  Constant information density in zoomable interfaces , 1998, AVI '98.

[28]  R. Rosenholtz.  A simple saliency model predicts a number of motion popout phenomena , 1999, Vision Research.

[29]  J. P. Thomas,et al.  A signal detection model predicts the effects of set size on visual search accuracy for feature, conjunction, triple conjunction, and disjunction displays , 2000, Perception & psychophysics.

[30]  A B Watson,et al.  Visual detection of spatial contrast patterns: evaluation of five simple models. , 2000, Optics express.

[31]  Ruth Rosenholz,et al.  Significantly Different Textures: A Computational Model of Pre-attentive Texture Segmentation , 2000, ECCV.

[32]  R. Rosenholtz.  Visual search for orientation among heterogeneous distractors: experimental results and implications for signal-detection theory models of search. , 2001, Journal of experimental psychology. Human perception and performance.

[33]  R. Rosenholtz.  Search asymmetries? What search asymmetries? , 2001, Perception & psychophysics.

[34]  A. Oliva,et al.  Segmentation of objects from backgrounds in visual search tasks , 2002, Vision Research.

[35]  Hany Farid,et al.  Search for a Category Target in Clutter , 2004, Perception.

[36]  R. Rosenholtz,et al.  The effect of background color on asymmetries in color search. , 2004, Journal of vision.

[37]  Michael L. Mack,et al.  Identifying the Perceptual Dimensions of Visual Complexity of Scenes , 2004 .

[38]  P. Cavanagh,et al.  The Capacity of Visual Short-Term Memory is Set Both by Visual Information Load and by Number of Objects , 2004, Psychological science.

[39]  Ruth Rosenholtz,et al.  A computational form of the statistical saliency model for visual search , 2005 .

[40]  Yuanzhen Li,et al.  Feature congestion: a measure of display clutter , 2005, CHI.

[41]  Antonio Torralba,et al.  Contextual guidance of eye movements and attention in real-world scenes: the role of global features in object search. , 2006, Psychological review.

[42]  H. Robbins.  A Stochastic Approximation Method , 1951 .

[43]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .