A model of multi-scale perceptual organization in information graphics

We propose a new method for assessing the perceptual organization of information graphics, based on the premise that the visual structure of an image should match the structure of the data it is intended to convey. The core of our method is a new formal model of one type of perceptual structure, based on classical machine vision techniques for analyzing an image at multiple resolutions. The model takes as input an arbitrary grayscale image and returns a lattice structure describing the visual organization of the image. We show how this model captures several aspects of traditional design aesthetics, and we describe a software tool that implements the model to help designers analyze and refine visual displays. Our emphasis here is on demonstrating the model's potential as a design aid rather than as a description of human perception, but given its initial promise we propose a variety of ways in which the model could be extended and validated.

[1]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Colin Ware,et al.  Information Visualization: Perception for Design , 2000 .

[3]  S. Kosslyn Understanding charts and graphs , 1989 .

[4]  Max A. Viergever,et al.  Invertible Orientation Bundles on 2D Scalar Images , 1997, Scale-Space.

[5]  D. Navon Forest before trees: The precedence of global features in visual perception , 1977, Cognitive Psychology.

[6]  Yee Leung,et al.  Clustering by Scale-Space Filtering , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Jan J. Koenderink,et al.  Color Differential Structure , 2001, Scale-Space.

[8]  Jean-Pierre Antoine,et al.  Image analysis with two-dimensional continuous wavelet transform , 1993, Signal Process..

[9]  Jim R. Parker,et al.  Algorithms for image processing and computer vision , 1996 .

[10]  G. Logan The CODE theory of visual attention: an integration of space-based and object-based attention. , 1996, Psychological review.

[11]  Edward H. Adelson,et al.  The Laplacian Pyramid as a Compact Image Code , 1983, IEEE Trans. Commun..

[12]  Benjamin B. Bederson,et al.  Space-scale diagrams: understanding multiscale interfaces , 1995, CHI '95.

[13]  Zhaoping Li,et al.  A Neural Model of Contour Integration in the Primary Visual Cortex , 1998, Neural Computation.

[14]  Jitendra Malik,et al.  Scale-Space and Edge Detection Using Anisotropic Diffusion , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Issei Fujishiro,et al.  The elements of graphing data , 2005, The Visual Computer.

[16]  J. Elder,et al.  Ecological statistics of Gestalt laws for the perceptual organization of contours. , 2002, Journal of vision.

[17]  Ben Shneiderman,et al.  Tree visualization with tree-maps: 2-d space-filling approach , 1992, TOGS.

[18]  John J. Bertin,et al.  The semiology of graphics , 1983 .

[19]  A. Witkin,et al.  On the Role of Structure in Vision , 1983 .

[20]  J. D. Fix Astronomy: Journey to the Cosmic Frontier , 1995 .

[21]  Eric Saund,et al.  Symbolic Construction of a 2-D Scale-Space Image , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  Jun Shen,et al.  An optimal linear operator for step edge detection , 1992, CVGIP Graph. Model. Image Process..

[23]  M. Kubovy The perceptual organization of dot lattices , 1994, Psychonomic bulletin & review.

[24]  Martin Wattenberg,et al.  Visualizing the stock market , 1999, CHI Extended Abstracts.

[25]  Edward R. Tufte,et al.  Envisioning Information , 1990 .

[26]  Kim L. Boyer,et al.  Guest Editors' Introduction: Perceptual Organization in Computer Vision: Status, Challenges, and Potential , 1999, Comput. Vis. Image Underst..

[27]  James T. Enns,et al.  Harnessing Preattentive Processes for Multivariate Data Visualization , 1992 .

[28]  Andrew P. Witkin,et al.  Scale-Space Filtering , 1983, IJCAI.

[29]  C. Koch,et al.  Computational modelling of visual attention , 2001, Nature Reviews Neuroscience.

[30]  Stuart K. Card,et al.  Visual information foraging in a focus + context visualization , 2001, CHI.

[31]  Jock D. Mackinlay,et al.  Applying a theory of graphical presentation to the graphic design of user interfaces , 1988, UIST '88.

[32]  J. Koenderink The structure of images , 2004, Biological Cybernetics.

[33]  I. Spence,et al.  A Remarkable Scatterplot , 1993 .

[34]  D Marr,et al.  Theory of edge detection , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[35]  Tony Lindeberg,et al.  Scale-Space Theory in Computer Vision , 1993, Lecture Notes in Computer Science.

[36]  Ben Shneiderman,et al.  Evaluating spatial and textual style of displays , 1995 .

[37]  S. Palmer Hierarchical structure in perceptual representation , 1977, Cognitive Psychology.

[38]  J. Simonoff Multivariate Density Estimation , 1996 .