Complexity of Images: Experimental and Computational Estimates Compared

We tested whether visual complexity can be modeled through the use of parameters relevant to known mechanisms of visual processing. In psychophysical experiments observers ranked the complexity of two groups of stimuli: 15 unfamiliar Chinese hieroglyphs and 24 outline images of well-known common objects. To predict image complexity, we considered: (i) spatial characteristics of the images, (ii) spatial-frequency characteristics, (iii) a combination of spatial and Fourier properties, and (iv) the size of the image encoded as a JPEG file. For hieroglyphs the highest correlation was obtained when complexity was calculated as the product of the squared spatial-frequency median and the image area. This measure accounts for the larger number of lines, strokes, and local periodic patterns in the hieroglyphs. For outline objects the best predictor of the experimental data was complexity estimated as the number of turns in the image, as Attneave (1957 Journal of Experimental Psychology 53 221–227) obtained for his abstract outlined images. Other predictors of complexity gave significant but lower correlations with the experimental ranking. We conclude that our modeling measures can be used to estimate the complexity of visual images but for different classes of images different measures of complexity may be required.

[1]  J. Robson,et al.  Application of fourier analysis to the visibility of gratings , 1968, The Journal of physiology.

[2]  Arthur P. Ginsburg,et al.  Spatial filtering and visual form perception. , 1986 .

[3]  Johan Wagemans,et al.  The influence of orientation jitter and motion on contour saliency and object identification , 2009, Vision Research.

[4]  D H HUBEL,et al.  RECEPTIVE FIELDS AND FUNCTIONAL ARCHITECTURE IN TWO NONSTRIATE VISUAL AREAS (18 AND 19) OF THE CAT. , 1965, Journal of neurophysiology.

[5]  M. Chun,et al.  Dissociable neural mechanisms supporting visual short-term memory for objects , 2006, Nature.

[6]  R. V. Novikova,et al.  Selective and invariant sensitivity to crosses and corners in cat striate neurons , 1998, Neuroscience.

[7]  Mario Ignacio Chacon Murguia,et al.  A Fuzzy Approach on Image Complexity Measure , 2007, Computación y Sistemas.

[8]  Alan Johnston,et al.  Infants' Discrimination of Faces by Using Biological Motion Cues , 2006, Perception.

[9]  P C Vitz,et al.  A model of the perception of simple geometric figures. , 1971, Psychological review.

[10]  D. Pelli,et al.  Feature detection and letter identification , 2006, Vision Research.

[11]  D. Hubel,et al.  Receptive fields, binocular interaction and functional architecture in the cat's visual cortex , 1962, The Journal of physiology.

[12]  C. Cela-Conde,et al.  Predicting beauty: fractal dimension and visual complexity in art. , 2011, British journal of psychology.

[13]  Richard Alan Peters,et al.  Image Complexity Metrics for Automatic Target Recognizers , 1990 .

[14]  C Blakemore,et al.  On the existence of neurones in the human visual system selectively sensitive to the orientation and size of retinal images , 1969, The Journal of physiology.

[15]  V. Glezer,et al.  Investigation of complex and hypercomplex receptive fields of visual cortex of the cat as spatial frequency filters. , 1973, Vision research.

[16]  D. Donderi.  Visual complexity: a review. , 2006, Psychological bulletin.

[17]  F W Campbell,et al.  The physics of visual perception. , 1980, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[18]  L. Riggs,et al.  Curvature detectors in human vision? , 1974, Science.

[19]  J. Cutting,et al.  Fractal curves and complexity , 1987, Perception & psychophysics.

[20]  F Campbell.  Psychophysical measurement of the intercone separation and object recognition in the human foveola , 1992 .

[21]  Vito Di Gesù,et al.  A fuzzy approach to the evaluation of image complexity , 2009, Fuzzy Sets Syst..

[22]  F. Campbell,et al.  Visibility of aperiodic patterns compared with that of sinusoidal gratings , 1969, The Journal of physiology.

[23]  Michel Vidal-Naquet,et al.  Visual features of intermediate complexity and their use in classification , 2002, Nature Neuroscience.

[24]  A. Ginsburg.  Psychological Correlates of a Model of the Human Visual System , 1971 .

[25]  J. G. Snodgrass,et al.  A standardized set of 260 pictures: norms for name agreement, image agreement, familiarity, and visual complexity. , 1980, Journal of experimental psychology. Human learning and memory.

[26]  David Whitaker,et al.  Geometric representation of the mechanisms underlying human curvature detection , 1998, Vision Research.

[27]  G. F. Cooper,et al.  The spatial selectivity of the visual cells of the cat , 1969, The Journal of physiology.

[28]  Aapo Hyvärinen,et al.  Modelling Image Complexity by Independent Component Analysis, with Application to Content-Based Image Retrieval , 2009, ICANN.

[29]  David J. Field,et al.  What Is the Goal of Sensory Coding? , 1994, Neural Computation.

[30]  Gerry Mulhern,et al.  Confounds in pictorial sets: The role of complexity and familiarity in basic-level picture processing , 2008, Behavior research methods.

[31]  David J. Field,et al.  Emergence of simple-cell receptive field properties by learning a sparse code for natural images , 1996, Nature.

[32]  G. F. Cooper,et al.  The spatial selectivity of visual cells of the cat and the squirrel monkey. , 1969, The Journal of physiology.

[33]  F. Attneave.  Physical determinants of the judged complexity of shapes. , 1957, Journal of experimental psychology.

[34]  V. L. Perju.  Determination of the Image Complexity Feature in Pattern Recognitions , 2003, Comput. Sci. J. Moldova.

[35]  K. N. Dudkin,et al.  Relationship between learning characteristics and the properties of visual objects in rhesus macaques , 1997, Neuroscience and Behavioral Physiology.

[36]  A. Kolmogorov.  Three approaches to the quantitative definition of information , 1968 .

[37]  L. Maffei,et al.  The visual cortex as a spatial frequency analyser. , 1973, Vision research.

[38]  Jyrki Rovamo,et al.  Spatial integration of band-pass filtered patterns in noise , 1993, Vision Research.

[39]  Jarek Rossignac,et al.  Shape complexity , 2005, The Visual Computer.

[40]  C. W. Tyler.  Selectivity for spatial frequency and bar width in cat visual cortex , 1978, Vision Research.

[41]  Javier Silvestre-Blanes.  Structural similarity image quality reliability: Determining parameters and window size , 2011, Signal Process..