An exponential filter model predicts lightness illusions

Lightness, or perceived reflectance of a surface, is influenced by surrounding context. This is demonstrated by the Simultaneous Contrast Illusion (SCI), where a gray patch is perceived lighter against a black background and vice versa. Conversely, assimilation is where the lightness of the target patch moves toward that of the bounding areas and can be demonstrated in White's effect. Blakeslee and McCourt (1999) introduced an oriented difference-of-Gaussian (ODOG) model that is able to account for both contrast and assimilation in a number of lightness illusions and that has been subsequently improved using localized normalization techniques. We introduce a model inspired by image statistics that is based on a family of exponential filters, with kernels spanning across multiple sizes and shapes. We include an optional second stage of normalization based on contrast gain control. Our model was tested on a well-known set of lightness illusions that have previously been used to evaluate ODOG and its variants, and model lightness values were compared with typical human data. We investigate whether predictive success depends on filters of a particular size or shape and whether pooling information across filters can improve performance. The best single filter correctly predicted the direction of lightness effects for 21 out of 27 illusions. Combining two filters together increased the best performance to 23, with asymptotic performance at 24 for an arbitrarily large combination of filter outputs. While normalization improved prediction magnitudes, it only slightly improved overall scores in direction predictions. The prediction performance of 24 out of 27 illusions equals that of the best performing ODOG variant, with greater parsimony. Our model shows that V1-style orientation-selectivity is not necessary to account for lightness illusions and that a low-level model based on image statistics is able to account for a wide range of both contrast and assimilation effects.

[1]  Zhong-Lin Lu,et al.  Relative Brightness in Natural Images Can Be Accounted for by Removing Blurry Content , 2011, Psychological science.

[2]  W. Geisler.  Visual perception and the statistical properties of natural scenes. , 2008, Annual review of psychology.

[3]  Charles Chubb,et al.  Brightness assimilation in bullseye displays , 2004, Vision Research.

[4]  D J Field,et al.  Relations between the statistics of natural images and the response properties of cortical cells. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[5]  M. McCourt,et al.  A unified theory of brightness contrast and assimilation incorporating oriented multiscale spatial filtering and contrast normalization , 2004, Vision Research.

[6]  M. McCourt,et al.  Oriented multiscale spatial filtering and contrast normalization: a parsimonious model of brightness induction in a continuum of stimuli including White, Howe and simultaneous brightness contrast , 2005, Vision Research.

[7]  S. Laughlin,et al.  Predictive coding: a fresh view of inhibition in the retina , 1982, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[8]  M. McCourt,et al.  Similar mechanisms underlie simultaneous brightness contrast and grating induction , 1997, Vision Research.

[9]  M. Carandini,et al.  The Suppressive Field of Neurons in Lateral Geniculate Nucleus , 2005, The Journal of Neuroscience.

[10]  Barbara Blakeslee,et al.  Modeling lateral geniculate nucleus response with contrast gain control. Part 1: formulation. , 2013, Journal of the Optical Society of America. A, Optics, image science, and vision.

[11]  H. B. Barlow,et al.  Possible Principles Underlying the Transformations of Sensory Messages , 2012 .

[12]  Colin W. G. Clifford,et al.  Using colour to disambiguate contrast and assimilation in White's Effect , 2010 .

[13]  Song-Chun Zhu,et al.  Prior Learning and Gibbs Reaction-Diffusion , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  E. Adelson.  Perceptual organization and the judgment of brightness. , 1993, Science.

[15]  Margaret S. Livingstone,et al.  White's effect: removing the junctions but preserving the strength of the illusion , 2010 .

[16]  M. McCourt,et al.  A multiscale spatial filtering account of the Wertheimer–Benary effect and the corrugated Mondrian , 2001, Vision Research.

[17]  D. Dacey,et al.  Synergistic center-surround receptive field model of monkey H1 horizontal cells. , 2005, Journal of vision.

[18]  A. Gilchrist,et al.  An anchoring theory of lightness perception. , 1999 .

[19]  P. Howe,et al.  White's Effect: Removing the Junctions but Preserving the Strength of the Illusion , 2005, Perception.

[20]  Frederick A.A. Kingdom,et al.  Lightness, brightness and transparency: A quarter century of new ideas, captivating demonstrations and unrelenting controversy , 2011, Vision Research.

[21]  Song-Chun Zhu,et al.  Learning generic prior models for visual computation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[22]  William Bialek,et al.  Statistics of Natural Images: Scaling in the Woods , 1993, NIPS.

[23]  M. White,et al.  A New Effect of Pattern on Perceived Lightness , 1979, Perception.

[24]  A. AlanGilchrist.  Seeing in Black and White , 2006 .

[25]  B. Anderson,et al.  Contrasting theories of White's illusion. , 2001, Perception.

[26]  L. Arend,et al.  Perceived lightness, but not brightness, of achromatic surfaces depends on perceived depth information , 1990, Perception & psychophysics.

[27]  A. Gilchrist,et al.  An anchoring theory of lightness perception. , 1999, Psychological review.

[28]  Arnold W. M. Smeulders,et al.  A Biologically Plausible Model for Rapid Natural Scene Identification , 2009, NIPS.

[29]  Alan E. Robinson,et al.  Explaining brightness illusions using spatial filtering and local response normalization , 2007, Vision Research.

[30]  Min Su,et al.  Image Smoothing with Exponential Functions , 2001, Int. J. Pattern Recognit. Artif. Intell..

[31]  H Barlow,et al.  Redundancy reduction revisited , 2001, Network.

[32]  B. Anderson.  A Theory of Illusory Lightness and Transparency in Monocular and Binocular Images: The Role of Contour Junctions , 1997, Perception.

[33]  P. O. Bishop,et al.  Spatial vision. , 1971, Annual review of psychology.

[34]  S. Dakin,et al.  Natural image statistics mediate brightness ‘filling in’ , 2003, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[35]  Colin W G Clifford,et al.  Induction in Variants of White's Effect: Common or Separate Mechanisms? , 2002, Perception.

[36]  C. Ripamonti,et al.  Classical and Inverted White's Effects , 2001, Perception.

[37]  Sandip Sarkar,et al.  A possible explanation of the low-level brightness–contrast illusions in the light of an extended classical receptive field model of retinal ganglion cells , 2006, Biological Cybernetics.

[38]  M. McCourt,et al.  A multiscale spatial filtering account of the White effect, simultaneous brightness contrast and grating induction , 1999, Vision Research.

[39]  W. Benary,et al.  Beobachtungen zu einem Experiment über Helligkeitskontrast , 1924 .

[40]  M. McCourt.  A spatial frequency dependent grating-induction effect , 1982, Vision Research.

[41]  Kennehi J. W. Craik,et al.  THE NATURE OF PSYCHOLOGY: A SELECTION OF PAPERS, ESSAYS AND OTHER WRITINGS , 1966 .

[42]  Eero P. Simoncelli,et al.  Natural signal statistics and sensory gain control , 2001, Nature Neuroscience.

[43]  P. Howe,et al.  A comment on the Anderson (1997), the Todorović (1997), and the Ross and Pessoa (2000) explanations of White's effect. , 2001, Perception.

[44]  Vivian O'Brien,et al.  Contour Perception, Illusion and Reality* , 1958 .

[45]  Eugène Chevreul,et al.  De la loi du contraste simultané des couleurs et de l'assortiment des objets colorés , 1839 .

[46]  D. Dacey,et al.  Receptive field structure of H1 horizontal cells in macaque monkey retina. , 2002, Journal of vision.

[47]  Duane Q Nykamp,et al.  Full identification of a linear-nonlinear system via cross-correlation analysis. , 2002, Journal of vision.

[48]  D. Knill,et al.  Apparent surface curvature affects lightness perception , 1991, Nature.

[49]  R. Haber,et al.  Visual Perception , 2018, Encyclopedia of Database Systems.

[50]  D. Todorović.  Lightness and Junctions , 1997, Perception.