A Contrast- and Luminance-driven Multiscale Network Model of Brightness Perception

A neural network model of brightness perception is developed to account for a wide variety of data, including the classical phenomenon of Mach bands, low- and high-contrast missing fundamental, luminance staircases, and non-linear contrast effects associated with sinusoidal waveforms. The model builds upon previous work on filling-in models that produce brightness profiles through the interaction of boundary and feature signals. Boundary computations that are sensitive to luminance steps and to continuous luminance gradients are presented. A new interpretation of feature signals through the explicit representation of contrast-driven and luminance-driven information is provided and directly addresses the issue of brightness "anchoring". Computer simulations illustrate the model's competencies.

[1]  Demetri Terzopoulos,et al.  Multilevel computational processes for visual surface reconstruction , 1983, Comput. Vis. Graph. Image Process..

[2]  F. Kingdom,et al.  Border effects on brightness: a review of findings, models and issues. , 1988, Spatial vision.

[3]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  S. Grossberg.  The quantized geometry of visual space: The coherent computation of depth, form, and lightness , 1982, Behavioral and Brain Sciences.

[5]  M. Sanders.  Handbook of Sensory Physiology , 1975 .

[6]  Stephen Grossberg,et al.  Neural dynamics of surface perception: Boundary webs, illuminants, and shape-from-shading , 1987, Comput. Vis. Graph. Image Process..

[7]  K. Arrington.  The temporal dynamics of brightness filling-in , 1994, Vision Research.

[8]  J. Robson,et al.  Application of fourier analysis to the visibility of gratings , 1968, The Journal of physiology.

[9]  Luiz Pessoa,et al.  A Simple Cell Model with Multiple Spatial Frequency Selectivity and Linear/Non-Linear Response Properties , 1994 .

[10]  Stephen Grossberg,et al.  Stereo boundary fusion by cortical complex cells: A system of maps, filters, and feedback networks for multiplexing distributed data , 1989, Neural Networks.

[11]  M. A. Parasido.  Brightness perception and filling-in , 1991 .

[12]  R. Watt,et al.  A theory of the primitive spatial code in human vision , 1985, Vision Research.

[13]  Alan N. Gove,et al.  Brightness perception, illusory contours, and corticogeniculate feedback , 1995, Visual Neuroscience.

[14]  M. Davidson,et al.  Human brightness perception near sharp contours. , 1971, Journal of the Optical Society of America.

[15]  L. Arend.  Spatial differential and integral operations in human vision: implications of stabilized retinal image fading. , 1973, Psychological review.

[16]  Campbell Fw,et al.  The appearance of gratings with and without the fundamental Fourier component. , 1971 .

[17]  Stephen Grossberg,et al.  Boundary Contour System and Feature Contour System , 1995 .

[18]  D Marr,et al.  Theory of edge detection , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[19]  J. Robson,et al.  The appearance of gratings with and without the fundamental Fourier component. , 1971, Journal of Physiology.

[20]  Heiko Neumann,et al.  An Outline of a Neural Architecture for Unified Visual Contrast and Brightness Perception , 1994 .

[21]  S. Grossberg,et al.  Neural dynamics of 1-D and 2-D brightness perception: A unified model of classical and recent phenomena , 1988, Perception & psychophysics.

[22]  David C. Burr,et al.  A non-linear model of feature detection. , 1992 .

[23]  A. Fiorentini.  Mach Band Phenomena , 1972 .

[24]  Andrew Blake,et al.  Visual Reconstruction , 1987, Deep Learning for EEG-Based Brain–Computer Interfaces.

[25]  R Goldstein,et al.  Lightness models, gradient illusions, and curl , 1987, Perception & psychophysics.

[26]  J. Gibson.  The Senses Considered As Perceptual Systems , 1967 .

[27]  D. Todorović.  The Craik-O’Brien-Cornsweet effect: New varieties and their theoretical implications , 1987, Perception & psychophysics.

[28]  D. Knill,et al.  Apparent surface curvature affects lightness perception , 1991, Nature.

[29]  R. Haber,et al.  Visual Perception , 2018, Encyclopedia of Database Systems.

[30]  D. Burr,et al.  Feature detection in human vision: a phase-dependent energy model , 1988, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[31]  R Shapley,et al.  Contrast and assimilation in the perception of brightness. , 1985, Proceedings of the National Academy of Sciences of the United States of America.

[32]  E. Land,et al.  Lightness and retinex theory. , 1971, Journal of the Optical Society of America.

[33]  S Grossberg,et al.  3-D vision and figure-ground separation by visual cortex , 2010, Perception & psychophysics.

[34]  R. B. Pinter,et al.  Nonlinear Vision: Determination of Neural Receptive Fields, Function, and Networks , 1992 .

[35]  R. Shapley,et al.  Brightness induction by local contrast and the spatial dependence of assimilation , 1988, Vision Research.

[36]  F. Ratliff.  Why mach bands are not seen at the edges of a step , 1984, Vision Research.

[37]  M. C. Morrone,et al.  Illusory brightness step in the chevreul illusion , 1994, Vision Research.

[38]  Tomaso Poggio,et al.  Computational vision and regularization theory , 1985, Nature.

[39]  Ewald Hering.  Outlines of a theory of the light sense , 1964 .

[40]  R. Weale.  Vision. A Computational Investigation Into the Human Representation and Processing of Visual Information. David Marr , 1983 .

[41]  Stanley Coren,et al.  When “filling in” fails , 1983, Behavioral and Brain Sciences.

[42]  Stephen Grossberg,et al.  Studies of mind and brain , 1982 .

[43]  Stephen Grossberg,et al.  Contour Enhancement, Short Term Memory, and Constancies in Reverberating Neural Networks , 1973 .

[44]  Lowell D. Jacobson,et al.  Structural testing of multi-input linear—nonlinear cascade models for cells in macaque striate cortex , 1993, Vision Research.

[45]  W. Weibull.  A Statistical Distribution Function of Wide Applicability , 1951 .

[46]  Heiko Neumann,et al.  A Multi-Scale Network Model of Brightness Perception , 1994 .

[47]  H. Gerrits,et al.  Experiments with retinal stabilized images. Relations between the observations and neural data. , 1966, Vision research.

[48]  S Grossberg,et al.  Neural dynamics of brightness perception: Features, boundaries, diffusion, and resonance , 1984, Perception & Psychophysics.

[49]  E. Adelson.  Perceptual Organization andthe Judgment ofBrightness , 1993 .

[50]  H. Barlow,et al.  Changes in the maintained discharge with adaptation level in the cat retina , 1969, The Journal of physiology.

[51]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[52]  James P. Thomas,et al.  7 – THE PERCEPTION OF BRIGHTNESS AND DARKNESS: RELATIONS TO NEURONAL RECEPTIVE FIELDS , 1990 .

[53]  F. Kingdom,et al.  A multi-channel approach to brightness coding , 1992, Vision Research.

[54]  Ennio Mingolla,et al.  Neural dynamics of perceptual grouping: Textures, boundaries, and emergent segmentations , 1985 .

[55]  Stephen Grossberg,et al.  Processing of synthetic aperture radar images by the boundary contour system and feature contour system , 1992, [Proceedings 1992] IJCNN International Joint Conference on Neural Networks.

[56]  G L WALLS,et al.  The filling-in process. , 1954, American journal of optometry and archives of American Academy of Optometry.

[57]  C. Enroth-Cugell,et al.  Chapter 9 Visual adaptation and retinal gain controls , 1984 .

[58]  J. Beck.  Surface color perception , 1972 .

[59]  D. Burr,et al.  The conditions under which Mach bands are visible , 1989, Vision Research.

[60]  L. Spillmann,et al.  Visual Perception: The Neurophysiological Foundations , 1989 .

[61]  G. Fry.  Mechanisms subserving simultaneous brightness contrast. , 1948, American journal of optometry and archives of American Academy of Optometry.

[62]  D. Jameson,et al.  The perception of brightness and darkness , 1970 .

[63]  S. Grossberg,et al.  Neural dynamics of form perception: boundary completion, illusory figures, and neon color spreading. , 1985 .

[64]  S Grossberg,et al.  Cortical dynamics of three-dimensional form, color, and brightness perception: II. Binocular theory , 1988, Perception & psychophysics.

[65]  D. Jameson,et al.  Mach bands : quantitative studies on neural networks in the retina , 1966 .

[66]  L. Sirovich,et al.  Equivalence classes of visual stimuli , 1978, Vision Research.