Color and brightness encoded in a common L- and M-cone pathway with expansive and compressive nonlinearities.

Lights near 560 nm appear brighter when flickered, whereas lights near 520 or 650 nm appear yellower. Both effects are consistent with signal distortion within the visual pathway--brightness changes at an expansive nonlinearity, and hue shifts at a compressive one. We previously manipulated the distortion products generated by each nonlinearity to extract the temporal properties of stages of the L- and M-cone pathways that signal brightness and color before (early stages) and after (late stages) each nonlinearity. We find that the attenuation characteristics of the early and late stages are virtually identical in both pathways: The early temporal stage acts like a band-pass filter peaking at 10-15 Hz, while the late stage acts like low-pass filter with a cut-off frequency near 3 Hz. We propose a physiologically relevant model that accounts for the filter shapes and incorporates both nonlinearities within a common parvocellular pathway. The shape of the early band-pass filter is consistent with antagonism between center signals and more sluggish and delayed surround signals, while the late filter is consistent with a simple two-stage low-pass filter. Modeling suggests that the brightness change and hue shift are both initially caused by the half-wave rectification and partition of signals into ON and OFF components. However, the hue shift is probably caused by the additional effects of a later nonlinearity that compresses chromatic red and green signals. Plausible sites for the expansive half-wave rectifying nonlinearity are after surround antagonism, possibly from horizontal cells, but the compressive nonlinearity is likely to be after the late filter.

[1]  V. Billock The relationship between simple and double opponent cells , 1991, Vision Research.

[2]  Flicker sensitivity of the human red and green color mechanisms , 1975, Vision Research.

[3]  Anthony D. D'Antona,et al.  The neural pathways mediating color shifts induced by temporally varying light. , 2009, Journal of vision.

[4]  Joel Pokorny,et al.  Responses to pulses and sinusoids in macaque ganglion cells , 1994, Vision Research.

[5]  R. J. Ball AN INVESTIGATION OF CHROMATIC BRIGHTNESS ENHANCEMENT TENDENCIES. , 1964, American journal of optometry and archives of American Academy of Optometry.

[6]  Sheng He,et al.  Visible flicker from invisible patterns , 1993, Nature.

[7]  A. Stockman,et al.  Human cone light adaptation: from behavioral measurements to molecular mechanisms. , 2006, Journal of vision.

[8]  D. Macleod,et al.  Blue-sensitive cones do not contribute to luminance. , 1980, Journal of the Optical Society of America.

[9]  David A. Tovar,et al.  Representational dynamics of object vision: the first 1000 ms. , 2013, Journal of vision.

[10]  David Williams,et al.  A visual nonlinearity fed by single cones , 1992, Vision Research.

[11]  A. Stockman,et al.  The spectral sensitivities of the middle- and long-wavelength-sensitive cones derived from measurements in observers of known genotype , 2000, Vision Research.

[12]  J. Mollon,et al.  Colour vision : physiology and psychophysics , 1983 .

[13]  David Williams Aliasing in human foveal vision , 1985, Vision Research.

[14]  Leo Maurice Hurvich,et al.  Color vision , 1981 .

[15]  Herbert E. Ives,et al.  A Theory of Intermittent Vision , 1922 .

[16]  J. L. Schnapf,et al.  The Photovoltage of Macaque Cone Photoreceptors: Adaptation, Noise, and Kinetics , 1999, The Journal of Neuroscience.

[17]  C. Stromeyer,et al.  Colour adaptation modifies the temporal properties of the long‐ and middle‐wave cone signals in the human luminance mechanism , 2000, The Journal of physiology.

[18]  A. Stockman,et al.  Paradoxical shifts in human color sensitivity caused by constructive and destructive interference between signals from the same cone class , 2006, Visual Neuroscience.

[19]  Michael A. Webster,et al.  Temporal properties of brightness and color induction , 1986, Vision Research.

[20]  G. G. Furman,et al.  Comparison of models for subtractive and shunting lateral-inhibition in receptor-neuron fields , 1965, Kybernetik.

[21]  D. Baylor,et al.  Spectral sensitivity of cones of the monkey Macaca fascicularis. , 1987, The Journal of physiology.

[22]  Donald C. Hood,et al.  Sensitivity to Light , 1986 .

[23]  A. Elsner,et al.  Analysis of nonlinearities in the flicker ERG. , 1992, Optometry and vision science : official publication of the American Academy of Optometry.

[24]  W A Rushton,et al.  The spectral sensitivity of "red" and "green" cones in the normal eye. , 1973, Vision research.

[25]  R. W. Rodieck The First Steps in Seeing , 1998 .

[26]  P. Lennie,et al.  Mechanisms of color vision. , 1988, Critical reviews in neurobiology.

[27]  David R. Williams,et al.  Serial spatial filters in vision , 1993, Vision Research.

[28]  T. M. Nelson,et al.  Certain Chromatic and Brightness Changes Associated with Rate of Intermittency of Photo Stimulation , 1960 .

[29]  C. Rashbass The visibility of transient changes of luminance , 1970, The Journal of physiology.

[30]  Hao Sun,et al.  The temporal properties of the response of macaque ganglion cells and central mechanisms of flicker detection. , 2007, Journal of vision.

[31]  S. Burns,et al.  Red-green flicker photometry and nonlinearities in the flicker electroretinogram. , 1993, Journal of the Optical Society of America. A, Optics and image science.

[32]  G. Gripon,et al.  Sitzungsberichte der Mathematisch-Naturwissenschaftlichen Classe der Kaiserlichen Akademie der Wissenschaften in Wien; 1882 , 1883 .

[33]  E. Kaplan,et al.  Dynamics of primate P retinal ganglion cells: responses to chromatic and achromatic stimuli , 1999, The Journal of physiology.

[34]  R. M. Boynton Human color vision , 1979 .

[35]  H K Hartline,et al.  Enhancement of Flicker by Lateral Inhibition , 1967, Science.

[36]  B. B. Lee,et al.  Light adaptation in cells of macaque lateral geniculate nucleus and its relation to human light adaptation. , 1983, Journal of neurophysiology.

[37]  Y. Frégnac,et al.  The “silent” surround of V1 receptive fields: theory and experiments , 2003, Journal of Physiology-Paris.

[38]  S. H. Bartley Brightness Enhancement in Relation to Target Intensity , 1951 .

[39]  D. Broadbent,et al.  Some experiments bearing on the hypothesis that the visual system analyses spatial patterns in independent bands of spatial frequency , 1975, Vision Research.

[40]  P. Lennie,et al.  Chromatic mechanisms in lateral geniculate nucleus of macaque. , 1984, The Journal of physiology.

[41]  C. R. Ingling,et al.  The relationship between spectral sensitivity and spatial sensitivity for the primate r-g X-channel , 1983, Vision Research.

[42]  E. Kaplan,et al.  The receptive field of the primate P retinal ganglion cell, I: Linear dynamics , 1997, Visual Neuroscience.

[43]  G. N. Stewart 5. Is the Law of Talbot true for very rapidly Intermittent Light , 1889 .

[44]  J. Pokorny,et al.  Spectral sensitivity of the foveal cone photopigments between 400 and 500 nm , 1975, Vision Research.

[45]  H. D. L. Dzn Research into the dynamic nature of the human fovea-cortex systems with intermittent and modulated light. I. Attenuation characteristics with white and colored light. , 1958 .

[46]  G D Field,et al.  Information processing in the primate retina: circuitry and coding. , 2007, Annual review of neuroscience.

[47]  S. H. Bartley Brightness Comparisons When One Eye is Stimulated Intermittently and the Other Eye Steadily , 1952 .

[48]  B. B. Lee,et al.  Sensitivity of macaque retinal ganglion cells to chromatic and luminance flicker. , 1989, The Journal of physiology.

[49]  C. R. Ingling,et al.  Retinal receptive fields: correlations between psychophysics and electrophysiology. , 1973, Vision research.

[50]  B H Tsou,et al.  Spectral sensitivity for flicker and acuity criteria. , 1988, Journal of the Optical Society of America. A, Optics and image science.

[51]  Jay Neitz,et al.  Estimates of L:M cone ratio from ERG flicker photometry and genetics. , 2002, Journal of vision.

[52]  A. Stockman,et al.  A luminous efficiency function, VD65* (λ), for daylight adaptation: A correction , 2011 .

[53]  C. Koch,et al.  The control of retinogeniculate transmission in the mammalian lateral geniculate nucleus , 2004, Experimental Brain Research.

[54]  D. Hood,et al.  Lower-level visual processing and models of light adaptation. , 1998, Annual review of psychology.

[55]  J. Nachmias Effect of Exposure Duration on Visual Contrast Sensitivity with Square-Wave Gratings*† , 1967 .

[56]  Vision Research , 1961, Nature.

[57]  Bart Farell,et al.  Coherence, cardinal directions and higher-order mechanisms , 1996, Vision Research.

[58]  Heinz Wässle,et al.  Parallel processing in the mammalian retina , 2004, Nature Reviews Neuroscience.

[59]  H. K. Hartline,et al.  Spatial and temporal aspects of retinal inhibitory interaction. , 1963, Journal of the Optical Society of America.

[60]  S. H. Bartley,et al.  Changes in brightness index, saturation, and hue produced by luminance-wavelength-temporal interactions. , 1966, Journal of the Optical Society of America.

[61]  G. J. Burton,et al.  Evidence for non-linear response processes in the human visual system from measurements on the thresholds of spatial beat frequencies. , 1973, Vision research.

[62]  Joel Pokorny,et al.  Foveal cone thresholds , 1989, Vision Research.

[63]  L. Kaufman,et al.  Handbook of perception and human performance , 1986 .

[64]  The mechanism of brightness enhancement , 1978, Vision Research.

[65]  M M Sondhi,et al.  Model for visual luminance discrimination and flicker detection. , 1968, Journal of the Optical Society of America.

[66]  S. W. Kuffler Discharge patterns and functional organization of mammalian retina. , 1953, Journal of neurophysiology.

[67]  G. J. van der Horst,et al.  Hue shift and brightness enhancement of flickering light. , 1969, Vision research.

[68]  R. Shapley,et al.  Nonlinear analysis of cat retinal ganglion cells in the frequency domain. , 1977, Proceedings of the National Academy of Sciences of the United States of America.

[69]  E. Kaplan,et al.  The dynamics of primate M retinal ganglion cells , 1999, Visual Neuroscience.

[70]  D. H. Kelly Flickering Patterns and Lateral Inhibition , 1969 .

[71]  Cathy Frey,et al.  Investigative Ophthalmology and Visual Science , 2010 .

[72]  J. L. Schnapf,et al.  Photovoltage of rods and cones in the macaque retina. , 1995, Science.

[73]  A. Stockman,et al.  Color from invisible flicker: a failure of the Talbot–Plateau law caused by an early ‘hard’ saturating nonlinearity used to partition the human short-wave cone pathway , 1998, Vision Research.

[74]  S. H. Bartley A Central Mechanism in Brightness Discrimination.∗ , 1938 .

[75]  R. Eskew Chromatic Detection and Discrimination , 2008 .

[76]  A. Stockman,et al.  The temporal characteristics of the early and late stages of L- and M-cone pathways that signal brightness. , 2013, Journal of vision.

[77]  P Gouras,et al.  Enchancement of luminance flicker by color-opponent mechanisms. , 1979, Science.

[78]  D. H. Kelly Visual responses to time-dependent stimuli. III. Individual variations. , 1962, Journal of the Optical Society of America.

[79]  H. D. L. Dzn,et al.  Experiments on flicker and some calculations on an electrical analogue of the foveal systems , 1952 .

[80]  E. Kaplan,et al.  The receptive field of the primate P retinal ganglion cell, II: Nonlinear dynamics , 1997, Visual Neuroscience.

[81]  Lindsay T Sharpe,et al.  Tritanopic color matches and the middle- and long-wavelength-sensitive cone spectral sensitivities , 2000, Vision Research.

[82]  Barry B. Lee,et al.  Horizontal Cells of the Primate Retina: Cone Specificity Without Spectral Opponency , 1996, Science.

[83]  Stephen A. Burns,et al.  Flicker brightness enhancement and visual nonlinearity , 1996, Vision Research.

[84]  R. Shapley,et al.  A method of nonlinear analysis in the frequency domain. , 1980, Biophysical journal.

[85]  J. Pokorny,et al.  Responses of macaque ganglion cells to the relative phase of heterochromatically modulated lights. , 1992, The Journal of physiology.

[86]  A. Stockman,et al.  Slow and fast pathways in the human rod visual system: electrophysiology and psychophysics. , 1991, Journal of the Optical Society of America. A, Optics and image science.

[87]  D. Baylor,et al.  Spectral sensitivity of human cone photoreceptors , 1987, Nature.

[88]  R. Hilz,et al.  Contrast Sensitivity of the Human Eye for Square-Wave Gratings , 1965 .

[89]  D. Macleod,et al.  Faster than the eye can see: blue cones respond to rapid flicker. , 1993, Journal of the Optical Society of America. A, Optics and image science.

[90]  C. M. Cicerone,et al.  The relative numbers of long-wavelength-sensitive to middle-wavelength-sensitive cones in the human fovea centralis , 1989, Vision Research.

[91]  P. Lennie Recent developments in the physiology of color vision , 1984, Trends in Neurosciences.

[92]  Donald I. A. MacLeod,et al.  The temporal properties of the human short-wave photoreceptors and their associated pathways , 1991, Vision Research.

[93]  H DE LANGE DZN,et al.  Research into the dynamic nature of the human fovea-cortex systems with intermittent and modulated light. II. Phase shift in brithtness and delay in color perception. , 1958, Journal of the Optical Society of America.

[94]  C. R. Ingling,et al.  The spatiotemporal properties of the r-g X-cell channel , 1985, Vision Research.

[95]  Á. Szél,et al.  Identification of the blue‐sensitive cones in the mammalian retina by anti‐visual pigment antibody , 1988, The Journal of comparative neurology.

[96]  D. H. Kelly Theory of flicker and transient responses. I. Uniform fields. , 1971, Journal of the Optical Society of America.

[97]  C. B. Gillman,et al.  Factors affecting luminance additivity at threshold among normal and color-blind subjects and elaborations of a trichromatic-opponent colors theory. , 1968, Vision research.

[98]  Nicholas J. Priebe,et al.  Inhibition, Spike Threshold, and Stimulus Selectivity in Primary Visual Cortex , 2008, Neuron.

[99]  E. D. Montag,et al.  Spectrally opponent inputs to the human luminance pathway: slow +M and −L cone inputs revealed by intense long‐wavelength adaptation , 2005, The Journal of physiology.

[100]  William H. Merigan,et al.  Spatio-temporal vision of macaques with severe loss of Pβ retinal ganglion cells , 1986, Vision Research.

[101]  P K Ahnelt,et al.  Identification of a subtype of cone photoreceptor, likely to be blue sensitive, in the human retina , 1987, The Journal of comparative neurology.

[102]  J. Roufs,et al.  Dynamic properties of vision. II. Theoretical relationships between flicker and flash thresholds. , 1972, Vision research.

[103]  P. Lennie,et al.  Spatial and temporal contrast sensitivities of neurones in lateral geniculate nucleus of macaque. , 1984, The Journal of physiology.

[104]  A. Watson,et al.  Patterns of temporal interaction in the detection of gratings , 1977, Vision Research.

[105]  D. Fayuk,et al.  The Journal of Physiology , 1978, Medical History.

[106]  Heidi Hofer,et al.  Organization of the Human Trichromatic Cone Mosaic , 2003, The Journal of Neuroscience.

[107]  D. H. Kelly Spatiotemporal variation of chromatic and achromatic contrast thresholds. , 1983, Journal of the Optical Society of America.

[108]  J. Robson Spatial and Temporal Contrast-Sensitivity Functions of the Visual System , 1966 .

[109]  Karl R. Gegenfurtner,et al.  Color Vision: From Genes to Perception , 1999 .

[110]  A. Stockman,et al.  The temporal characteristics of the early and late stages of the L- and M-cone pathways that signal color. , 2013, Journal of vision.

[111]  R. L. Valois Color Vision Mechanisms in the Monkey , 1960 .

[112]  S. H. Bartley Some effects of intermittent photic stimulation. , 1939 .

[113]  O. Estévez,et al.  A spectral compensation method for determining the flicker characteristics of the human colour mechanisms. , 1974, Vision research.

[114]  A. Stockman,et al.  Long-wavelength adaptation reveals slow, spectrally opponent inputs to the human luminance pathway. , 2005, Journal of vision.

[115]  J. J. Wisowaty Estimates for the temporal response characteristics of chromatic pathways. , 1981, Journal of the Optical Society of America.

[116]  G L WALLS,et al.  A branched-pathway schema for the color-vision system and some of the evidence for it. , 1955, American journal of ophthalmology.

[117]  Anthony D. D'Antona,et al.  Induced steady color shifts from temporally varying surrounds , 2006, Visual Neuroscience.

[118]  J. Pokorny,et al.  Luminance and chromatic modulation sensitivity of macaque ganglion cells and human observers. , 1990, Journal of the Optical Society of America. A, Optics and image science.

[119]  D. H. Kelly Visual Responses to Time-Dependent Stimuli.* II. Single-Channel Model of the Photopic Visual System , 1961 .

[120]  J. M. Foley,et al.  Human luminance pattern-vision mechanisms: masking experiments require a new model. , 1994, Journal of the Optical Society of America. A, Optics, image science, and vision.

[121]  A. Stockman,et al.  Slow and fast pathways in the human rod visual system: ERG and psychophysics , 1991 .

[122]  B W Knight,et al.  On tuning and amplification by lateral inhibition. , 1969, Proceedings of the National Academy of Sciences of the United States of America.

[123]  Sophie M. Wuerger,et al.  'Color Vision: From Genes to Perception' , 2000 .

[124]  J. Victor The dynamics of the cat retinal X cell centre. , 1987, The Journal of physiology.

[125]  G. Phillips,et al.  Nonlinear analysis of the human visual evoked response , 1978, Biological Cybernetics.

[126]  J. Roufs Dynamic properties of vision. IV. Thresholds of decremental flashes, incremental flashes and doublets in relation to flicker fusion. , 1974, Vision research.

[127]  H DE LANGE DZN,et al.  Research into the dynamic nature of the human fovea-cortex systems with intermittent and modulated light. I. Attenuation characteristics with white and colored light. , 1958, Journal of the Optical Society of America.

[128]  D. Dacey Parallel pathways for spectral coding in primate retina. , 2000, Annual review of neuroscience.

[129]  H. Spekreijse,et al.  The “silent substitution” method in visual research , 1982, Vision Research.

[130]  P. Lennie,et al.  Temporal-chromatic interactions in LGN P-cells , 1998, Visual Neuroscience.

[131]  Dick Reits,et al.  SEQUENTIAL ANALYSIS OF THE VISUAL EVOKED POTENTIAL SYSTEM IN MAN; NONLINEAR ANALYSIS OF A SANDWICH SYSTEM * , 1980, Annals of the New York Academy of Sciences.

[132]  W. Rushton,et al.  Exchange thresholds in dichromats. , 1973, Vision Research.

[133]  A. Stockman,et al.  Spectrally opponent inputs to the human luminance pathway: slow +L and −M cone inputs revealed by low to moderate long‐wavelength adaptation , 2005, The Journal of physiology.

[134]  N. Logothetis,et al.  Functions of the colour-opponent and broad-band channels of the visual system , 1990, Nature.

[135]  A. Milam,et al.  Distribution and morphology of human cone photoreceptors stained with anti‐blue opsin , 1991, The Journal of comparative neurology.

[136]  E. Bedrosian,et al.  The output properties of Volterra systems (nonlinear systems with memory) driven by harmonic and Gaussian inputs , 1971 .

[137]  D. H. Kelly Theory of flicker and transient responses. II. Counterphase gratings. , 1971, Journal of the Optical Society of America.

[138]  P. Z. Marmarelis,et al.  Analysis of Physiological Systems: The White-Noise Approach , 2011 .