What is second-order vision for? Discriminating illumination versus material changes.

The human visual system is sensitive to second-order modulations of the local contrast (CM) or amplitude (AM) of a carrier signal. Second-order cues are detected independently of first-order luminance signals; however, it is not clear why vision should benefit from second-order sensitivity. Analysis of the first- and second-order contents of natural images suggests that these cues tend to occur together, but their phase relationship varies. We have shown that in-phase combinations of LM and AM are perceived as a shaded corrugated surface whereas the anti-phase combination can be seen as corrugated when presented alone or as a flat material change when presented in a plaid containing the in-phase cue. We now extend these findings using new stimulus types and a novel haptic matching task. We also introduce a computational model based on initially separate first- and second-order channels that are combined within orientation and subsequently across orientation to produce a shading signal. Contrast gain control allows the LM + AM cue to suppress responses to the LM - AM when presented in a plaid. Thus, the model sees LM - AM as flat in these circumstances. We conclude that second-order vision plays a key role in disambiguating the origin of luminance changes within an image.

[1]  Keith Langley,et al.  Computational analysis of non-Fourier motion , 1994, Vision Research.

[2]  A J Schofield,et al.  What Does Second-Order Vision See in an Image? , 2000, Perception.

[3]  Mark A. Georgeson,et al.  Local luminance amplitude modulates the interpretation of shape-from-shading in textured surfaces , 2006, Vision Research.

[4]  C. Baker,et al.  The direction-selective contrast response of area 18 neurons is different for first- and second-order motion , 2005, Visual Neuroscience.

[5]  Berthold K. P. Horn,et al.  Shape from shading , 1989 .

[6]  Frederick A A Kingdom,et al.  Color brings relief to human vision , 2003, Nature Neuroscience.

[7]  J. Robson,et al.  Application of fourier analysis to the visibility of gratings , 1968, The Journal of physiology.

[8]  H. Levitt.  Transformed up-down methods in psychoacoustics. , 1971, The Journal of the Acoustical Society of America.

[9]  J. M. Foley,et al.  Contrast masking in human vision. , 1980, Journal of the Optical Society of America.

[10]  David R. Badcock,et al.  Interactions between luminance and contrast signals in global form detection , 2005, Vision Research.

[11]  D. Heeger.  Modeling simple-cell direction selectivity with normalized, half-squared, linear operators. , 1993, Journal of neurophysiology.

[12]  G. Sperling,et al.  Measuring the spatial frequency selectivity of second-order texture mechanisms , 1995, Vision Research.

[13]  J. M. Foley,et al.  Human luminance pattern-vision mechanisms: masking experiments require a new model. , 1994, Journal of the Optical Society of America. A, Optics, image science, and vision.

[14]  A. Pentland.  Shape information from shading: A theory about human perception , 1989 .

[15]  Mark A. Georgeson,et al.  Humans assume a mixture of diffuse and point-source lighting when viewing sinusoidal shading patterns , 2007 .

[16]  J. Koenderink,et al.  Light Source Dependence in Shape from Shading , 1997, Vision Research.

[17]  Jacob Nachmias.  Contrast modulated maskers: Test of a late nonlinearity hypothesis , 1989, Vision Research.

[18]  H. Barrow,et al.  RECOVERING INTRINSIC SCENE CHARACTERISTICS FROM IMAGES , 1978 .

[19]  M. Georgeson,et al.  Sensitivity to contrast modulation: the spatial frequency dependence of second-order vision , 2003, Vision Research.

[20]  Allen R. Hanson,et al.  Computer Vision Systems , 1978 .

[21]  J. Koenderink,et al.  Perception of local shape from shading , 1993, Perception & psychophysics.

[22]  D. Broadbent,et al.  Some experiments bearing on the hypothesis that the visual system analyses spatial patterns in independent bands of spatial frequency , 1975, Vision Research.

[23]  C. Clifford,et al.  Interaction between first- and second-order orientation channels revealed by the tilt illusion: psychophysics and computational modelling , 2001, Vision Research.

[24]  Curtis L Baker,et al.  Neural mechanisms mediating responses to abutting gratings: luminance edges vs. illusory contours. , 2006, Visual neuroscience.

[25]  M.-C. Dubois,et al.  Light from above , 2003 .

[26]  T D Albright,et al.  Form-cue invariant motion processing in primate visual cortex. , 1992, Science.

[27]  T. Meese,et al.  Adaptation and gain pool summation: alternative models and masking data , 2002, Vision Research.

[28]  Andriana Olmos,et al.  A biologically inspired algorithm for the recovery of shading and reflectance images , 2004 .

[29]  S Baldassi,et al.  Are there separate first-order and second-order mechanisms for orientation discrimination? , 2000, Vision Research.

[30]  V. S. Ramachandran,et al.  Perception of shape from shading , 1988, Nature.

[31]  ANDREW T SMITH,et al.  Separate Detection of Moving Luminance and Contrast Modulations: Fact or Artifact? , 1997, Vision Research.

[32]  M. Landy,et al.  Orientation-selective adaptation to first- and second-order patterns in human visual cortex. , 2006, Journal of neurophysiology.

[33]  M. Ernst,et al.  Experience can change the 'light-from-above' prior , 2004, Nature Neuroscience.

[34]  M. Georgeson,et al.  Shading and texture: separate information channels with a common adaptation mechanism? , 2002, Spatial vision.

[35]  J. Bergen,et al.  Texture segregation and orientation gradient , 1991, Vision Research.

[36]  T. Meese.  Area summation and masking. , 2004, Journal of vision.

[37]  Edward H. Adelson,et al.  Recovering intrinsic images from a single image , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[38]  D. G. Albrecht,et al.  Motion selectivity and the contrast-response function of simple cells in the visual cortex , 1991, Visual Neuroscience.

[39]  N. Graham,et al.  Normalization: contrast-gain control in simple (Fourier) and complex (non-Fourier) pathways of pattern vision , 2000, Vision Research.

[40]  Kirsten L. Challinor,et al.  Suppression pathways saturate with contrast for parallel surrounds but not for superimposed cross-oriented masks , 2009, Vision Research.

[41]  R. Hess,et al.  Investigating local network interactions underlying first- and second-order processing , 2004, Vision Research.

[42]  V. Ramachandran,et al.  On the perception of shape from shading , 1988, Nature.

[43]  P. Perona,et al.  Where is the sun? , 1998, Nature Neuroscience.

[44]  C. Baker,et al.  First- and second-order information in natural images: a filter-based approach to image statistics. , 2004, Journal of the Optical Society of America. A, Optics, image science, and vision.

[45]  C. Baker.  Central neural mechanisms for detecting second-order motion , 1999, Current Opinion in Neurobiology.

[46]  M. Georgeson,et al.  Sensitivity to modulations of luminance and contrast in visual white noise: separate mechanisms with similar behaviour , 1999, Vision Research.

[47]  P. Mamassian,et al.  Prior knowledge on the illumination position , 2001, Cognition.

[48]  E. Mingolla,et al.  Perception of surface curvature and direction of illumination from patterns of shading. , 1983, Journal of experimental psychology. Human perception and performance.

[49]  Harriet A. Allen,et al.  Second-order spatial frequency and orientation channels in human vision , 2006, Vision Research.

[50]  J. Nachmias,et al.  Masking by spatially-modulated gratings , 1983, Vision Research.

[51]  S. Dakin,et al.  Sensitivity to contrast modulation depends on carrier spatial frequency and orientation , 2000, Vision Research.

[52]  H. Wilson,et al.  A psychophysically motivated model for two-dimensional motion perception , 1992, Visual Neuroscience.

[53]  STANLEY A. KLEIN,et al.  The Adjacent Pixel Nonlinearity: Problems and Solutions , 1996, Vision Research.

[54]  J. D. Delius,et al.  Central Neural Mechanisms of V ocalizations , 2012 .

[55]  John M. Foley,et al.  Analysis of the effect of pattern adaptation on pattern pedestal effects: A two-process model , 1997, Vision Research.

[56]  D. Heeger.  Normalization of cell responses in cat striate cortex , 1992, Visual Neuroscience.

[57]  C. Baker,et al.  Temporal and spatial response to second-order stimuli in cat area 18. , 1998, Journal of neurophysiology.

[58]  D C Knill,et al.  Perception of surface contours and surface shape: from computation to psychophysics. , 1992, Journal of the Optical Society of America. A, Optics and image science.

[59]  H. Ashida,et al.  FMRI adaptation reveals separate mechanisms for first-order and second-order motion. , 2007, Journal of neurophysiology.

[60]  C L Baker,et al.  Spatial properties of envelope-responsive cells in area 17 and 18 neurons of the cat. , 1996, Journal of neurophysiology.

[61]  Alex Pentland,et al.  Shape Information From Shading: A Theory About Human Perception , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[62]  H. Bülthoff,et al.  Depth Discrimination from Shading under Diffuse Lighting , 2000, Perception.

[63]  Robert F Hess,et al.  Impoverished second-order input to global linking in human vision , 2000, Vision Research.

[64]  R. Allard,et al.  Double dissociation between first- and second-order processing , 2007, Vision Research.

[65]  N E Scott-Samuel,et al.  First-order and second-order signals combine to improve perceptual accuracy. , 2001, Journal of the Optical Society of America. A, Optics, image science, and vision.