Angular embedding: From jarring intensity differences to perceived luminance

Our goal is to turn an intensity image into its perceived luminance without parsing it into depths, surfaces, or scene illuminations. We start with jarring intensity differences at two scales mixed according to edges, identified by a pixel-centric edge detector. We propose angular embedding as a more robust, efficient, and versatile alternative to LS, LLE, and NCUTS for obtaining a global brightness ordering from local differences. Our model explains a variety of brightness illusions with a single algorithm. Brightness of a pixel can be understood locally as its intensity deviating in the gradient direction and globally as finding its rank relative to others, particularly the lightest and darkest ones.

[1]  Rama Chellappa,et al.  A Method for Enforcing Integrability in Shape from Shading Algorithms , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Berthold K. P. Horn,et al.  Determining lightness from an image , 1974, Comput. Graph. Image Process..

[3]  Ian P Howard,et al.  The Helmholtz – Hering Debate in Retrospect , 1999, Perception.

[4]  S. Grossberg.  The quantized geometry of visual space: The coherent computation of depth, form, and lightness , 1982, Behavioral and Brain Sciences.

[5]  E. Land,et al.  Lightness and retinex theory. , 1971, Journal of the Optical Society of America.

[6]  W. D. Ross,et al.  Lightness from contrast: A selective integration model , 2000, Perception & psychophysics.

[7]  Berthold K. P. Horn,et al.  Shape from shading , 1989 .

[8]  Jitendra Malik,et al.  Normalized cuts and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[9]  A. Gilchrist.  Seeing in Black and White , 2006 .

[10]  D. Todorović.  Lightness and Junctions , 1997, Perception.

[11]  S. Yu,et al.  Segmentation with pairwise attraction and repulsion , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[12]  Todor Georgiev,et al.  Covariant Derivatives and Vision , 2006, ECCV.

[13]  H. Barrow,et al.  RECOVERING INTRINSIC SCENE CHARACTERISTICS FROM IMAGES , 1978 .

[14]  Yair Weiss,et al.  Deriving intrinsic images from image sequences , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[15]  Edward H. Adelson,et al.  Recovering intrinsic images from a single image , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  M. McCourt,et al.  Oriented multiscale spatial filtering and contrast normalization: a parsimonious model of brightness induction in a continuum of stimuli including White, Howe and simultaneous brightness contrast , 2005, Vision Research.

[17]  S. Grossberg,et al.  Neural dynamics of 3-D surface perception: Figure-ground separation and lightness perception , 2000, Perception & psychophysics.

[18]  Edward H. Adelson,et al.  The perception of shading and reflectance , 1996 .

[19]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.