Recovering shading and reflectance from a single image

The Problem: Given an input image, decompose it into an image representing the shading of the scene and a second image representing the reflectance of every point in the scene. Finding the shading image can be thought of as re-rendering the image as if every surface shown in the image was made of the same material, such as plaster. Figure 1 shows an example image that has been decomposed into shading and reflectance images.

[1]  Edward H. Adelson,et al.  The perception of shading and reflectance , 1996 .

[2]  H. Barrow,et al.  RECOVERING INTRINSIC SCENE CHARACTERISTICS FROM IMAGES , 1978 .

[3]  Alex Pentland.  Linear shape from shading , 2004, International Journal of Computer Vision.

[4]  Yair Weiss,et al.  Deriving intrinsic images from image sequences , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[5]  Mark S. Drew,et al.  Removing Shadows from Images , 2002, ECCV.

[6]  James R. Bergen,et al.  Pyramid-based texture analysis/synthesis , 1995, Proceedings., International Conference on Image Processing.

[7]  E. Land,et al.  Lightness and retinex theory. , 1971, Journal of the Optical Society of America.

[8]  Paul A. Viola,et al.  Boosting Image Retrieval , 2004, International Journal of Computer Vision.

[9]  Mark S. Drew,et al.  Recovering Shading from Color Images , 1992, ECCV.

[10]  Paul A. Viola,et al.  Bayesian Model of Surface Perception , 1997, NIPS.

[11]  J. Friedman.  Special Invited Paper-Additive logistic regression: A statistical view of boosting , 2000 .

[12]  Geoffrey E. Hinton,et al.  The EM algorithm for mixtures of factor analyzers , 1996 .

[13]  Jitendra Malik,et al.  Recognizing surfaces using three-dimensional textons , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[14]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1995, EuroCOLT.

[15]  J. M. Rubin,et al.  Color vision and image intensities: When are changes material? , 1982, Biological Cybernetics.

[16]  William T. Freeman,et al.  Learning Low-Level Vision , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[17]  Yoshua Bengio,et al.  Convolutional networks for images, speech, and time series , 1998 .

[18]  W. Freeman,et al.  Generalized Belief Propagation , 2000, NIPS.

[19]  W. Freeman,et al.  Learning local evidence for shading and reflectance , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[20]  Y. J. Tejwani,et al.  Robot vision , 1989, IEEE International Symposium on Circuits and Systems,.