Use of Spider Model to Decompose Complex Reflection Components

Many object surfaces are composed of layers of different physical substances, and these are known as layered surfaces. Such surfaces have more complex optical properties than diffuse surfaces and are generally incapable of being segmented. This is because their colors change with the mixture of the optical properties of the layers, which leads to the colors changing gradually instead of sharply. To tackle these problems, we focused on surfaces with two layers, and propose a novel physical model, the Spider model. Given a single input image, our goal is to segment the colors of the image on the basis of the physical model of layered surfaces and to extract the optical properties of the two layers. The end results provide us with the approximated top layer's opacities, as well as the reflection of the top and bottom layers. The latter two are equivalent to the segmented colors of both layers. We show the results of comparison with general segmentation and digital matting. Moreover, experiments with real images show that our method is effective.

[1]  Beer Bestimmung der Absorption des rothen Lichts in farbigen Flüssigkeiten , 1852 .

[2]  D. B. Judd,et al.  Spectral Distribution of Typical Daylight as a Function of Correlated Color Temperature , 1964 .

[3]  Katsushi Ikeuchi,et al.  Object shape and reflectance modeling from observation , 1997, SIGGRAPH.

[4]  Shree K. Nayar,et al.  Vision in bad weather , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[5]  Katsushi Ikeuchi,et al.  Determining reflectance parameters and illumination distribution from a sparse set of images for view-dependent image synthesis , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[6]  S. G. Narasimhan,et al.  Interactive Deweathering of An Image Using Physical Model , 2003 .

[7]  Katsushi Ikeuchi,et al.  Polarization-based inverse rendering from a single view , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[8]  Gudrun Klinker,et al.  A physical approach to color image understanding , 1989, International Journal of Computer Vision.

[9]  Jian Sun,et al.  Lazy snapping , 2004, SIGGRAPH 2004.

[10]  Jiaya Jia,et al.  Poisson matting , 2004, SIGGRAPH 2004.

[11]  Yoav Y. Schechner,et al.  Clear underwater vision , 2004, CVPR 2004.

[12]  Daniel P. Huttenlocher,et al.  Efficient Graph-Based Image Segmentation , 2004, International Journal of Computer Vision.

[13]  M. Werman,et al.  Color lines: image specific color representation , 2004, CVPR 2004.

[14]  Takeo Kanade,et al.  The measurement of highlights in color images , 1988, International Journal of Computer Vision.

[15]  Richard Szeliski,et al.  A Comparative Study of Energy Minimization Methods for Markov Random Fields , 2006, ECCV.

[16]  Michael F. Cohen,et al.  Optimized Color Sampling for Robust Matting , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[17]  Dani Lischinski,et al.  A Closed-Form Solution to Natural Image Matting , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.