Image segmentation with simultaneous illumination and reflectance estimation: An energy minimization approach

Spatial intensity variations caused by illumination changes have been a challenge for image segmentation and many other computer vision tasks. This paper presents a novel method for image segmentation with simultaneous estimation of illumination and reflectance images. The proposed method is based on the composition of an observed scene image with an illumination component and a reflectance component, known as intrinsic images. We define an energy functional in terms of an illumination image, the membership functions of the regions, and the corresponding reflectance constants of the regions in the scene. This energy is convex in each of its variables. By minimizing the energy, image segmentation result is obtained in the form of the membership functions of the regions. The illumination and reflectance components of the observed image are estimated simultaneously as the result of energy minimization. With illumination taken into account, the proposed method is able to segment images with non-uniform intensities caused by spatial variations in illumination. Comparisons with the state-of-the-art piecewise smooth model demonstrate the superior performance of our method.

[1]  Andrew Blake,et al.  Boundary conditions for lightness computation in Mondrian World , 1985, Comput. Vis. Graph. Image Process..

[2]  E. Land,et al.  Lightness and retinex theory. , 1971, Journal of the Optical Society of America.

[3]  Berthold K. P. Horn,et al.  Determining lightness from an image , 1974, Comput. Graph. Image Process..

[4]  ANTONIN CHAMBOLLE,et al.  An Algorithm for Total Variation Minimization and Applications , 2004, Journal of Mathematical Imaging and Vision.

[5]  D. Mumford,et al.  Optimal approximations by piecewise smooth functions and associated variational problems , 1989 .

[6]  Michael Elad,et al.  A Variational Framework for Retinex , 2002, IS&T/SPIE Electronic Imaging.

[7]  Tony F. Chan,et al.  A Multiphase Level Set Framework for Image Segmentation Using the Mumford and Shah Model , 2002, International Journal of Computer Vision.

[8]  H. Barrow,et al.  RECOVERING INTRINSIC SCENE CHARACTERISTICS FROM IMAGES , 1978 .

[9]  Yair Weiss,et al.  Deriving intrinsic images from image sequences , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[10]  Xavier Bresson,et al.  Fast Global Minimization of the Active Contour/Snake Model , 2007, Journal of Mathematical Imaging and Vision.

[11]  Mila Nikolova,et al.  Algorithms for Finding Global Minimizers of Image Segmentation and Denoising Models , 2006, SIAM J. Appl. Math..

[12]  Tony F. Chan,et al.  Active contours without edges , 2001, IEEE Trans. Image Process..

[13]  Alan L. Yuille,et al.  Region Competition: Unifying Snakes, Region Growing, and Bayes/MDL for Multiband Image Segmentation , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Edward H. Adelson,et al.  Estimating Intrinsic Component Images using Non-Linear Regression , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[15]  Katsushi Ikeuchi,et al.  Illumination normalization with time-dependent intrinsic images for video surveillance , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..