Shadow removal from natural images

In this paper, we present a system for estimating the shadow field from a single natural image. The user of our system is provided with a broad brush to roughly specify the shadow boundary. As the user finishes drawing a stroke, the system starts to estimate the shadow field around the stroke and generates pretty accurate result even if the underlying surface is highly textured. Since the strokes provided by the user may be sparse, an optimization scheme is proposed to propagate the estimated shadow field to the entire image. With this scheme, the amount of user interactions required for the system is reduced. The shadow field estimated by our system can be used to seamlessly remove the shadow from the image. It is also useful for other shadow editing tasks. Experimental results on a variety of photos are provided to show the effectiveness of the proposed system.

[1]  Harry Shum,et al.  Natural shadow matting , 2007, TOGS.

[2]  Patrick Pérez,et al.  Poisson image editing , 2003, ACM Trans. Graph..

[3]  Dani Lischinski,et al.  A Closed-Form Solution to Natural Image Matting , 2008 .

[4]  David Salesin,et al.  A Bayesian approach to digital matting , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[5]  Michael Gleicher,et al.  Texture-Consistent Shadow Removal , 2008, ECCV.

[6]  Zeev Farbman,et al.  Interactive local adjustment of tonal values , 2006, ACM Trans. Graph..

[7]  Mark S. Drew,et al.  Removing Shadows from Images , 2002, ECCV.

[8]  G. Finlayson,et al.  Simple Shadow Removal , 2006 .

[9]  Jack Tumblin,et al.  Editing Soft Shadows in a Digital Photograph , 2007, IEEE Computer Graphics and Applications.

[10]  Tai-Pang Wu,et al.  A Bayesian approach for shadow extraction from a single image , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[11]  Patrick Pérez,et al.  Region filling and object removal by exemplar-based image inpainting , 2004, IEEE Transactions on Image Processing.

[12]  Dani Lischinski,et al.  The Shadow Meets the Mask: Pyramid‐Based Shadow Removal , 2008, Comput. Graph. Forum.

[13]  Graham D. Finlayson,et al.  Simple Shadow Remova , 2006, 18th International Conference on Pattern Recognition (ICPR'06).