Shadow Removal Using Intensity Surfaces and Texture Anchor Points

Removal of shadows from a single image is a challenging problem. Producing a high-quality shadow-free image which is indistinguishable from a reproduction of a true shadow-free scene is even more difficult. Shadows in images are typically affected by several phenomena in the scene, including physical phenomena such as lighting conditions, type and behavior of shadowed surfaces, occluding objects, etc. Additionally, shadow regions may undergo postacquisition image processing transformations, e.g., contrast enhancement, which may introduce noticeable artifacts in the shadow-free images. We argue that the assumptions introduced in most studies arise from the complexity of the problem of shadow removal from a single image and limit the class of shadow images which can be handled by these methods. The purpose of this paper is twofold: First, it provides a comprehensive survey of the problems and challenges which may occur when removing shadows from a single image. In the second part of the paper, we present our framework for shadow removal, in which we attempt to overcome some of the fundamental problems described in the first part of the paper. Experimental results demonstrating the capabilities of our algorithm are presented.

[1]  Harry Shum,et al.  Natural shadow matting , 2007, TOGS.

[2]  G. Finlayson,et al.  Simple Shadow Removal , 2006 .

[3]  Graham D. Finlayson,et al.  Shadow Identification using Colour Ratios , 2000, CIC.

[4]  J. P. Lewis.  Fast Normalized Cross-Correlation , 2010 .

[5]  Tai-Pang Wu,et al.  A Bayesian approach for shadow extraction from a single image , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[6]  Martin D. Levine,et al.  Removing shadows , 2005, Pattern Recognit. Lett..

[7]  Mohan M. Trivedi,et al.  Detecting Moving Shadows: Algorithms and Evaluation , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Hagit Hel-Or,et al.  Texture-Preserving Shadow Removal in Color Images Containing Curved Surfaces , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Hujun Bao,et al.  Shadow Removal in Gradient Domain , 2005, ICIAR.

[10]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[11]  Anil K. Jain.  Fundamentals of Digital Image Processing , 2018, Control of Color Imaging Systems.

[12]  Laurent D. Cohen,et al.  Finite-Element Methods for Active Contour Models and Balloons for 2-D and 3-D Images , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Xiaodong Gu,et al.  Image shadow removal using pulse coupled neural network , 2005, IEEE Transactions on Neural Networks.

[14]  Masashi Baba,et al.  Shadow removal from a real picture , 2003, SIGGRAPH '03.

[15]  Mark S. Drew,et al.  Removing Shadows from Images , 2002, ECCV.

[16]  Thomas Ertl,et al.  Hierarchical Solutions for the Deformable Surface Problem in Visualization , 2000, Graph. Model..

[17]  Mark S. Drew,et al.  Detecting Illumination in Images , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[18]  Cheng Lu,et al.  Intrinsic Images by Entropy Minimization , 2004, ECCV.

[19]  H. Barrow,et al.  RECOVERING INTRINSIC SCENE CHARACTERISTICS FROM IMAGES , 1978 .

[20]  D. Knill,et al.  The perception of cast shadows , 1998, Trends in Cognitive Sciences.

[21]  Jack Tumblin,et al.  Editing Soft Shadows in a Digital Photograph , 2007, IEEE Computer Graphics and Applications.

[22]  Yair Weiss,et al.  Deriving intrinsic images from image sequences , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[23]  Stan Z. Li,et al.  Markov Random Field Modeling in Image Analysis , 2001, Computer Science Workbench.

[24]  Touradj Ebrahimi,et al.  Cast shadow segmentation using invariant color features , 2004, Comput. Vis. Image Underst..

[25]  Moshe Koppel,et al.  Detecting and Removing Shadows , 2004 .

[26]  Tim J. Ellis,et al.  Image Difference Threshold Strategies and Shadow Detection , 1995, BMVC.

[27]  Alessandro Leone,et al.  Shadow detection for moving objects based on texture analysis , 2007, Pattern Recognit..

[28]  David Salesin,et al.  Shadow matting and compositing , 2003, ACM Trans. Graph..

[29]  Cheng Lu,et al.  On the removal of shadows from images , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Touradj Ebrahimi,et al.  Shadow identification and classification using invariant color models , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[31]  Alessandro Bevilacqua,et al.  Effective Shadow Detection in Traffic Monitoring Applications , 2003, WSCG.

[32]  Graham D. Finlayson,et al.  Hamiltonian Path based Shadow Removal , 2005, BMVC.

[33]  Reinhard Koch,et al.  A Color Similarity Measure for Robust Shadow Removal in Real Time , 2003, VMV.

[34]  Graham D. Finlayson,et al.  Simple Shadow Remova , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[35]  Francis Y. L. Chin,et al.  Shadow detection for vehicles by locating the object-shadow boundary , 2005, SIP.

[36]  J. Keller,et al.  Geometrical theory of diffraction. , 1962, Journal of the Optical Society of America.

[37]  John C. Platt,et al.  Elastically deformable models , 1987, SIGGRAPH.

[38]  Demetri Terzopoulos,et al.  Symmetry-seeking models and 3D object reconstruction , 1988, International Journal of Computer Vision.

[39]  Mark S. Drew,et al.  Removing Shadows From Images using Retinex , 2002, CIC.

[40]  Primack,et al.  Penumbra diffraction in the quantization of dispersing billiards. , 1995, Physical review letters.

[41]  Li Xu,et al.  Shadow Removal from a Single Image , 2006, Sixth International Conference on Intelligent Systems Design and Applications.

[42]  Anat Levin,et al.  User Assisted Separation of Reflections from a Single Image Using a Sparsity Prior , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[43]  Masashi Baba,et al.  Shadow removal from a real image based on shadow density , 2004, SIGGRAPH '04.