Shadow removal from uniform-textured images using iterative thresholding of shearlet coefficients

Shadows are natural phenomena that appear in images due to inconsistent illumination of the scene being captured. Recently, the need for removal of shadows from images and videos has gained wide attention due to the ill-effects of shadows on many computer vision tasks. This paper presents a novel technique to remove shadows from images with a uniform background. Initially, our method identifies the shadow and the lit regions by discarding the low-frequency image details. This is followed by an iterative procedure in which the shadow pixels to be corrected are located by eliminating the Shearlet approximation coefficients greater than a threshold. The shadow pixels identified in each iteration are corrected using a pre-computed correction factor. The shadow-corrected image is finally inpainted to generate the shadow-free output. In order to demonstrate the superior performance of the proposed method, we provide both qualitative and quantitative comparisons of the method with other state-of-the-art techniques.

[1]  Cheng Lu,et al.  On the removal of shadows from images , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Wang-Q Lim,et al.  ShearLab 3D , 2014, 1402.5670.

[3]  Narendra Ahuja,et al.  Shadow Removal Using Bilateral Filtering , 2012, IEEE Transactions on Image Processing.

[4]  Han Gong,et al.  Interactive Removal and Ground Truth for Difficult Shadow Scenes , 2016, Journal of the Optical Society of America. A, Optics, image science, and vision.

[5]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[6]  D. Donoho,et al.  Simultaneous cartoon and texture image inpainting using morphological component analysis (MCA) , 2005 .

[7]  David Zhang,et al.  FSIM: A Feature Similarity Index for Image Quality Assessment , 2011, IEEE Transactions on Image Processing.

[8]  Nijad Al-Najdawi,et al.  A survey of cast shadow detection algorithms , 2012, Pattern Recognit. Lett..

[9]  Graham D. Finlayson,et al.  Simple Shadow Remova , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[10]  Jr. Thomas G. Stockham,et al.  Image processing in the context of a visual model , 1972 .

[11]  Derek Hoiem,et al.  Paired Regions for Shadow Detection and Removal , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  V. K. Govindan,et al.  Shadow Detection and Removal from a Single Image Using LAB Color Space , 2013 .

[13]  Qing Zhang,et al.  Shadow Remover: Image Shadow Removal Based on Illumination Recovering Optimization , 2015, IEEE Transactions on Image Processing.

[14]  Ge Li,et al.  A New Shadow Removal Method Using Color-Lines , 2017, CAIP.

[15]  Dimitris Samaras,et al.  Large-Scale Training of Shadow Detectors with Noisily-Annotated Shadow Examples , 2016, ECCV.

[16]  Lin Chen,et al.  Efficient Shadow Removal Using Subregion Matching Illumination Transfer , 2013, Comput. Graph. Forum.

[17]  Glenn R. Easley,et al.  Image Processing Using Shearlets , 2012 .

[18]  H. Barrow,et al.  RECOVERING INTRINSIC SCENE CHARACTERISTICS FROM IMAGES , 1978 .

[19]  Patrick Pérez,et al.  Region filling and object removal by exemplar-based image inpainting , 2004, IEEE Transactions on Image Processing.

[20]  Chi-Wing Fu,et al.  Direction-Aware Spatial Context Features for Shadow Detection , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[21]  V. K. Govindan,et al.  A Survey on Shadow Detection Techniques in a Single Image , 2018, Inf. Technol. Control..

[22]  Rynson W. H. Lau,et al.  DeshadowNet: A Multi-context Embedding Deep Network for Shadow Removal , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[23]  Michael Terry,et al.  Learning to Remove Soft Shadows , 2015, ACM Trans. Graph..

[24]  Jiejie Zhu,et al.  Learning to recognize shadows in monochromatic natural images , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[25]  G. Easley,et al.  Sparse directional image representations using the discrete shearlet transform , 2008 .

[26]  Darren Cosker,et al.  User-assisted image shadow removal , 2017, Image Vis. Comput..

[27]  Karianto Leman,et al.  Shadow optimization from structured deep edge detection , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[28]  Homer H. Chen,et al.  A Three-Stage Approach to Shadow Field Estimation From Partial Boundary Information , 2010, IEEE Transactions on Image Processing.

[29]  Mohammed Bennamoun,et al.  Automatic Shadow Detection and Removal from a Single Image , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  V. Govindan,et al.  A Survey on Shadow Removal Techniques for Single Image , 2016 .

[31]  Mark S. Drew,et al.  Removing Shadows from Images , 2002, ECCV.

[32]  Chi-Wing Fu,et al.  Bidirectional Feature Pyramid Network with Recurrent Attention Residual Modules for Shadow Detection , 2018, ECCV.

[33]  Le Hui,et al.  Stacked Conditional Generative Adversarial Networks for Jointly Learning Shadow Detection and Shadow Removal , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[34]  Hagit Hel-Or,et al.  Shadow Removal Using Intensity Surfaces and Texture Anchor Points , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[35]  Zhou Wang,et al.  Multi-scale structural similarity for image quality assessment , 2003 .

[36]  Wang-Q Lim,et al.  Sparse multidimensional representation using shearlets , 2005, SPIE Optics + Photonics.

[37]  G. Finlayson,et al.  Simple Shadow Removal , 2006 .