Quaternion-based image shadow removal

Visual effects such as shadows and highlights appear in photographs due to variations in lighting conditions. Although these effects add more meaning to the images, they pose various problems to specific computer vision algorithms. Hence, the removal of shadows and highlights is often considered as a prerequisite to such algorithms. This paper presents an interactive technique for shadow elimination from images. Our method requires user input in the form of rough strokes on the shadow region and its corresponding non-shadow region in the image. We further use quaternion rotation in the YCbCr color space to derive an image that is invariant to shadows. The actual colors of the image are finally recovered by color transfer from the original shadow image. The proposed method takes less time to generate the shadow-free image and does not necessitate the detection of shadows prior to its removal. Also, unlike the existing shadow-removal techniques, our method generates invariant image with minor texture loss. Experimental findings are reported to demonstrate the performance of our shadow-removal technique.

[1]  Erik Reinhard,et al.  Color Transfer between Images , 2001, IEEE Computer Graphics and Applications.

[2]  Cheng Lu,et al.  On the removal of shadows from images , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  R. Sasi,et al.  Shadow removal using sparse representation over local dictionaries , 2016 .

[4]  Jiandong Tian,et al.  Pixel-wise Orthogonal Decomposition for Color Illumination Invariant and Shadow-free Image , 2014, Optics express.

[5]  V. K. Govindan,et al.  Single image shadow removal by optimization using non-shadow anchor values , 2019, Computational Visual Media.

[6]  Cheng Lu,et al.  Intrinsic Images by Entropy Minimization , 2004, ECCV.

[7]  Dimitris Samaras,et al.  Large-Scale Training of Shadow Detectors with Noisily-Annotated Shadow Examples , 2016, ECCV.

[8]  Han Gong,et al.  Interactive Removal and Ground Truth for Difficult Shadow Scenes , 2016, Journal of the Optical Society of America. A, Optics, image science, and vision.

[9]  Derek Hoiem,et al.  Paired Regions for Shadow Detection and Removal , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Chunxia Xiao,et al.  Effective shadow removal via multi-scale image decomposition , 2019, The Visual Computer.

[11]  Ge Li,et al.  A New Shadow Removal Method Using Color-Lines , 2017, CAIP.

[12]  Qing Zhang,et al.  Shadow Remover: Image Shadow Removal Based on Illumination Recovering Optimization , 2015, IEEE Transactions on Image Processing.

[13]  Homer H. Chen,et al.  A Three-Stage Approach to Shadow Field Estimation From Partial Boundary Information , 2010, IEEE Transactions on Image Processing.

[14]  Hazem Hiary,et al.  Single-Image Shadow Detection using Quaternion Cues , 2018, Comput. J..

[15]  Le Hui,et al.  Stacked Conditional Generative Adversarial Networks for Jointly Learning Shadow Detection and Shadow Removal , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[16]  Darren Cosker,et al.  User-assisted image shadow removal , 2017, Image Vis. Comput..

[17]  Lilong Shi,et al.  Quaternion color texture segmentation , 2007, Comput. Vis. Image Underst..

[18]  V. Govindan,et al.  A Survey on Shadow Removal Techniques for Single Image , 2016 .

[19]  Gang Chen,et al.  Quaternion Zernike moments and their invariants for color image analysis and object recognition , 2012, Signal Process..

[20]  Baba C. Vemuri,et al.  A Quaternion Framework for Color Image Smoothing and Segmentation , 2011, International Journal of Computer Vision.

[21]  Lin Chen,et al.  Efficient Shadow Removal Using Subregion Matching Illumination Transfer , 2013, Comput. Graph. Forum.

[22]  Narendra Ahuja,et al.  Shadow Removal Using Bilateral Filtering , 2012, IEEE Transactions on Image Processing.

[23]  Stephen J. Sangwine,et al.  Hypercomplex color-sensitive smoothing filters , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[24]  Chunxia Xiao,et al.  Shading-aware shadow detection and removal from a single image , 2020, The Visual Computer.

[25]  V. K. Govindan,et al.  Shadow Detection and Removal from a Single Image Using LAB Color Space , 2013 .

[26]  Michael Terry,et al.  Learning to Remove Soft Shadows , 2015, ACM Trans. Graph..