Single image shadow detection and removal based on feature fusion and multiple dictionary learning

In recent years, the analysis of natural image has made great progress while the image of the intrinsic component analysis can solve many computer vision problems, such as the image shadow detection and removal. This paper presents the novel model, which integrates the feature fusion and the multiple dictionary learning. Traditional model can hardly handle the challenge of reserving the removal accuracy while keeping the low time consuming. Inspire by the compressive sensing theory, traditional single dictionary scenario is extended to the multiple condition. The human visual system is more sensitive to the high frequency part of the image, and the high frequency part expresses most of the semantic information of the image. At the same time, the high frequency characteristic of the high and low resolution image is adopted in the dictionary training, which can effectively recover the loss in the high resolution image with high frequency information. This paper presents the integration of compressive sensing model with feature extraction to construct the two-stage methodology. Therefore, the feature fusion algorithm is applied to the dictionary training procedure to finalize the robust model. Simulation results proves the effectiveness of the model, which outperforms compared with the other state-of-the-art algorithms.

[1]  Haiying Xia,et al.  A modified Gaussian mixture background model via spatiotemporal distribution with shadow detection , 2016, Signal Image Video Process..

[2]  Mehmet Karakose,et al.  Image processing based analysis of moving shadow effects for reconfiguration in PV arrays , 2014, 2014 IEEE International Energy Conference (ENERGYCON).

[3]  Qing Zhang,et al.  Cloud Detection of RGB Color Aerial Photographs by Progressive Refinement Scheme , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[4]  Bo Li,et al.  Robust patch-based tracking using valid patch selection and feature fusion update , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[5]  Qing Zhang,et al.  Shadow Remover: Image Shadow Removal Based on Illumination Recovering Optimization , 2015, IEEE Transactions on Image Processing.

[6]  C. Woodcock,et al.  Improvement and expansion of the Fmask algorithm: cloud, cloud shadow, and snow detection for Landsats 4–7, 8, and Sentinel 2 images , 2015 .

[7]  Dapeng Tao,et al.  Feature fusion of triaxial acceleration signals and depth maps for human action recognition , 2016, 2016 IEEE International Conference on Information and Automation (ICIA).

[8]  Aihua Li,et al.  Moving Shadow Detection Based on Multi-feature Fusion , 2016, 2016 8th International Conference on Intelligent Human-Machine Systems and Cybernetics (IHMSC).

[9]  Michael Elad,et al.  Improving Dictionary Learning: Multiple Dictionary Updates and Coefficient Reuse , 2013, IEEE Signal Processing Letters.

[10]  Guangfeng Lin,et al.  Heterogeneous feature structure fusion for classification , 2016, Pattern Recognit..

[11]  Denis Friboulet,et al.  Compressed Sensing Reconstruction of 3D Ultrasound Data Using Dictionary Learning and Line-Wise Subsampling , 2015, IEEE Transactions on Medical Imaging.

[12]  Mohammed Bennamoun,et al.  Automatic Feature Learning for Robust Shadow Detection , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  Collin G. Homer,et al.  Automated cloud and shadow detection and filling using two-date Landsat imagery in the USA , 2013 .

[14]  Dimitris Samaras,et al.  Single Image Shadow Removal via Neighbor-Based Region Relighting , 2014, ECCV Workshops.

[15]  Shengping Zhang,et al.  Online Dictionary Learning on Symmetric Positive Definite Manifolds with Vision Applications , 2015, AAAI.

[16]  Yang Liu,et al.  Road Image Shadow Removal Method Based on Retinex Algorithm , 2016, 2016 8th International Conference on Intelligent Human-Machine Systems and Cybernetics (IHMSC).

[17]  Lizhuang Ma,et al.  Multispectral Joint Image Restoration via Optimizing a Scale Map , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Zi Huang,et al.  Multi-Feature Fusion via Hierarchical Regression for Multimedia Analysis , 2013, IEEE Transactions on Multimedia.

[19]  M. Joseph Hughes,et al.  Automated Detection of Cloud and Cloud Shadow in Single-Date Landsat Imagery Using Neural Networks and Spatial Post-Processing , 2014, Remote. Sens..

[20]  Jian Yang,et al.  Unsupervised Discriminant Canonical Correlation Analysis for Feature Fusion , 2014, 2014 22nd International Conference on Pattern Recognition.

[21]  Zhe Zhu,et al.  Automated cloud, cloud shadow, and snow detection in multitemporal Landsat data: An algorithm designed specifically for monitoring land cover change , 2014 .

[22]  Mohammed Bennamoun,et al.  Automatic Shadow Detection and Removal from a Single Image , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Lin Chen,et al.  Efficient Shadow Removal Using Subregion Matching Illumination Transfer , 2013, Comput. Graph. Forum.

[24]  Jianfei Cai,et al.  Kinect Shadow Detection and Classification , 2013, 2013 IEEE International Conference on Computer Vision Workshops.

[25]  Haoxiang Wang,et al.  An Effective Image Representation Method Using Kernel Classification , 2014, 2014 IEEE 26th International Conference on Tools with Artificial Intelligence.