Outdoor Shadow Estimating Using Multiclass Geometric Decomposition Based on BLS

Illumination is a significant component of an image, and illumination estimation of an outdoor scene from given images is still challenging yet it has wide applications. Most of the traditional illumination estimating methods require prior knowledge or fixed objects within the scene, which makes them often limited by the scene of a given image. We propose an optimization approach that integrates the multiclass cues of the image(s) [a main input image and optional auxiliary input image(s)]. First, Sun visibility is estimated by the efficient broad learning system. And then for the scene with visible Sun, we classify the information in the image by the proposed classification algorithm, which combines the geometric information and shadow information to make the most of the information. And we apply a respective algorithm for every class to estimate the illumination parameters. Finally, our approach integrates all of the estimating results by the Markov random field. We make full use of the cues in the given image instead of an extra requirement for the scene, and the qualitative results are presented and show that our approach outperformed other methods with similar conditions.

[1]  Ping Li,et al.  Deep Color Guided Coarse-to-Fine Convolutional Network Cascade for Depth Image Super-Resolution , 2019, IEEE Transactions on Image Processing.

[2]  Jiandong Tian,et al.  New spectrum ratio properties and features for shadow detection , 2016, Pattern Recognit..

[3]  Feiping Nie,et al.  Dimension Reduction for Non-Gaussian Data by Adaptive Discriminative Analysis , 2019, IEEE Transactions on Cybernetics.

[4]  Peter A. Beling,et al.  Simulating Kinect Infrared and Depth Images , 2016, IEEE Transactions on Cybernetics.

[5]  C. L. Philip Chen,et al.  Broad learning system: Feature extraction based on K-means clustering algorithm , 2017, 2017 4th International Conference on Information, Cybernetics and Computational Social Systems (ICCSS).

[6]  Yannick Hold-Geoffroy,et al.  Deep Outdoor Illumination Estimation , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  Xuelong Li,et al.  Blind Image Quality Assessment via Deep Learning , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[8]  Xi Zhang,et al.  Illumination invariant feature based on neighboring radiance ratio , 2017, 2017 IEEE Visual Communications and Image Processing (VCIP).

[9]  Kwan-Liu Ma,et al.  Deep Neural Representation Guided Face Sketch Synthesis , 2019, IEEE Transactions on Visualization and Computer Graphics.

[10]  Yongwei Nie,et al.  Object Movements Synopsis viaPart Assembling and Stitching , 2014, IEEE Transactions on Visualization and Computer Graphics.

[11]  Rynson W. H. Lau,et al.  Video Decolorization Using Visual Proximity Coherence Optimization , 2018, IEEE Transactions on Cybernetics.

[12]  Ruigang Yang,et al.  Estimating pose and illumination direction for frontal face synthesis , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[13]  Wenhao Zhang,et al.  A new underwater image enhancing method via color correction and illumination adjustment , 2017, 2017 IEEE Visual Communications and Image Processing (VCIP).

[14]  Huifang Li,et al.  Shadow removal based on clustering correction of illumination field for urban aerial remote sensing images , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[15]  Nikos Paragios,et al.  Illumination estimation and cast shadow detection through a higher-order graphical model , 2011, CVPR 2011.

[16]  Guangyou Xu,et al.  Estimating illumination parameters using spherical harmonics coefficients in frequency space , 2007 .

[17]  Yongwei Nie,et al.  Compact Video Synopsis via Global Spatiotemporal Optimization , 2013, IEEE Transactions on Visualization and Computer Graphics.

[18]  Xiaonian Wang,et al.  Unfalsified Visual Servoing for Simultaneous Object Recognition and Pose Tracking , 2016, IEEE Transactions on Cybernetics.

[19]  Jun Yu,et al.  A Video, Text, and Speech-Driven Realistic 3-D Virtual Head for Human–Machine Interface , 2015, IEEE Transactions on Cybernetics.

[20]  R. K. Jeyachitra,et al.  Performance analysis of indoor joint illumination and communication systems using light emitting diodes and laser diodes , 2017, 2017 International Conference on Wireless Communications, Signal Processing and Networking (WiSPNET).

[21]  Imari Sato,et al.  Light transport component decomposition using multi-frequency illumination , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[22]  Maoguo Gong,et al.  Change Detection in Synthetic Aperture Radar Images Based on Deep Neural Networks , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[23]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[24]  Alexei A. Efros,et al.  Estimating the Natural Illumination Conditions from a Single Outdoor Image , 2012, International Journal of Computer Vision.

[25]  Bin Sheng,et al.  Computer-Assisted Decision Support System in Pulmonary Cancer detection and stage classification on CT images , 2018, J. Biomed. Informatics.

[26]  Xuelong Li,et al.  Intrinsic Image Decomposition Using Optimization and User Scribbles , 2013, IEEE Transactions on Cybernetics.

[27]  Rongrong Ji,et al.  Learning-Based Shadow Recognition and Removal From Monochromatic Natural Images , 2017, IEEE Transactions on Image Processing.

[28]  Yongwei Nie,et al.  Interactive image/video retexturing using GPU parallelism , 2012, Comput. Graph..

[29]  Alexei A. Efros,et al.  Estimating natural illumination from a single outdoor image , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[30]  C. L. Philip Chen,et al.  Broad learning system: A new learning paradigm and system without going deep , 2017, 2017 32nd Youth Academic Annual Conference of Chinese Association of Automation (YAC).

[31]  Bin Sheng,et al.  Abdominal adipose tissues extraction using multi-scale deep neural network , 2017, Neurocomputing.

[32]  Shengkui Dai,et al.  Research on adaptive fusion algorithm for image stitching , 2017, 2017 International Symposium on Intelligent Signal Processing and Communication Systems (ISPACS).

[33]  Qinghua Hu,et al.  SG-FCN: A Motion and Memory-Based Deep Learning Model for Video Saliency Detection , 2018, IEEE Transactions on Cybernetics.

[34]  Alexei A. Efros,et al.  Geometric context from a single image , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[35]  Bin Sheng,et al.  Deep gesture interaction for augmented anatomy learning , 2019, Int. J. Inf. Manag..

[36]  Bin Sheng,et al.  Deep Convolutional Neural Networks for Human Action Recognition Using Depth Maps and Postures , 2019, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[37]  Ping Tan,et al.  Intrinsic Image Decomposition with Step and Drift Shading Separation , 2020, IEEE Transactions on Visualization and Computer Graphics.

[38]  Takahiro Okabe,et al.  Diffuse-specular separation of multi-view images under varying illumination , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[39]  Ioannis A. Kakadiaris,et al.  Minimizing Illumination Differences for 3D to 2D Face Recognition Using Lighting Maps , 2014, IEEE Transactions on Cybernetics.

[40]  Qiang Wu,et al.  Retinal Vessel Segmentation Using Minimum Spanning Superpixel Tree Detector , 2019, IEEE Transactions on Cybernetics.

[41]  C. L. Philip Chen,et al.  Broad Learning System: An Effective and Efficient Incremental Learning System Without the Need for Deep Architecture , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[42]  Qiang Ji,et al.  Thermal Augmented Expression Recognition , 2018, IEEE Transactions on Cybernetics.

[43]  Ming Yang,et al.  Shadow detection and removal for illumination consistency on the road , 2017, 2017 International Conference on Security, Pattern Analysis, and Cybernetics (SPAC).

[44]  Bin Sheng,et al.  Image stylization with enhanced structure on GPU , 2012, Science China Information Sciences.

[45]  Wei Fang,et al.  A novel YOLO-Based real-time people counting approach , 2017, 2017 International Smart Cities Conference (ISC2).

[46]  J. Michalsky,et al.  All-weather model for sky luminance distribution—Preliminary configuration and validation , 1993 .

[47]  Danny Crookes,et al.  Largest Matching Areas for Illumination and Occlusion Robust Face Recognition , 2017, IEEE Transactions on Cybernetics.

[48]  Krista A. Ehinger,et al.  Recognizing scene viewpoint using panoramic place representation , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.