A gradient-domain image enhancement method for traffic signs in nighttime surveillance

Nighttime video surveillance may suffer from nonuniform illumination from artificial light sources. Meanwhile, these light sources which often result in so noticeable amounts of glow that the objects nearby the light sources cannot be seen at all. To solve the above problem, our paper proposed a novel gradient-domain image enhancement method for traffic signs in nighttime surveillance. We found that both of the glow-removal and image fusion can be represented as a kind of gradient adjustment. Therefore, in our method, remove the glow effects via image gradient decomposition at first. Then, complementary details of inter frames can be fused together in the gradient domain. Finally, the enhanced image will be obtained via a Poisson solver. We have done many experiments and the results show that the proposed method can effectively enhance the traffic signs in nighttime traffic videos.

[1]  Xuelong Li,et al.  Exposure Fusion Using Boosting Laplacian Pyramid , 2014, IEEE Transactions on Cybernetics.

[2]  Li Zhuo,et al.  Exposure fusion via textural and color transform , 2014, 2014 9th IEEE Conference on Industrial Electronics and Applications.

[3]  Sunghyun Cho,et al.  Fast motion deblurring , 2009, SIGGRAPH 2009.

[4]  Xiaoou Tang,et al.  Single Image Haze Removal Using Dark Channel Prior , 2011 .

[5]  Patrick Pérez,et al.  Poisson image editing , 2003, ACM Trans. Graph..

[6]  Jianbo Shi,et al.  Generalized Random Walks for Fusion of Multi-Exposure Images , 2011, IEEE Transactions on Image Processing.

[7]  Qi Zhang,et al.  Rolling Guidance Filter , 2014, ECCV.

[8]  Jan Kautz,et al.  Exposure Fusion , 2009, 15th Pacific Conference on Computer Graphics and Applications (PG'07).

[9]  Bernhard Schölkopf,et al.  Fast removal of non-uniform camera shake , 2011, 2011 International Conference on Computer Vision.

[10]  Shree K. Nayar,et al.  Shedding light on the weather , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[11]  Ta-Hsin Li,et al.  A joint estimation approach for two-tone image deblurring by blind deconvolution , 2002, IEEE Trans. Image Process..

[12]  Ming-Hsuan Yang,et al.  Joint Depth Estimation and Camera Shake Removal from Single Blurry Image , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  Jenn-Jier James Lien,et al.  Photography Enhancement Based on the Fusion of Tone and Color Mappings in Adaptive Local Region , 2010, IEEE Transactions on Image Processing.

[14]  Robby T. Tan,et al.  Visibility in bad weather from a single image , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Frédo Durand,et al.  Efficient marginal likelihood optimization in blind deconvolution , 2011, CVPR 2011.

[16]  Ankit Gupta,et al.  Single Image Deblurring Using Motion Density Functions , 2010, ECCV.

[17]  Xuelong Li,et al.  A Comprehensive Survey to Face Hallucination , 2013, International Journal of Computer Vision.

[18]  Seungyong Lee,et al.  Handling outliers in non-blind image deconvolution , 2011, 2011 International Conference on Computer Vision.

[19]  Alexei A. Efros,et al.  Fast bilateral filtering for the display of high-dynamic-range images , 2002 .

[20]  Ying-Ching Chen,et al.  Underwater Image Enhancement by Wavelength Compensation and Dehazing , 2012, IEEE Transactions on Image Processing.

[21]  Li Xu,et al.  Two-Phase Kernel Estimation for Robust Motion Deblurring , 2010, ECCV.

[22]  Codruta O. Ancuti,et al.  Single Image Dehazing by Multi-Scale Fusion , 2013, IEEE Transactions on Image Processing.

[23]  Lucjan Janowski,et al.  A no reference metric for the quality assessment of videos affected by exposure distortion , 2011, 2011 IEEE International Conference on Multimedia and Expo.

[24]  Ming-Hsuan Yang,et al.  Deblurring Low-Light Images with Light Streaks , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Hans-Peter Seidel,et al.  Optimal HDR reconstruction with linear digital cameras , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[26]  Li Zhuo,et al.  Layered-based exposure fusion algorithm , 2013, IET Image Process..

[27]  Codruta O. Ancuti,et al.  Enhancing underwater images and videos by fusion , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[28]  Kin-Man Lam,et al.  An adaptive algorithm for the display of high-dynamic range images , 2007, J. Vis. Commun. Image Represent..

[29]  Michael S. Brown,et al.  Single Image Layer Separation Using Relative Smoothness , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[30]  Li Xu,et al.  Unnatural L0 Sparse Representation for Natural Image Deblurring , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[31]  Jean-Philippe Tarel,et al.  BLIND CONTRAST ENHANCEMENT ASSESSMENT BY GRADIENT RATIOING AT VISIBLE EDGES , 2011 .

[32]  Yair Weiss,et al.  From learning models of natural image patches to whole image restoration , 2011, 2011 International Conference on Computer Vision.

[33]  Michael S. Brown,et al.  Nighttime Haze Removal with Glow and Multiple Light Colors , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[34]  William T. Freeman,et al.  Removing camera shake from a single photograph , 2006, SIGGRAPH 2006.

[35]  Sandy Irani,et al.  Perception-based contrast enhancement of images , 2007, TAP.

[36]  Manoranjan Paul,et al.  Just Noticeable Difference for Images With Decomposition Model for Separating Edge and Textured Regions , 2010, IEEE Transactions on Circuits and Systems for Video Technology.