Coarse-to-Fine Luminance Estimation for Low-Light Image Enhancement in Maritime Video Surveillance

Captured images in maritime video surveillance under non-uniform illumination conditions easily suffer from low contrast and details loss. The low-quality images may significantly result in negative effects in practical applications, e.g., target detection, recognition, classification and tracking, etc. Increasing attention has recently been paid to improve the quality of low-light images via computer vision techniques. In this paper, we propose to establish a two-step luminance estimation framework to enhance low-light images. In particular, the coarse luminance is firstly estimated using traditional Max-RGB which extracts the highest pixel values in each color channel. The refined luminance is obtained by introducing a weighted variational model which has the capacities of structure-preserving and texture-smoothing. Based on the estimated well-constructed luminance, the enhanced low-light images are obtained by combining Retinex model with its extended version. The image quality is further improved through a BM3D-based denoising approach. Experimental results on both synthetic and realistic low-light images have demonstrated the satisfactory imaging performance in terms of quantitative and qualitative evaluations.

[1]  Yu Li,et al.  LIME: Low-Light Image Enhancement via Illumination Map Estimation , 2017, IEEE Transactions on Image Processing.

[2]  Zia-ur Rahman,et al.  A multiscale retinex for bridging the gap between color images and the human observation of scenes , 1997, IEEE Trans. Image Process..

[3]  Karen O. Egiazarian,et al.  Video denoising by sparse 3D transform-domain collaborative filtering , 2007, 2007 15th European Signal Processing Conference.

[4]  Zia-ur Rahman,et al.  Properties and performance of a center/surround retinex , 1997, IEEE Trans. Image Process..

[5]  Chen Wei,et al.  Deep Retinex Decomposition for Low-Light Enhancement , 2018, BMVC.

[6]  Zeev Farbman,et al.  Edge-preserving decompositions for multi-scale tone and detail manipulation , 2008, SIGGRAPH 2008.

[7]  Hai-Miao Hu,et al.  Naturalness Preserved Enhancement Algorithm for Non-Uniform Illumination Images , 2013, IEEE Transactions on Image Processing.

[8]  Delu Zeng,et al.  A fusion-based enhancing method for weakly illuminated images , 2016, Signal Process..

[9]  A. Cantor Optics of the atmosphere--Scattering by molecules and particles , 1978, IEEE Journal of Quantum Electronics.

[10]  Keith E. Muller,et al.  Contrast-limited adaptive histogram equalization: speed and effectiveness , 1990, [1990] Proceedings of the First Conference on Visualization in Biomedical Computing.

[11]  E. Land The retinex theory of color vision. , 1977, Scientific American.

[12]  Yao Lu,et al.  Fast efficient algorithm for enhancement of low lighting video , 2011, ICME.

[13]  Wei Zeng,et al.  Night video enhancement using improved dark channel prior , 2013, 2013 IEEE International Conference on Image Processing.

[14]  Xiaoou Tang,et al.  Single Image Haze Removal Using Dark Channel Prior , 2011 .

[15]  Stefan Harmeling,et al.  Image denoising: Can plain neural networks compete with BM3D? , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[16]  Xiao-Ping Zhang,et al.  A variational framework for single low light image enhancement using bright channel prior , 2013, 2013 IEEE Global Conference on Signal and Information Processing.

[17]  Xiao-Ping Zhang,et al.  A Weighted Variational Model for Simultaneous Reflectance and Illumination Estimation , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  John D. Austin,et al.  Adaptive histogram equalization and its variations , 1987 .

[19]  J. Alex Stark,et al.  Adaptive image contrast enhancement using generalizations of histogram equalization , 2000, IEEE Trans. Image Process..

[20]  Luc Van Gool,et al.  DSLR-Quality Photos on Mobile Devices with Deep Convolutional Networks , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[21]  Zia-ur Rahman,et al.  Multi-scale retinex for color image enhancement , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[22]  Juan Song,et al.  Enhancement and noise reduction of very low light level images , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).