Contrast Enhancement and Image Completion: A CNN Based Model to Restore Ill Exposed Images

Digital cameras work through transforming the scene’s radiance into an electrical charge. Optical arrangement, sensors, and embedded electronics often limit the accuracy of the representation. Scenes with a dynamic range above the capability of the camera or poor lighting are challenging conditions, which usually result in low contrast images. Soft clipping is usually compensated by transforming the power and shifting the image’s histogram. However, under extreme conditions, ill exposure results in severe clipping that requires interpolation and painting. We introduce a model of convolutional neural network to perform signal reconstruction and interpolation. It is designed to be used on sRGB images. The results are evaluated using several metrics of image quality that indicate that the proposed network can improve images that are damaged by different conditions of exposure. In addition, our method offers a substantial gain over state-of-the-art methods.

[1]  Jia Xu,et al.  Fast Image Processing with Fully-Convolutional Networks , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[2]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[3]  Lei Zhang,et al.  Learning a Deep Single Image Contrast Enhancer from Multi-Exposure Images , 2018, IEEE Transactions on Image Processing.

[4]  Jean-Michel Morel,et al.  Multiscale Retinex , 2014, Image Process. Line.

[5]  Lei Zhang,et al.  Gradient Magnitude Similarity Deviation: A Highly Efficient Perceptual Image Quality Index , 2013, IEEE Transactions on Image Processing.

[6]  David Zhang,et al.  FSIM: A Feature Similarity Index for Image Quality Assessment , 2011, IEEE Transactions on Image Processing.

[7]  Samuel W. Hasinoff,et al.  Saturation (Imaging) , 2014, Computer Vision, A Reference Guide.

[8]  Xiao-Ping Zhang,et al.  A Probabilistic Method for Image Enhancement With Simultaneous Illumination and Reflectance Estimation , 2015, IEEE Transactions on Image Processing.

[9]  Cristiano Steffens,et al.  Deep Learning Based Exposure Correction for Image Exposure Correction with Application in Computer Vision for Robotics , 2018, 2018 Latin American Robotic Symposium, 2018 Brazilian Symposium on Robotics (SBR) and 2018 Workshop on Robotics in Education (WRE).

[10]  Sepp Hochreiter,et al.  Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs) , 2015, ICLR.

[11]  Haidi Ibrahim,et al.  Brightness Preserving Dynamic Histogram Equalization for Image Contrast Enhancement , 2007, IEEE Transactions on Consumer Electronics.

[12]  Sylvain Paris,et al.  Learning photographic global tonal adjustment with a database of input / output image pairs , 2011, CVPR 2011.

[13]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[14]  Chin-Chuan Han,et al.  Adaptive Multiscale Retinex for Image Contrast Enhancement , 2013, 2013 International Conference on Signal-Image Technology & Internet-Based Systems.

[15]  Chang-Su Kim,et al.  Robust contrast enhancement of noisy low-light images: Denoising-enhancement-completion , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[16]  Vincent Dumoulin,et al.  Deconvolution and Checkerboard Artifacts , 2016 .

[17]  Gordon Wetzstein,et al.  Sensor saturation in Fourier multiplexed imaging , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[18]  Jiangtao Wen,et al.  Fast efficient algorithm for enhancement of low lighting video , 2010, 2011 IEEE International Conference on Multimedia and Expo.

[19]  Jia Xu,et al.  Learning to See in the Dark , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[20]  Vladlen Koltun,et al.  Multi-Scale Context Aggregation by Dilated Convolutions , 2015, ICLR.

[21]  Jan Kautz,et al.  Exposure Fusion , 2007, 15th Pacific Conference on Computer Graphics and Applications (PG'07).

[22]  Vittorio Baroncini,et al.  The polar edge coherence: A quasi blind metric for video quality assessment , 2009, 2009 17th European Signal Processing Conference.

[23]  Ronggang Wang,et al.  A New Image Contrast Enhancement Algorithm Using Exposure Fusion Framework , 2017, CAIP.

[24]  Yoshua Bengio,et al.  Understanding the difficulty of training deep feedforward neural networks , 2010, AISTATS.

[25]  Ronggang Wang,et al.  A New Low-Light Image Enhancement Algorithm Using Camera Response Model , 2017, 2017 IEEE International Conference on Computer Vision Workshops (ICCVW).

[26]  Alexei A. Efros,et al.  Image-to-Image Translation with Conditional Adversarial Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[27]  M. Ali Akber Dewan,et al.  A Dynamic Histogram Equalization for Image Contrast Enhancement , 2007, IEEE Transactions on Consumer Electronics.