RetinexGAN:Unsupervised Low-Light Enhancement With Two-Layer Convolutional Decomposition Networks

In the field of image enhancement, using deep learning methods to enhance low-light images is currently mainstream. However, the methods often have complex network structures of a large number of parameters, and their training often uses paired data-sets, which are difficult to obtain in actual practice. To solve these problems, this paper proposes a simple generative adversarial network and Retinex model, dubbed RetinexGAN, that is completely trained using unpaired data-sets. It contains a decomposition network and two discriminator networks. To reduce the parameters of the network, only two convolution layers are used in the decomposition network. We show more challenging testing data where some parts of the image are underexposed and others are normal light. Both quantitative and visual results show that RetinexGAN is largely superior to state-of-the-art methods.

[1]  J. Zico Kolter,et al.  Gradient descent GAN optimization is locally stable , 2017, NIPS.

[2]  Chi-Wing Fu,et al.  Underexposed Photo Enhancement Using Deep Illumination Estimation , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Chul Lee,et al.  Contrast enhancement based on layered difference representation , 2012, 2012 19th IEEE International Conference on Image Processing.

[4]  Wei Huang,et al.  Low Light Image Enhancement Network With Attention Mechanism and Retinex Model , 2020, IEEE Access.

[5]  Junping Du,et al.  Low-Light Image Enhancement via a Deep Hybrid Network , 2019, IEEE Transactions on Image Processing.

[6]  Chin-Chuan Han,et al.  Adaptive Multiscale Retinex for Image Contrast Enhancement , 2013, 2013 International Conference on Signal-Image Technology & Internet-Based Systems.

[7]  Jonathan T. Barron,et al.  Deep bilateral learning for real-time image enhancement , 2017, ACM Trans. Graph..

[8]  Yu Zhang,et al.  Self-supervised Image Enhancement Network: Training with Low Light Images Only , 2020, ArXiv.

[9]  Zia-ur Rahman,et al.  Properties and performance of a center/surround retinex , 1997, IEEE Trans. Image Process..

[10]  Yong Xu,et al.  Recurrent Exposure Generation for Low-Light Face Detection , 2020, IEEE Transactions on Multimedia.

[11]  Ding Liu,et al.  EnlightenGAN: Deep Light Enhancement Without Paired Supervision , 2019, IEEE Transactions on Image Processing.

[12]  Wen Gao,et al.  A Bio-Inspired Multi-Exposure Fusion Framework for Low-light Image Enhancement , 2017, ArXiv.

[13]  Yung-Yu Chuang,et al.  Deep Photo Enhancer: Unpaired Learning for Image Enhancement from Photographs with GANs , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[14]  Chen Wei,et al.  Deep Retinex Decomposition for Low-Light Enhancement , 2018, BMVC.

[15]  Sebastian Nowozin,et al.  The Numerics of GANs , 2017, NIPS.

[16]  Xiao-Ping Zhang,et al.  A Weighted Variational Model for Simultaneous Reflectance and Illumination Estimation , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Zhiwu Li,et al.  Group consensus via pinning control for a class of heterogeneous multi-agent systems with input constraints , 2021, Inf. Sci..

[18]  Kuldeep Singh,et al.  Contrast enhancement via texture region based histogram equalization , 2016 .

[19]  Rob Fergus,et al.  Visualizing and Understanding Convolutional Networks , 2013, ECCV.

[20]  Soumik Sarkar,et al.  LLNet: A deep autoencoder approach to natural low-light image enhancement , 2015, Pattern Recognit..

[21]  Léon Bottou,et al.  Wasserstein GAN , 2017, ArXiv.

[22]  Zia-ur Rahman,et al.  A multiscale retinex for bridging the gap between color images and the human observation of scenes , 1997, IEEE Trans. Image Process..

[23]  Om Prakash Verma,et al.  Contrast enhancement using entropy-based dynamic sub-histogram equalisation , 2016, IET Image Process..

[24]  Wencheng Wang,et al.  Adaptive image enhancement method for correcting low-illumination images , 2019, Inf. Sci..

[25]  Raymond Y. K. Lau,et al.  Least Squares Generative Adversarial Networks , 2016, 2017 IEEE International Conference on Computer Vision (ICCV).

[26]  Shikha Purwar,et al.  Image contrast enhancement using unsharp masking and histogram equalization , 2018, Multimedia Tools and Applications.

[27]  Zairui Gao,et al.  An Experiment-Based Review of Low-Light Image Enhancement Methods , 2020, IEEE Access.

[28]  Sam Kwong,et al.  Zero-Reference Deep Curve Estimation for Low-Light Image Enhancement , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[29]  Tao Lu,et al.  Low-light image enhancement using CNN and bright channel prior , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[30]  Jie Ma,et al.  MSR-net: Low-light Image Enhancement Using Deep Convolutional Network , 2017, ArXiv.

[31]  Li Tao,et al.  LLCNN: A convolutional neural network for low-light image enhancement , 2017, 2017 IEEE Visual Communications and Image Processing (VCIP).

[32]  Xiaojie Guo,et al.  Kindling the Darkness: A Practical Low-light Image Enhancer , 2019, ACM Multimedia.

[33]  Naiqi Wu,et al.  Homomorphic Encryption of Supervisory Control Systems Using Automata , 2020, IEEE Access.

[34]  Christian Ledig,et al.  Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[35]  Yu Li,et al.  Attention Guided Low-Light Image Enhancement with a Large Scale Low-Light Simulation Dataset , 2019, Int. J. Comput. Vis..

[36]  Jianhua Wu,et al.  MBLLEN: Low-Light Image/Video Enhancement Using CNNs , 2018, BMVC.

[37]  Yue Wang,et al.  From Fidelity to Perceptual Quality: A Semi-Supervised Approach for Low-Light Image Enhancement , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[38]  Jian Yang,et al.  DSFD: Dual Shot Face Detector , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[39]  拓海 杉山,et al.  “Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks”の学習報告 , 2017 .

[40]  Ronggang Wang,et al.  A New Low-Light Image Enhancement Algorithm Using Camera Response Model , 2017, 2017 IEEE International Conference on Computer Vision Workshops (ICCVW).

[41]  Hai-Miao Hu,et al.  Naturalness Preserved Enhancement Algorithm for Non-Uniform Illumination Images , 2013, IEEE Transactions on Image Processing.

[42]  Yu Li,et al.  LIME: Low-Light Image Enhancement via Illumination Map Estimation , 2017, IEEE Transactions on Image Processing.

[43]  Alexei A. Efros,et al.  Image-to-Image Translation with Conditional Adversarial Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[44]  Zhenhua Yu,et al.  A Pareto-based genetic algorithm for multi-objective scheduling of automated manufacturing systems , 2020 .