Real-time image enhancement with efficient dynamic programming

Image enhancement is a problem of fundamental importance in the area of low level image processing. The goal of image enhancement is to significantly improve the visual effects of images or to obtain the fine details that are invisible in degraded images. In this paper, a new accurate image enhancement algorithm is developed to efficiently perform image enhancement with a dynamic programming approach. Specifically, an objective function is developed for the mappings between an original image and its enhanced versions to evaluate the effectiveness of enhancement. The objective function is then optimized by a dynamic programming algorithm to achieve the optimal enhancement effect. It is also shown that the computation efficiency of this dynamic programming algorithm can be significantly improved when certain conditions are satisfied. Testing results show that this new algorithm can efficiently generate images with significantly improved effectiveness of enhancement and is thus potentially useful for real-time applications. An implementation of the algorithm in MATLAB is freely available at the link: https://github.com/yinglei2020/YingleiSong.

[1]  Sos S. Agaian,et al.  Human Visual System-Based Image Enhancement and Logarithmic Contrast Measure , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[2]  Qiming Li,et al.  Low-Light Image Enhancement Based on Deep Symmetric Encoder-Decoder Convolutional Networks , 2020, Symmetry.

[3]  Swapna Devi,et al.  A New Method for Color Image Quality Assessment , 2011 .

[4]  Jonathan T. Barron,et al.  Deep bilateral learning for real-time image enhancement , 2017, ACM Trans. Graph..

[5]  Jack D. Tubbs,et al.  A note on parametric image enhancement , 1987, Pattern Recognit..

[6]  S. Acton,et al.  Image enhancement using a contrast measure in the compressed domain , 2003, IEEE Signal Processing Letters.

[7]  Sangkeun Lee,et al.  Content-based image enhancement in the compressed domain based on multi-scale a-rooting algorithm , 2006 .

[8]  Avadhesh Kumar Dixit,et al.  A Review on Image Contrast Enhancement in Colored images , 2019 .

[9]  Dynamic range compression and contrast enhancement for digital images in the compressed domain , 2006 .

[10]  Pedro J. Sanz,et al.  A Deep Learning Approach for Underwater Image Enhancement , 2017, IWINAC.

[11]  Ai Poh Loh,et al.  Real-time identification of pedestrian meeting and split events from surveillance videos using motion similarity and its applications , 2016, Journal of Real-Time Image Processing.

[12]  In-So Kweon,et al.  Distort-and-Recover: Color Enhancement Using Deep Reinforcement Learning , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[13]  Noriaki Suetake,et al.  Hue-preserving image enhancement in CIELAB color space considering color gamut , 2019, Optical Review.

[14]  SangKeun Lee.  Content-based image enhancement in the compressed domain based on multi-scale alpha-rooting algorithm , 2006, Pattern Recognit. Lett..

[15]  L JayaV.,et al.  IEM: A New Image Enhancement Metric for Contrast and Sharpness Measurements , 2013 .

[16]  Peyman Milanfar,et al.  Learned perceptual image enhancement , 2017, 2018 IEEE International Conference on Computational Photography (ICCP).

[17]  Li Tao,et al.  LLCNN: A convolutional neural network for low-light image enhancement , 2017, 2017 IEEE Visual Communications and Image Processing (VCIP).

[18]  Soumik Sarkar,et al.  LLNet: A deep autoencoder approach to natural low-light image enhancement , 2015, Pattern Recognit..

[19]  Sanjit K. Mitra,et al.  Nonlinear unsharp masking methods for image contrast enhancement , 1996, J. Electronic Imaging.

[20]  David C. C. Wang,et al.  Digital image enhancement: A survey , 1983, Comput. Vis. Graph. Image Process..

[21]  Kiyoharu Aizawa,et al.  Dark and low-contrast image enhancement using dynamic stochastic resonance in discrete cosine transform domain , 2013, APSIPA Transactions on Signal and Information Processing.

[22]  I. M. Bockstein.  Color equalization method and its application to color image processing , 1986 .

[23]  Mohamed Abdel-Nasser,et al.  Ultrasound Image Enhancement Using a Deep Learning Architecture , 2016, AISI.

[24]  Bogdan Orza,et al.  Fuzzy intensification operator based contrast enhancement in the compressed domain , 2009, Appl. Soft Comput..

[25]  A.A. Abdelwahab,et al.  Image Enhancement Using a Contrast measure in the Discrete Wavelet Transform , 2007, 2007 National Radio Science Conference.

[26]  R. Hummel.  Histogram modification techniques , 1975 .

[27]  Bhupendra Gupta,et al.  Color retinal image enhancement using luminosity and quantile based contrast enhancement , 2019, Multidimens. Syst. Signal Process..

[28]  Wei Fang,et al.  An Image Enhancement Method Using the Quantum-Behaved Particle Swarm Optimization with an Adaptive Strategy , 2013 .

[29]  Cristian Munteanu,et al.  Evolutionary image enhancement with user behavior modeling , 2001, SIAP.

[30]  Sung Wook Baik,et al.  Partially shaded sketch-based image search in real mobile device environments via sketch-oriented compact neural codes , 2018, Journal of Real-Time Image Processing.

[31]  Scott Daly,et al.  Digital Images and Human Vision , 1993 .

[32]  Sangkeun Lee,et al.  An Efficient Content-Based Image Enhancement in the Compressed Domain Using Retinex Theory , 2007, IEEE Transactions on Circuits and Systems for Video Technology.