Deep Battery Saver: End-to-End Learning for Power Constrained Contrast Enhancement

Due to the problems of power-hungry displays and limited battery life in electronic devices, the concept of “green computing,” which entails a reduction in power consumption, is proposed. One often seen green computing is the power-constrained contrast enhancement (PCCE), yet it is much more challenging because of the noticeable local intensity suppressions in images. This paper aims at developing an image-quality lossless end-to-end learning network called deep battery saver to achieve power savings in emissive displays, i.e., produce power-saved images with high perceptual quality and less power consumption. Built upon the end-to-end network of the displayed image, we propose a variational loss function for enhancing the visual quality and suppressing the power consumption, simultaneously. The basic idea is to integrate both high-level perceptual losses and low-level pixel losses by a deep residual convolutional neural network (CNN) over a devised variational loss function with strong human perceptual consistency. Such deep residual CNN network leads to a visually pleasing image representation during the suppression of power consumption. Experimental results demonstrated the superiority of our deep battery saver to existing PCCE methods.

[1]  Ke Gu,et al.  Learning a No-Reference Quality Assessment Model of Enhanced Images With Big Data , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[2]  Jae-Jung Yun,et al.  Color Distortion-Aware Error Control for Backlight Dimming , 2015, Journal of Display Technology.

[3]  Homer H. Chen,et al.  JND-based enhancedment of perceptibility for dim images , 2008, 2008 15th IEEE International Conference on Image Processing.

[4]  Shanq-Jang Ruan,et al.  Advanced Multimedia Power-Saving Method Using a Dynamic Pixel Dimmer on AMOLED Displays , 2018, IEEE Transactions on Circuits and Systems for Video Technology.

[5]  Bo-Hao Chen An Illuminance Attenuation Prior to Contrast Enhancement for Vision-Based Advanced Driver Assistance Systems , 2016, BDAW '16.

[6]  Wen Gao,et al.  Guided Image Contrast Enhancement Based on Retrieved Images in Cloud , 2016, IEEE Transactions on Multimedia.

[7]  Lizhuang Ma,et al.  Color transfer in correlated color space , 2006, VRCIA '06.

[8]  Hadi Hadizadeh,et al.  Energy-Efficient Images , 2017, IEEE Transactions on Image Processing.

[9]  Suk-Ju Kang,et al.  Perceptual Quality-Aware Power Reduction Technique for Organic Light Emitting Diodes , 2016, Journal of Display Technology.

[10]  Neeraj Kumar,et al.  Super Resolution by Comprehensively Exploiting Dependencies of Wavelet Coefficients , 2017, IEEE Transactions on Multimedia.

[11]  Jian Yang,et al.  UP-CNN: Un-pooling augmented convolutional neural network , 2017, Pattern Recognit. Lett..

[12]  Vittorio Baroncini,et al.  The polar edge coherence: A quasi blind metric for video quality assessment , 2009, 2009 17th European Signal Processing Conference.

[13]  Fei Zhou,et al.  Consistent Coding Scheme for Single-Image Super-Resolution Via Independent Dictionaries , 2016, IEEE Transactions on Multimedia.

[14]  Pei-Yin Chen,et al.  A Low-Cost Hardware Architecture for Illumination Adjustment in Real-Time Applications , 2015, IEEE Transactions on Intelligent Transportation Systems.

[15]  A.C. Kokaram,et al.  N-dimensional probability density function transfer and its application to color transfer , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[16]  Chih-Chang Lai,et al.  Backlight power reduction and image contrast enhancement using adaptive dimming for global backlight applications , 2008, IEEE Transactions on Consumer Electronics.

[17]  Li Fei-Fei,et al.  Perceptual Losses for Real-Time Style Transfer and Super-Resolution , 2016, ECCV.

[18]  Suk-Ju Kang,et al.  Image-Quality-Based Power Control Technique for Organic Light Emitting Diode Displays , 2015, Journal of Display Technology.

[19]  Suk-Ju Kang Adaptive Weight Allocation-Based Subpixel Rendering Algorithm , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[20]  Yi Lin,et al.  Parameter Estimation of a Gaussian Mixture Model for Wind Power Forecast Error by Riemann L-BFGS Optimization , 2018, IEEE Access.

[21]  Yung-Yu Chuang,et al.  Content-Aware Display Adaptation and Interactive Editing for Stereoscopic Images , 2011, IEEE Transactions on Multimedia.

[22]  Alfio Lombardo,et al.  A Model-Assisted Cross-Layer Design of an Energy-Efficient Mobile Video Cloud , 2014, IEEE Transactions on Multimedia.

[23]  Bo-Hao Chen,et al.  Power-Constrained Image Contrast Enhancement Through Sparse Representation by Joint Mixed-Norm Regularization , 2020, IEEE Transactions on Circuits and Systems for Video Technology.

[24]  Andrea Vedaldi,et al.  Understanding deep image representations by inverting them , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[25]  Soo-Chang Pei,et al.  Color Enhancement With Adaptive Illumination Estimation for Low-Backlighted Displays , 2017, IEEE Transactions on Multimedia.

[26]  Rae-Hong Park,et al.  Color Fringe Correction by the Color Difference Prediction Using the Logistic Function , 2017, IEEE Transactions on Image Processing.

[27]  Bo-Hao Chen,et al.  Power Constrained Contrast Enhancement by Joint L2,1-norm Regularized Sparse Coding for OLED Display , 2018, 2018 IEEE Conference on Multimedia Information Processing and Retrieval (MIPR).

[28]  Chongyu Chen,et al.  Structure-Preserving Image Super-Resolution via Contextualized Multitask Learning , 2017, IEEE Transactions on Multimedia.

[29]  Homer H. Chen,et al.  Image Enhancement for Backlight-Scaled TFT-LCD Displays , 2009, IEEE Transactions on Circuits and Systems for Video Technology.

[30]  Do-Hun Kim,et al.  Preferred skin color reproduction based on adaptive affine transform , 2005, IEEE Transactions on Consumer Electronics.

[31]  Jong Beom Ra,et al.  Contrast-Enhanced Fusion of Multisensor Images Using Subband-Decomposed Multiscale Retinex , 2012, IEEE Transactions on Image Processing.

[32]  O. A. K. Reddy,et al.  Power-Constrained Contrast Enhancement for Emissive Displays Based on Histogram Equalization , 2013 .

[33]  Byung Cheol Song,et al.  Power-Constrained Contrast Enhancement Algorithm Using Multiscale Retinex for OLED Display , 2014, IEEE Transactions on Image Processing.

[34]  Xiaolin Wu,et al.  Generalized Equalization Model for Image Enhancement , 2014, IEEE Transactions on Multimedia.

[35]  Rongrong Ji,et al.  Image Quality Assessment for Color Correction Based on Color Contrast Similarity and Color Value Difference , 2018, IEEE Transactions on Circuits and Systems for Video Technology.

[36]  Luc Van Gool,et al.  DSLR-Quality Photos on Mobile Devices with Deep Convolutional Networks , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[37]  Eric Dubois,et al.  Image up-sampling using total-variation regularization with a new observation model , 2005, IEEE Transactions on Image Processing.

[38]  Peter Schelkens,et al.  Spatio-Temporally Consistent Color and Structure Optimization for Multiview Video Color Correction , 2015, IEEE Transactions on Multimedia.

[39]  Raanan Fattal,et al.  Edge-avoiding wavelets and their applications , 2009, ACM Trans. Graph..

[40]  Guangming Shi,et al.  Enhanced Just Noticeable Difference Model for Images With Pattern Complexity , 2017, IEEE Transactions on Image Processing.

[41]  Ying Li,et al.  Highly Accurate Image Reconstruction for Multimodal Noise Suppression Using Semisupervised Learning on Big Data , 2018, IEEE Transactions on Multimedia.