Dynamic backlight scaling considering ambient luminance for mobile energy saving

The mobile video playback involves many subsystems of the devices such as computing, rendering and displaying subsystems. Among all subsystems, the displaying subsystem accounts for at least 38% of all consumed power, and it can be up to 68% with the maximum backlight brightness. What is more, lots of people watch videos via mobile devices in various situations, where the ambient luminance condition is different. Therefore, how to save mobile energy and improve the Quality of Experience (QoE) in different situations become significant problems. In this paper, we try to maximally enhance the battery power performance under various ambient luminance conditions through backlight magnitude adjusting, while without negatively impacting users' QoE. In particular, we conduct a series of subject quality assessment experiments to uncover the quantitative relationship among QoE, ambient luminance, video content luminance and backlight level. We first study whether the continuous playback of backlight-scaled shots using the proposed scaling magnitude would cause flicker effect or not. Then motivated by the findings of these subject studies, we implement a Dynamic Backlight Scaling (DBS) strategy. The experiment results demonstrate that the DBS strategy can save more than 40% power at most and can also save 10% power even at a very high ambient luminance.

[1]  R. Jain Quality of experience , 2004, IEEE MultiMedia.

[2]  Luca Benini,et al.  HVS-DBS: human visual system-aware dynamic luminance backlight scaling for video streaming applications , 2009, EMSOFT '09.

[3]  Weisi Lin,et al.  A Psychovisual Quality Metric in Free-Energy Principle , 2012, IEEE Transactions on Image Processing.

[4]  Yiran Chen,et al.  How is energy consumed in smartphone display applications? , 2013, HotMobile '13.

[5]  Nikil D. Dutt,et al.  Quality-Based Backlight Optimization for Video Playback on Handheld Devices , 2007, Adv. Multim..

[6]  Youn Jin Kim An automatic image enhancement method adaptive to the surround luminance variation for small sized mobile transmissive LCD , 2010, IEEE Transactions on Consumer Electronics.

[7]  Pi-Cheng Hsiu,et al.  Dynamic backlight scaling optimization for mobile streaming applications , 2011, IEEE/ACM International Symposium on Low Power Electronics and Design.

[8]  Chang Wen Chen,et al.  A study on perception of mobile video with surrounding contextual influences , 2012, 2012 Fourth International Workshop on Quality of Multimedia Experience.

[9]  Guangtao Zhai,et al.  Recent Advances in Image Quality Assessment , 2015 .

[10]  Wei Song,et al.  Acceptability-Based QoE Models for Mobile Video , 2014, IEEE Transactions on Multimedia.

[11]  Jacob Søgaard,et al.  Modeling the Quality of Videos Displayed With Local Dimming Backlight at Different Peak White and Ambient Light Levels , 2016, IEEE Transactions on Image Processing.

[12]  N Bergman,et al.  Fourth International Workshop on Kangaroo Mother Care. , 2003, Journal of tropical pediatrics.

[13]  Samarjit Chakraborty,et al.  Proceedings of the seventh ACM international conference on Embedded software , 2009, EMSOFT 2009.

[14]  A. Murat Tekalp,et al.  Robust color histogram descriptors for video segment retrieval and identification , 2002, IEEE Trans. Image Process..

[15]  Leonidas J. Guibas,et al.  The Earth Mover's Distance as a Metric for Image Retrieval , 2000, International Journal of Computer Vision.

[16]  Gernot Heiser,et al.  An Analysis of Power Consumption in a Smartphone , 2010, USENIX Annual Technical Conference.

[17]  Tong Zhang,et al.  Exploring QoE for Power Efficiency: A Field Study on Mobile Videos with LCD Displays , 2015, ACM Multimedia.

[18]  Jianfei Cai,et al.  Three Dimensional Scalable Video Adaptation via User-End Perceptual Quality Assessment , 2008, IEEE Transactions on Broadcasting.

[19]  Nikil D. Dutt,et al.  Dynamic backlight adaptation for low-power handheld devices , 2004, IEEE Design & Test of Computers.

[20]  Jianfei Cai,et al.  Cross-Dimensional Perceptual Quality Assessment for Low Bit-Rate Videos , 2008, IEEE Transactions on Multimedia.

[21]  Xianming Liu,et al.  Blind quality assessment of compressed images via pseudo structural similarity , 2016, 2016 IEEE International Conference on Multimedia and Expo (ICME).