Exploring QoE for Power Efficiency: A Field Study on Mobile Videos with LCD Displays

Display power consumption has become a major concern for both mobile users and design engineers, especially considering the prevalence of today's video-rich mobile services. The power consumption of liquid crystal display (LCD), a dominant mobile display technology, can be reduced by dynamic backlight scaling (DBS). However, such dynamic changes of screen brightness may degrade users' quality of experience (QoE) in viewing videos. How would QoE be impacted by different DBS strategies has not yet been understood clearly and thus obscures the way to achieve systematic power saving. In this paper, we take a first step to explore the QoE of DBS on smartphones and aim at maximally enhancing the display power performance without negatively impacting users' QoE. In particular, we conduct three motivational studies to uncover the inherent relationship between QoE and backlight scaling frequency, magnitude, and temporal consistency, respectively. Motivated by the findings of these studies, we design a suite of techniques to implement a comprehensive DBS strategy. We demonstrate an example application of the proposed DBS designs in a mobile video streaming system. Measurements and user evaluations show that more than 40% system power reduction, or equivalently, 20% more power savings than the non-QoE approaches, can be achieved without QoE impairment.

[1]  Alan Hanjalic,et al.  Shot-boundary detection: unraveled and resolved? , 2002, IEEE Trans. Circuits Syst. Video Technol..

[2]  Weisi Lin,et al.  Perceptual visual quality metrics: A survey , 2011, J. Vis. Commun. Image Represent..

[3]  Wei-Chung Cheng,et al.  Power minimization in a backlit TFT-LCD display by concurrent brightness and contrast scaling , 2004, IEEE Transactions on Consumer Electronics.

[4]  Nikil D. Dutt,et al.  Dynamic backlight adaptation for low-power handheld devices , 2004, IEEE Design & Test of Computers.

[5]  Srinivasan Seshan,et al.  Modeling web quality-of-experience on cellular networks , 2014, MobiCom.

[6]  Ivan Himawan,et al.  Acceptability-based QoE Management for User-centric Mobile Video Delivery: A Field Study Evaluation , 2014, ACM Multimedia.

[7]  Christian Timmerer,et al.  Automated QoE evaluation of Dynamic Adaptive Streaming over HTTP , 2013, 2013 Fifth International Workshop on Quality of Multimedia Experience (QoMEX).

[8]  Luca Benini,et al.  HVS-DBS: human visual system-aware dynamic luminance backlight scaling for video streaming applications , 2009, EMSOFT '09.

[9]  Wei Song,et al.  Saving bitrate vs. pleasing users: where is the break-even point in mobile video quality? , 2011, MM '11.

[10]  Chang Wen Chen,et al.  QoE continuum driven HTTP adaptive streaming over multi-client wireless networks , 2014, 2014 IEEE International Conference on Multimedia and Expo (ICME).

[11]  Fan Zhang,et al.  Additive Log-Logistic Model for Networked Video Quality Assessment , 2013, IEEE Transactions on Image Processing.

[12]  Rainer Lienhart,et al.  Comparison of automatic shot boundary detection algorithms , 1998, Electronic Imaging.

[13]  Wei Song,et al.  Acceptability-Based QoE Models for Mobile Video , 2014, IEEE Transactions on Multimedia.

[14]  Massoud Pedram,et al.  HVS-Aware Dynamic Backlight Scaling in TFT-LCDs , 2006, IEEE Transactions on Very Large Scale Integration (VLSI) Systems.

[15]  Massoud Pedram,et al.  HEBS: histogram equalization for backlight scaling , 2005, Design, Automation and Test in Europe.

[16]  Ralf Steinmetz,et al.  Subjective impression of variations in layer encoded videos , 2003, IWQoS'03.

[17]  Lin Zhong,et al.  Power Modeling and Optimization for OLED Displays , 2012, IEEE Transactions on Mobile Computing.

[18]  Xin Li,et al.  Content-adaptive display power saving in internet mobile streaming , 2015, NOSSDAV.

[19]  M. Angela Sasse,et al.  Can small be beautiful?: assessing image resolution requirements for mobile TV , 2005, MULTIMEDIA '05.

[20]  Naehyuck Chang,et al.  DLS: dynamic backlight luminance scaling of liquid crystal display , 2004, IEEE Transactions on Very Large Scale Integration (VLSI) Systems.

[21]  Srinivasan Seshan,et al.  Developing a predictive model of quality of experience for internet video , 2013, SIGCOMM.

[22]  Ragnhild Eg,et al.  Flicker effects in adaptive video streaming to handheld devices , 2011, ACM Multimedia.

[23]  A. Murat Tekalp,et al.  Robust color histogram descriptors for video segment retrieval and identification , 2002, IEEE Trans. Image Process..

[24]  Leonidas J. Guibas,et al.  The Earth Mover's Distance as a Metric for Image Retrieval , 2000, International Journal of Computer Vision.

[25]  Gernot Heiser,et al.  An Analysis of Power Consumption in a Smartphone , 2010, USENIX Annual Technical Conference.

[26]  Ronald Christensen,et al.  Log-Linear Models and Logistic Regression , 1997 .

[27]  Nikil D. Dutt,et al.  Quality-Based Backlight Optimization for Video Playback on Handheld Devices , 2007, Adv. Multim..

[28]  Pi-Cheng Hsiu,et al.  Dynamic Backlight Scaling Optimization: A Cloud-Based Energy-Saving Service for Mobile Streaming Applications , 2014, IEEE Transactions on Computers.