HVS-Aware Dynamic Backlight Scaling in TFT-LCDs

Liquid crystal displays (LCDs) have appeared in applications ranging from medical equipment to automobiles, gas pumps, laptops, and handheld portable computers. These display components present a cascaded energy attenuator to the battery of the handheld device which is responsible for about half of the energy drain at maximum display intensity. As such, the display components become the main focus of every effort for maximization of embedded system's battery lifetime. This paper proposes an approach for pixel transformation of the displayed image to increase the potential energy saving of the backlight scaling method. The proposed approach takes advantage of human visual system (HVS) characteristics and tries to minimize distortion between the perceived brightness values of the individual pixels in the original image and those of the backlight-scaled image. This is in contrast to previous backlight scaling approaches which simply match the luminance values of the individual pixels in the original and backlight-scaled images. Furthermore, this paper proposes a temporally-aware backlight scaling technique for video streams. The goal is to maximize energy saving in the display system by means of dynamic backlight dimming subject to a video distortion tolerance. The video distortion comprises of: 1) an intra-frame (spatial) distortion component due to frame-sensitive backlight scaling and transmittance function tuning and 2) an inter-frame (temporal) distortion component due to large-step backlight dimming across frames modulated by the psychophysical characteristics of the human visual system. The proposed backlight scaling technique is capable of efficiently computing the flickering effect online and subsequently using a measure of the temporal distortion to appropriately adjust the slack on the intra-frame spatial distortion, thereby, achieving a good balance between the two sources of distortion while maximizing the backlight dimming-driven energy saving in the display system and meeting an overall video quality figure of merit. The proposed dynamic backlight scaling approach is amenable to highly efficient hardware realization and has been implemented on the Apollo Testbed II. Actual current measurements demonstrate the effectiveness of proposed technique compared to the previous backlight dimming techniques, which have ignored the temporal distortion effect

[1]  Ian Ashdown,et al.  Radiosity: A Programmer's Perspective , 1994 .

[2]  G M Shickman.  Visual masking by low-frequency sinusoidally modulated light. , 1970, Journal of the Optical Society of America.

[3]  Michael Ashikhmin,et al.  A Tone Mapping Algorithm for High Contrast Images , 2002, Rendering Techniques.

[4]  Donald P. Greenberg,et al.  A multiscale model of adaptation and spatial vision for realistic image display , 1998, SIGGRAPH.

[5]  Massoud Pedram,et al.  HEBS: histogram equalization for backlight scaling , 2005, Design, Automation and Test in Europe.

[6]  Wei-Chung Cheng,et al.  Transmittance Scaling for Reducing Power Dissipation of a Backlit TFT-LCD , 2004, Ultra Low-Power Electronics and Design.

[7]  Luca Benini,et al.  Event-driven power management , 2001, IEEE Trans. Comput. Aided Des. Integr. Circuits Syst..

[8]  Alexei A. Efros,et al.  Fast bilateral filtering for the display of high-dynamic-range images , 2002 .

[9]  Massoud Pedram,et al.  DTM: dynamic tone mapping for backlight scaling , 2005, Proceedings. 42nd Design Automation Conference, 2005..

[10]  Holly E. Rushmeier,et al.  Tone reproduction for realistic images , 1993, IEEE Computer Graphics and Applications.

[11]  D. Hood,et al.  Lower-level visual processing and models of light adaptation. , 1998, Annual review of psychology.

[12]  Naehyuck Chang,et al.  DLS: dynamic backlight luminance scaling of liquid crystal display , 2004, IEEE Transactions on Very Large Scale Integration (VLSI) Systems.

[13]  Donald C. Hood,et al.  Modeling the dynamics of light adaptation: the merging of two traditions , 1992, Vision Research.

[14]  N. Graham,et al.  Testing a computational model of light-adaptation dynamics , 1995, Vision Research.

[15]  B. Achiriloaie,et al.  VI REFERENCES , 1961 .

[16]  Vasily G. Moshnyaga,et al.  LCD display energy reduction by user monitoring , 2005, 2005 International Conference on Computer Design.

[17]  A. Bovik,et al.  A universal image quality index , 2002, IEEE Signal Processing Letters.

[18]  B. H. Crawford.  Visual adaptation in relation to brief conditioning stimuli , 1947, Proceedings of the Royal Society of London. Series A. Mathematical and Physical Sciences.

[19]  Luca Benini,et al.  Low Power Control Techniques For TFT LCD Displays , 2002, CASES '02.

[20]  S. S. Stevens,et al.  Brightness function: effects of adaptation. , 1963, Journal of the Optical Society of America.

[21]  Kenneth Chiu,et al.  Spatially Nonuniform Scaling Functions for High Contrast Images , 1993 .

[22]  Patrick C. Teo,et al.  Perceptual image distortion , 1994, Electronic Imaging.

[23]  Christine D. Piatko,et al.  A visibility matching tone reproduction operator for high dynamic range scenes , 1997 .

[24]  Wei-Chung Cheng,et al.  Chromatic encoding: a low power encoding technique for digital visual interface , 2004, IEEE Transactions on Consumer Electronics.

[25]  Wei-Chung Cheng,et al.  Power minimization in a backlit TFT-LCD display by concurrent brightness and contrast scaling , 2004, IEEE Transactions on Consumer Electronics.

[26]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[27]  Donald P. Greenberg,et al.  A model of visual adaptation for realistic image synthesis , 1996, SIGGRAPH.

[28]  H. R. Blackwell,et al.  Contrast Threshold of the Human eye , 1946 .

[29]  Enrico Macii,et al.  Limited intra-word transition codes: an energy-efficient bus encoding for LCD display interfaces , 2004, Proceedings of the 2004 International Symposium on Low Power Electronics and Design (IEEE Cat. No.04TH8758).

[30]  Hitoshi Aoki,et al.  Dynamic characterization of a-Si TFT-LCD pixels , 1996 .

[31]  Greg Ward,et al.  A Contrast-Based Scalefactor for Luminance Display , 1994, Graphics Gems.

[32]  Jack Tumblin,et al.  The Trilateral Filter for High Contrast Images and Meshes , 2003, Rendering Techniques.