Modeling the Quality of Videos Displayed With Local Dimming Backlight at Different Peak White and Ambient Light Levels

This paper investigates the impact of ambient light and peak white (maximum brightness of a display) on the perceived quality of videos displayed using local backlight dimming. Two subjective tests providing quality evaluations are presented and analyzed. The analyses of variance show significant interactions of the factors peak white and ambient light with the perceived quality. Therefore, we proceed to predict the subjective quality grades with objective measures. The rendering of the frames on liquid crystal displays with light emitting diodes backlight at various ambient light and peak white levels is computed using a model of the display. Widely used objective quality metrics are applied based on the rendering models of the videos to predict the subjective evaluations. As these predictions are not satisfying, three machine learning methods are applied: partial least square regression, elastic net, and support vector regression. The elastic net method obtains the best prediction accuracy with a spearman rank order correlation coefficient of 0.71, and two features are identified as having a major influence on the visual quality.

[1]  Jari Korhonen,et al.  Modeling the Subjective Quality of Highly Contrasted Videos Displayed on LCD With Local Backlight Dimming , 2015, IEEE Transactions on Image Processing.

[2]  Jinbo Bi,et al.  Dimensionality Reduction via Sparse Support Vector Machines , 2003, J. Mach. Learn. Res..

[3]  Erik Reinhard,et al.  Visual calibration and correction for ambient illumination , 2006, TAP.

[4]  H. Zou,et al.  Regularization and variable selection via the elastic net , 2005 .

[5]  Wolfgang Heidrich,et al.  Video viewing preferences for HDR displays under varying ambient illumination , 2009, APGV '09.

[6]  Jari Korhonen,et al.  Modeling LCD displays with local backlight dimming for image quality assessment , 2011, Electronic Imaging.

[7]  Rasmus Larsen,et al.  SpaSM: A MATLAB Toolbox for Sparse Statistical Modeling , 2018 .

[8]  D. C. Howell.  Statistical methods for psychology, 3rd ed. , 1992 .

[9]  Jacob Søgaard,et al.  Video quality assessment and machine learning: Performance and interpretability , 2015, 2015 Seventh International Workshop on Quality of Multimedia Experience (QoMEX).

[10]  Wolfgang Heidrich,et al.  HDR-VDP-2: a calibrated visual metric for visibility and quality predictions in all luminance conditions , 2011, ACM Trans. Graph..

[11]  Zhou Wang,et al.  Multiscale structural similarity for image quality assessment , 2003, The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, 2003.

[12]  Peter G. J. Barten,et al.  Physical model for the contrast sensitivity of the human eye , 1992, Electronic Imaging.

[13]  Jari Korhonen,et al.  Quality assessment of images displayed on LCD screen with local backlight dimming , 2013, 2013 Fifth International Workshop on Quality of Multimedia Experience (QoMEX).

[14]  Micheal Evanoff,et al.  Optimum ambient lighting conditions for the viewing of softcopy radiological images , 2006, SPIE Medical Imaging.

[15]  Jari Korhonen,et al.  Investigating subjective attributes of quality for videos displayed with local backlight dimming , 2014, 2014 Sixth International Workshop on Quality of Multimedia Experience (QoMEX).

[16]  Wencheng Wu,et al.  The CIEDE2000 color-difference formula: Implementation notes, supplementary test data, and mathematical observations , 2005 .

[17]  Andreas Karrenbauer,et al.  A Clipper-free Algorithm for Efficient HW-Implementation of Local Dimming LED-Backlight , 2008 .

[18]  Weisi Lin,et al.  Visual Quality Assessment by Machine Learning , 2015 .

[19]  Judith Redi,et al.  Supporting visual quality assessment with machine learning , 2013, EURASIP Journal on Image and Video Processing.

[20]  Hans-Peter Seidel,et al.  Dynamic range independent image quality assessment , 2008, ACM Trans. Graph..

[21]  Margaret H. Pinson,et al.  The Consumer Digital Video Library , 2010 .

[22]  Robert S. Allison,et al.  75.3: Is Brighter Always Better? The Effects of Display and Ambient Luminance on Preferences for Digital Signage , 2010 .

[23]  R. Brereton,et al.  Support vector machines for classification and regression. , 2010, The Analyst.

[24]  Tae-Hyeun Ha,et al.  Locally pixel‐compensated backlight dimming on LED‐backlit LCD TV , 2007 .

[25]  Scott Miller,et al.  Perceptual Signal Coding for More Efficient Usage of Bit Codes , 2012 .

[26]  D. C. Howell.  Statistical Methods for Psychology , 1987 .

[27]  Christian Keimel,et al.  No-reference video quality metric for HDTV based on H.264/AVC bitstream features , 2011, 2011 18th IEEE International Conference on Image Processing.

[28]  Jari Korhonen,et al.  Controlling Power Consumption for Displays With Backlight Dimming , 2013, Journal of Display Technology.

[29]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[30]  Methods , metrics and procedures for statistical evaluation , qualification and comparison of objective quality prediction models , 2013 .

[31]  Rahul Vanam,et al.  Adapting objective video quality metrics to ambient lighting , 2015, 2015 Seventh International Workshop on Quality of Multimedia Experience (QoMEX).

[32]  Søren Bech,et al.  Perceptual Audio Evaluation-Theory, Method and Application: Bech/Perceptual Audio Evaluation-Theory, Method and Application , 2006 .

[33]  Patrick Le Callet,et al.  HDR-VQM: An objective quality measure for high dynamic range video , 2015, Signal Process. Image Commun..

[34]  Jari Korhonen,et al.  Subjective quality of videos displayed with local backlight dimming at different peak white and ambient light levels , 2015, 2015 Seventh International Workshop on Quality of Multimedia Experience (QoMEX).

[35]  Jin Zhou,et al.  59.3: Temporal Filtering In LCD Backlight Modulation , 2008 .

[36]  Patrick Le Callet,et al.  Considering Temporal Variations of Spatial Visual Distortions in Video Quality Assessment , 2009, IEEE Journal of Selected Topics in Signal Processing.

[37]  Florian Wickelmaier,et al.  Perceptual Audio Evaluation - Theory, Method and Application , 2006 .

[38]  H de Ridder,et al.  Continuous assessment of perceptual image quality. , 1995, Journal of the Optical Society of America. A, Optics, image science, and vision.

[39]  Hyunsuk Cho,et al.  A color local dimming algorithm for liquid crystals displays using color light emitting diode backlight systems , 2013 .

[40]  Jari Korhonen,et al.  Subjective quality of video sequences rendered on LCD with local backlight dimming at different lighting conditions , 2015, Electronic Imaging.

[41]  Xiaolin Wu,et al.  Modeling Power-Constrained Optimal Backlight Dimming for Color Displays , 2013, Journal of Display Technology.

[42]  Francis Rumsey,et al.  On Some Biases Encountered in Modern Audio Quality Listening Tests-A Review , 2008 .

[43]  Jari Korhonen,et al.  Block-Based Gradient Descent for Local Backlight Dimming and Flicker Reduction , 2014, Journal of Display Technology.

[44]  Touradj Ebrahimi,et al.  Subjective evaluation of higher dynamic range video , 2014, Optics & Photonics - Optical Engineering + Applications.

[45]  Peter Schelkens,et al.  Qualinet White Paper on Definitions of Quality of Experience , 2013 .

[46]  Wolfgang Heidrich,et al.  High dynamic range display systems , 2004, ACM Trans. Graph..

[47]  Hans-Peter Seidel,et al.  Extending quality metrics to full luminance range images , 2008, Electronic Imaging.