Evaluation of HDR video tone mapping for mobile devices

Tone mapping operators (TMOs) allow the visual appearance of High Dynamic Range (HDR) video to be reproduced on Low Dynamic Range (LDR) displays. While several studies have been made to compare the performance of different TMOs on standard displays, there is only one preliminary study that takes into account the characteristics of Small Screen Devices (SSDs) which are common on mobile platforms that are growing rapidly in popularity. Due to the unique characteristics of mobile devices, the variety of viewing conditions where they are used, and the fact that they are becoming so widespread, it is important to identify what is the best method to deliver HDR video content to these devices. This paper presents an evaluation of HDR video on mobile devices using an HDR display as reference. Six state-of-the-art HDR video tone mappers are evaluated by conducting a psychophysical experiment where participants were asked to rank the tone mappers applied to different HDR video footage. A comparison was made between tone mapped HDR video footage shown on a tablet and an LCD display compared with the same HDR video footage shown simultaneously on an HDR display. This study shows there is a subtle but statistically significant difference in the preference of TMOs between SSD and LDR even though the overall ordering of TMOs is the same across both displays.

[1]  Kenneth Chiu,et al.  Spatially Nonuniform Scaling Functions for High Contrast Images , 1993 .

[2]  Rafal Mantiuk,et al.  Display adaptive tone mapping , 2008, ACM Trans. Graph..

[3]  Christophe Schlick,et al.  Quantization Techniques for Visualization of High Dynamic Range Pictures , 1995 .

[4]  Erik Reinhard,et al.  Photographic tone reproduction for digital images , 2002, ACM Trans. Graph..

[5]  Alain Trémeau,et al.  Computational Color Imaging , 2015, Lecture Notes in Computer Science.

[6]  Hiroshi Yamaguchi,et al.  Evaluating HDR rendering algorithms , 2007, TAP.

[7]  Erik Reinhard,et al.  Do HDR displays support LDR content?: a psychophysical evaluation , 2007, ACM Trans. Graph..

[8]  H. Seidel,et al.  Perceptual Evaluation of Tone Mapping Operators with Regard to Similarity and Preference , 2002 .

[9]  Michael Ashikhmin,et al.  A Tone Mapping Algorithm for High Contrast Images , 2002, Rendering Techniques.

[10]  Alan Chalmers,et al.  Tone Mapping Operators on Small Screen Devices: An Evaluation Study , 2010, Comput. Graph. Forum.

[11]  Alan Chalmers,et al.  Evaluation of tone mapping operators using a High Dynamic Range display , 2005, ACM Trans. Graph..

[12]  Jean-Philippe Tarel,et al.  Vision models for image quality assessment: one is not enough , 2010, J. Electronic Imaging.

[13]  Bill Tomlinson,et al.  Media richness, interactivity and retargeting to mobile devices: a survey , 2011, Int. J. Arts Technol..

[14]  Hans-Peter Seidel,et al.  Perceptual evaluation of tone mapping operators with real-world scenes , 2005, IS&T/SPIE Electronic Imaging.

[15]  Michael Wimmer,et al.  Evaluation of HDR tone mapping methods using essential perceptual attributes , 2008, Comput. Graph..

[16]  Hans-Peter Seidel,et al.  Predicting visible differences in high dynamic range images: model and its calibration , 2005, IS&T/SPIE Electronic Imaging.

[17]  Donald P. Greenberg,et al.  A model of visual adaptation for realistic image synthesis , 1996, SIGGRAPH.

[18]  Patrick Le Callet,et al.  Spatio-temporal Tone Mapping Operator Based on a Retina Model , 2009, CCIW.

[19]  Adrien Gruson,et al.  Temporal coherency for video tone mapping , 2012, Other Conferences.

[20]  Donald P. Greenberg,et al.  A multiscale model of adaptation and spatial vision for realistic image display , 1998, SIGGRAPH.

[21]  Kurt Debattista,et al.  Advanced High Dynamic Range Imaging: Theory and Practice , 2011 .

[22]  Roland Brémond,et al.  Evaluation of tone mapping operators in night-time virtual worlds , 2012, Virtual Reality.

[23]  Robert Wanat,et al.  Evaluation of Tone Mapping Operators for HDR-Video , 2013, Comput. Graph. Forum.

[24]  Holly E. Rushmeier,et al.  Tone reproduction for realistic images , 1993, IEEE Computer Graphics and Applications.

[25]  Scott Daly,et al.  Digital Images and Human Vision , 1993 .

[26]  Christine D. Piatko,et al.  A visibility matching tone reproduction operator for high dynamic range scenes , 1997, SIGGRAPH '97.

[27]  Laurence Meylan,et al.  Model of retinal local adaptation for the tone mapping of color filter array images. , 2007, Journal of the Optical Society of America. A, Optics, image science, and vision.

[28]  Donald P. Greenberg,et al.  Time-dependent visual adaptation for fast realistic image display , 2000, SIGGRAPH.

[29]  Hans-Peter Seidel,et al.  Visible difference predicator for high dynamic range images , 2004, 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583).

[30]  Kurt Debattista,et al.  High-dynamic-range video solution , 2009, SIGGRAPH ASIA '09.

[31]  J. H. van Hateren,et al.  Encoding of high dynamic range video with a model of human cones , 2006, TOGS.

[32]  Charles Hansen,et al.  Adaptive temporal tone mapping , 2004 .