A survey on HDR visualization on mobile devices

There is a vast body of literature concerning the capture, storing, transmission and display of High Dynamic Range (HDR) imaging. Nevertheless, there are few works that try to address the problem of getting HDR on mobile devices. Their hardware limitations, such as processing power, storage space, graphics capabilities and screen characteristics, transform that problem in a big challenge. However, since more and more HDR content is being produced and given that in a few years it can become a standard, it is necessary to provide the means to visualize HDR images and video on mobile devices. The main goal of this paper is to present a survey on HDR visualization approaches and techniques developed specifically for mobile devices. To understand what are the main challenges that need to be addressed in order to visualize HDR on mobile devices, an overview of their main characteristics is given. The very low dynamic range of most of mobile devices' displays implies that a tone mapping operator (TMO) must be applied in order to visualize the HDR content. The current status of the research on TMO will be presented and analyzed, a special attention will be given to the ones that were developed taking in account the limited characteristics of the mobile devices' displays. Another important issue is visualization quality assessment, meaning visualize HDR content without losing the main characteristics of the original HDR content. Thus, evaluation studies of HDR content visualization on mobile devices will be presented and their results analyzed.

[1]  Mark D. Fairchild,et al.  iCAM06: A refined image appearance model for HDR image rendering , 2007, J. Vis. Commun. Image Represent..

[2]  Greg Ward,et al.  A Contrast-Based Scalefactor for Luminance Display , 1994, Graphics Gems.

[3]  James A. Ferwerda,et al.  Elements of Early Vision for Computer Graphics (Tutorial) , 2001, IEEE Computer Graphics and Applications.

[4]  Donald P. Greenberg,et al.  Time-dependent visual adaptation for fast realistic image display , 2000, SIGGRAPH.

[5]  Erik Reinhard,et al.  Ieee Transactions on Visualization and Computer Graphics 1 Dynamic Range Reduction Inspired by Photoreceptor Physiology , 2022 .

[6]  Miloslaw Smyk,et al.  HDR Photographic Pipeline for Camera Modules in Mobile Devices , 2011, Eurographics.

[7]  Luca Chittaro,et al.  Visualizing information on mobile devices , 2006, Computer.

[8]  Karol Myszkowski,et al.  Adaptive Logarithmic Mapping For Displaying High Contrast Scenes , 2003, Comput. Graph. Forum.

[9]  Hans-Peter Seidel,et al.  Lightness Perception in Tone Reproduction for High Dynamic Range Images , 2005, Comput. Graph. Forum.

[10]  Hans-Peter Seidel,et al.  Perceptual evaluation of tone mapping operators with real-world scenes , 2005, IS&T/SPIE Electronic Imaging.

[11]  Jan Kautz,et al.  Exposure Fusion , 2007, 15th Pacific Conference on Computer Graphics and Applications (PG'07).

[12]  Zhou Wang,et al.  Structural Fidelity vs. Naturalness - Objective Assessment of Tone Mapped Images , 2011, ICIAR.

[13]  Donald P. Greenberg,et al.  A model of visual adaptation for realistic image synthesis , 1996, SIGGRAPH.

[14]  Michael Wimmer,et al.  Image Attributes and Quality for Evaluation of Tone Mapping Operators , 2006 .

[15]  Michael Wimmer,et al.  Evaluation of HDR tone mapping methods using essential perceptual attributes , 2008, Comput. Graph..

[16]  J. H. van Hateren,et al.  Encoding of high dynamic range video with a model of human cones , 2006, TOGS.

[17]  Edward H. Adelson,et al.  Compressing and companding high dynamic range images with subband architectures , 2005, SIGGRAPH 2005.

[18]  Zia-ur Rahman,et al.  Multi-scale retinex for color image enhancement , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[19]  Hans-Peter Seidel,et al.  Predicting visible differences in high dynamic range images: model and its calibration , 2005, IS&T/SPIE Electronic Imaging.

[20]  Hans-Peter Seidel,et al.  Dynamic range independent image quality assessment , 2008, ACM Trans. Graph..

[21]  Sumanta N. Pattanaik,et al.  Adaptive gain control for high dynamic range image display , 2002, SCCG '02.

[22]  Tomas Akenine-Möller,et al.  The State of the Art in Mobile Graphics Research , 2008, IEEE Computer Graphics and Applications.

[23]  Zhou Wang,et al.  Objective assessment of tone mapping algorithms , 2010, 2010 IEEE International Conference on Image Processing.

[24]  E. Reinhard Photographic Tone Reproduction for Digital Images , 2002 .

[25]  Mark D. Fairchild,et al.  Meet iCAM: A Next-Generation Color Appearance Model , 2002, Color Imaging Conference.

[26]  Rafal Mantiuk,et al.  Display adaptive tone mapping , 2008, SIGGRAPH 2008.

[27]  Luiz Velho,et al.  Towards Mobile HDR Video , 2011, Eurographics.

[28]  Alan Chalmers,et al.  Evaluation of tone mapping operators using a High Dynamic Range display , 2005, ACM Trans. Graph..

[29]  Michael Ashikhmin,et al.  A reality check for tone-mapping operators , 2006, TAP.

[30]  Kenneth Chiu,et al.  Spatially Nonuniform Scaling Functions for High Contrast Images , 1993 .

[31]  Kate Devlin,et al.  A review of tone reproduction techniques , 2002 .

[32]  Donald P. Greenberg,et al.  A multiscale model of adaptation and spatial vision for realistic image display , 1998, SIGGRAPH.

[33]  Hiroshi Yamaguchi,et al.  Evaluating HDR rendering algorithms , 2007, TAP.

[34]  Hans-Peter Seidel,et al.  Perceptual evaluation of tone mapping operators , 2003, SIGGRAPH '03.

[35]  Laurence Meylan,et al.  High dynamic range image rendering with a retinex-based adaptive filter , 2006, IEEE Transactions on Image Processing.

[36]  A. Bovik,et al.  A universal image quality index , 2002, IEEE Signal Processing Letters.

[37]  Hans-Peter Seidel,et al.  Beyond Tone Mapping: Enhanced Depiction of Tone Mapped HDR Images , 2006, Comput. Graph. Forum.

[38]  Michael Ashikhmin,et al.  A Tone Mapping Algorithm for High Contrast Images , 2002, Rendering Techniques.

[39]  Alan Chalmers,et al.  Tone Mapping Operators on Small Screen Devices: An Evaluation Study , 2010, Comput. Graph. Forum.

[40]  Erik Reinhard,et al.  High Dynamic Range Imaging: Acquisition, Display, and Image-Based Lighting , 2010 .

[41]  Greg Turk,et al.  LCIS: a boundary hierarchy for detail-preserving contrast reduction , 1999, SIGGRAPH.

[42]  Sumanta N. Pattanaik,et al.  Segmentation and adaptive assimilation for detail-preserving display of high-dynamic range images , 2003, The Visual Computer.

[43]  Greg Ward,et al.  High dynamic range imaging , 2004, SIGGRAPH '04.

[44]  Dani Lischinski,et al.  Gradient Domain High Dynamic Range Compression , 2023 .

[45]  Christophe Schlick,et al.  Quantization Techniques for Visualization of High Dynamic Range Pictures , 1995 .

[46]  Christine D. Piatko,et al.  A visibility matching tone reproduction operator for high dynamic range scenes , 1997, SIGGRAPH '97.

[47]  Fan Wu,et al.  Dynamic correction of color appearance on mobile displays , 2008, Graphics Interface.

[48]  Alexei A. Efros,et al.  Fast bilateral filtering for the display of high-dynamic-range images , 2002 .

[49]  Radu Ciprian Bilcu,et al.  High dynamic range imaging on mobile devices , 2008, 2008 15th IEEE International Conference on Electronics, Circuits and Systems.

[50]  Holly E. Rushmeier,et al.  Tone reproduction for realistic images , 1993, IEEE Computer Graphics and Applications.

[51]  B. Wandell Foundations of vision , 1995 .

[52]  Kwontaeg Choi,et al.  Realtime training on mobile devices for face recognition applications , 2011, Pattern Recognit..