Tone Mapping HDR Panoramas for Viewing in Head Mounted Displays

Head-mounted displays enable a user to view a complete environment as if he/she was there; providing an immersive experience. However, the lighting in a full environment can vary significantly. Panoramic images captured with conventional, Low Dynamic Range (LDR), imaging of scenes with a large range of lighting conditions, can include areas of under- or over-exposed pixels. High Dynamic Range (HDR) imaging, on the other hand, is able to capture the full range of detail in a scene. However, HMDs are not currently HDR and thus the HDR panorama needs to be tone mapped before it can be displayed on the LDR HMD. While a large number of tone mapping operators have been proposed in the last 25 years, these were not designed for panoramic images, or for use with HMDs. This paper undertakes a two part subjective study to investigate which of the current, state-of-the-art tone mappers is most suitable for use with HMDs

[1]  Donald P. Greenberg,et al.  A model of visual adaptation for realistic image synthesis , 1996, SIGGRAPH.

[2]  Kurt Debattista,et al.  Evaluation of HDR video tone mapping for mobile devices , 2014, Signal Process. Image Commun..

[3]  Kurt Debattista,et al.  Advanced High Dynamic Range Imaging , 2017 .

[4]  Touradj Ebrahimi,et al.  Measuring quality of omnidirectional high dynamic range content , 2017, Optical Engineering + Applications.

[5]  Yuan Li,et al.  View Dependent Tone Mapping of HDR Panoramas for Head Mounted Displays , 2016, ICAT-EGVE.

[6]  H. Seidel,et al.  Perceptual Evaluation of Tone Mapping Operators with Regard to Similarity and Preference , 2002 .

[7]  Henry Been-Lirn Duh,et al.  Effects of field of view on presence, enjoyment, memory, and simulator sickness in a virtual environment , 2002, Proceedings IEEE Virtual Reality 2002.

[8]  Hans-Peter Seidel,et al.  Visible difference predicator for high dynamic range images , 2004, 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583).

[9]  Rafal Mantiuk,et al.  Display adaptive tone mapping , 2008, SIGGRAPH 2008.

[10]  Robert Wanat,et al.  Evaluation of Tone Mapping Operators for HDR‐Video , 2013, SIGGRAPH '13.

[11]  Wolfgang Heidrich,et al.  HDR-VDP-2: a calibrated visual metric for visibility and quality predictions in all luminance conditions , 2011, SIGGRAPH 2011.

[12]  Hans-Peter Seidel,et al.  A perceptual framework for contrast processing of high dynamic range images , 2006, TAP.

[13]  Scott J. Daly,et al.  Visible differences predictor: an algorithm for the assessment of image fidelity , 1992, Electronic Imaging.

[14]  Wijnand A. IJsselsteijn,et al.  Presence: concept, determinants, and measurement , 2000, Electronic Imaging.

[15]  Wijnand A. IJsselsteijn,et al.  Effects of Stereoscopic Presentation, Image Motion, and Screen Size on Subjective and Objective Corroborative Measures of Presence , 2001, Presence: Teleoperators & Virtual Environments.

[16]  Hans-Peter Seidel,et al.  Video quality assessment for computer graphics applications , 2010, ACM Trans. Graph..

[17]  Kurt Debattista,et al.  Evaluation of Tone‐Mapping Operators for HDR Video Under Different Ambient Luminance Levels , 2015, Comput. Graph. Forum.

[18]  Donald P. Greenberg,et al.  Time-dependent visual adaptation for fast realistic image display , 2000, SIGGRAPH.

[19]  Rosa María Baños,et al.  Presence and Emotions in Virtual Environments: The Influence of Stereoscopy , 2008, Cyberpsychology Behav. Soc. Netw..

[20]  Kenneth Chiu,et al.  Spatially Nonuniform Scaling Functions for High Contrast Images , 1993 .

[21]  Alan Chalmers,et al.  Evaluation of tone mapping operators using a High Dynamic Range display , 2005, ACM Trans. Graph..

[22]  Adrien Gruson,et al.  Temporal coherency for video tone mapping , 2012, Other Conferences.

[23]  Hiroshi Yamaguchi,et al.  Evaluating HDR rendering algorithms , 2007, TAP.

[24]  Matt C. Yu,et al.  Dynamic Tone Mapping with Head-Mounted Displays , 2015 .

[25]  Patrick Le Callet,et al.  HDR-VQM: An objective quality measure for high dynamic range video , 2015, Signal Process. Image Commun..

[26]  Hans-Peter Seidel,et al.  Perceptual evaluation of tone mapping operators with real-world scenes , 2005, IS&T/SPIE Electronic Imaging.

[27]  Michael Wimmer,et al.  Evaluation of HDR tone mapping methods using essential perceptual attributes , 2008, Comput. Graph..

[28]  Bobby Bodenheimer,et al.  A comparison of two cost-differentiated virtual reality systems for perception and action tasks , 2014, SAP.

[29]  E. Reinhard.  Photographic Tone Reproduction for Digital Images , 2002 .

[30]  Jan Kautz,et al.  Exposure Fusion , 2009, 15th Pacific Conference on Computer Graphics and Applications (PG'07).

[31]  Dominique Thoreau,et al.  Zonal brightness coherency for video tone mapping , 2014, Signal Process. Image Commun..