Evaluation of Feature Detection in HDR Based Imaging Under Changes in Illumination Conditions

High dynamic range (HDR) imaging enables to capture details in both dark and very bright regions of a scene, and is therefore supposed to provide higher robustness to illumination changes than conventional low dynamic range (LDR) imaging in tasks such as visual features extraction. However, it is not clear how much this gain is, and which are the best modalities of using HDR to obtain it. In this paper we evaluate the first block of the visual feature extraction pipeline, i.e., keypoint detection, using both LDR and different HDR-based modalities, when significant illumination changes are present in the scene. To this end, we captured a dataset with two scenes and a wide range of illumination conditions. On these images, we measure how the repeatability of either corner or blob interest points is affected with different LDR/HDR approaches. Our observations confirm the potential of HDR over conventional LDR acquisition. Moreover, extracting features directly from HDR pixel values is more effective than first tonemapping and then extracting features, provided that HDR luminance information is previously encoded to perceptually linear values.

[1]  Masahiro Okuda,et al.  An optimal video-surveillance approach for HDR videos tone mapping , 2011, 2011 19th European Signal Processing Conference.

[2]  Manish Narwaria,et al.  Tone mapping-based high-dynamic-range image compression: study of optimization criterion and perceptual quality , 2013 .

[3]  Nabil Aouf,et al.  HDR imaging for feature tracking in challenging visibility scenes , 2014, Kybernetes.

[4]  N. Aouf,et al.  Enhanced feature detection and matching under extreme illumination conditions with a HDR imaging sensor , 2013, 2012 IEEE 11th International Conference on Cybernetic Intelligent Systems (CIS).

[5]  Pavel Zemcík,et al.  Feature point detection under extreme lighting conditions , 2013, SCCG.

[6]  Christophe Schlick An Adaptive Sampling Technique for Multidimensional Integration by Ray-Tracing , 1994 .

[7]  Erik Reinhard,et al.  Color appearance in high-dynamic-range imaging , 2006, J. Electronic Imaging.

[8]  Hans-Peter Seidel,et al.  A perceptual framework for contrast processing of high dynamic range images , 2006, TAP.

[9]  Michael Ashikhmin,et al.  A Tone Mapping Algorithm for High Contrast Images , 2002, Rendering Techniques.

[10]  Didier Stricker,et al.  Robust Point Matching in HDRI through Estimation of Illumination Distribution , 2011, DAGM-Symposium.

[11]  Dani Lischinski,et al.  Gradient Domain High Dynamic Range Compression , 2023 .

[12]  Cordelia Schmid,et al.  Evaluation of Interest Point Detectors , 2000, International Journal of Computer Vision.

[13]  Luc Van Gool,et al.  SURF: Speeded Up Robust Features , 2006, ECCV.

[14]  Michael Wimmer,et al.  Evaluation of HDR tone mapping methods using essential perceptual attributes , 2008, Comput. Graph..

[15]  Hans-Peter Seidel,et al.  Extending quality metrics to full luminance range images , 2008, Electronic Imaging.

[16]  Touradj Ebrahimi,et al.  Evaluation of privacy in high dynamic range video sequences , 2014, Optics & Photonics - Optical Engineering + Applications.

[17]  Karol Myszkowski,et al.  Adaptive Logarithmic Mapping For Displaying High Contrast Scenes , 2003, Comput. Graph. Forum.

[18]  E. Reinhard Photographic Tone Reproduction for Digital Images , 2002 .

[19]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[20]  Anastasios Doulamis,et al.  Hdr Imaging for Feature Detection on Detailed Architectural Scenes , 2015 .

[21]  Christine D. Piatko,et al.  A visibility matching tone reproduction operator for high dynamic range scenes , 1997 .

[22]  Sumanta N. Pattanaik,et al.  Adaptive gain control for high dynamic range image display , 2002, SCCG '02.

[23]  Jitendra Malik,et al.  Recovering high dynamic range radiance maps from photographs , 1997, SIGGRAPH.

[24]  Alan Chalmers,et al.  Evaluation of tone mapping operators using a High Dynamic Range display , 2005, ACM Trans. Graph..

[25]  Kenneth Chiu,et al.  Spatially Nonuniform Scaling Functions for High Contrast Images , 1993 .