Evaluation of the effectiveness of HDR tone-mapping operators for photogrammetric applications

The ability of High Dynamic Range (HDR) imaging to capture the full range of lighting in a scene has meant that it is being increasingly used for Cultural Heritage (CH) applications. Photogrammetric techniques allow the semi-automatic production of 3D models from a sequence of images. Current photogrammetric methods are not always effective in reconstructing images under harsh lighting conditions, as significant geometric details may not have been captured accurately within under- and over-exposed regions of the image. HDR imaging offers the possibility to overcome this limitation, however the HDR images need to be tone mapped before they can be used within existing photogrammetric algorithms. In this paper we evaluate four different HDR tone-mapping operators (TMOs) that have been used to convert raw HDR images into a format suitable for state-of-the-art algorithms, and in particular keypoint detection techniques. The evaluation criteria used are the number of keypoints, the number of valid matches achieved and the repeatability rate. The comparison considers two local and two global TMOs. HDR data from four CH sites were used: Kaisariani Monastery (Greece), Asinou Church (Cyprus), Château des Baux (France) and Buonconsiglio Castle (Italy).

[1]  Pascal Mueller,et al.  Rome Reborn 2.0: A Case Study of Virtual City Reconstruction Using Procedural Modeling Techniques , 2009 .

[2]  Pavel Zemcík,et al.  Feature point detection under extreme lighting conditions , 2013, SCCG.

[3]  S. M. Steve SUSAN - a new approach to low level image processing , 1997 .

[4]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[5]  Jitendra Malik,et al.  Recovering high dynamic range radiance maps from photographs , 1997, SIGGRAPH.

[6]  E. Reinhard Photographic Tone Reproduction for Digital Images , 2002 .

[7]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[8]  Luc Van Gool,et al.  SURF: Speeded Up Robust Features , 2006, ECCV.

[9]  Dani Lischinski,et al.  Gradient Domain High Dynamic Range Compression , 2023 .

[10]  Cordelia Schmid,et al.  Evaluation of Interest Point Detectors , 2000, International Journal of Computer Vision.

[11]  Andreas Georgopoulos,et al.  Investigation on the Use of HDR Images for Cultural Heritage Documentation , 2014 .

[12]  Kurt Debattista,et al.  Advanced High Dynamic Range Imaging: Theory and Practice , 2011 .

[13]  Klaus D. McDonald-Maier,et al.  Improved repeatability measures for evaluating performance of feature detectors , 2015, ArXiv.

[14]  David G. Lowe,et al.  Fast Approximate Nearest Neighbors with Automatic Algorithm Configuration , 2009, VISAPP.

[15]  David Wheatley,et al.  High Dynamic Range Imaging for Archaeological Recording , 2011 .

[16]  Anastasios Doulamis,et al.  Hdr Imaging for Feature Detection on Detailed Architectural Scenes , 2015 .

[17]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[18]  Kurt Debattista,et al.  High-dynamic-range video solution , 2009, SIGGRAPH ASIA '09.

[19]  Gabriele Guidi,et al.  Image pre-processing for optimizing automated photogrammetry performances , 2014 .

[20]  Tom Drummond,et al.  Machine Learning for High-Speed Corner Detection , 2006, ECCV.

[21]  ShirleyPeter,et al.  Photographic tone reproduction for digital images , 2002 .

[22]  Alan Chalmers,et al.  Evaluation of tone mapping operators using a High Dynamic Range display , 2005, ACM Trans. Graph..

[23]  Hans-Peter Seidel,et al.  High dynamic range imaging pipeline: perception-motivated representation of visual content , 2007, Electronic Imaging.

[24]  Rafal Mantiuk,et al.  Display adaptive tone mapping , 2008, SIGGRAPH 2008.

[25]  Pavel Zemcík,et al.  Evaluation of feature point detection in high dynamic range imagery , 2016, J. Vis. Commun. Image Represent..

[26]  FattalRaanan,et al.  Gradient domain high dynamic range compression , 2002 .

[27]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .