Optimizing tone mapping operators for keypoint detection under illumination changes

Tone mapping operators (TMO) have recently raised interest for their capability to handle illumination changes. However, these TMOs are optimized with respect to perception rather than image analysis tasks like key point detection. Moreover, no work has been done to analyze the factors affecting the optimization of TMOs for such tasks. In this paper, we investigate the influence of two factors-Correlation Coefficient (CC) and Repeatability Rate (RR) of the tone mapped images for the optimization of classical Retinex based models to enhance key point detection under illumination changes. CC-based optimized models aim at increasing the similarity of the tone mapped images. Conversely, RR-based optimized models quantify the optimal detection performance gains. By considering two simple Retinex based models, i.e., Gaussian and bilateral filtering, we show that estimating as precisely as possible the illumination, CC-based optimized models do not necessarily bring to optimal key point detection performance. We conclude that, instead, other criteria specific to RR-based optimized models should be taken into account. Moreover, large gains in performance with respect to existing popular TMOs motivate further research towards optimal tone mapping technique for computer vision applications.

[1]  Pavel Zemcík,et al.  Feature point detection under extreme lighting conditions , 2013, SCCG.

[2]  K. Hohn,et al.  Determining Lightness from an Image , 2004 .

[3]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[4]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[5]  Cordelia Schmid,et al.  Evaluation of Interest Point Detectors , 2000, International Journal of Computer Vision.

[6]  Patrick Le Callet,et al.  High Dynamic Range Video - From Acquisition, to Display and Applications , 2016 .

[7]  Erik Reinhard,et al.  Photographic tone reproduction for digital images , 2002, ACM Trans. Graph..

[8]  Wilhelm Burger,et al.  Digital Image Processing - An Algorithmic Introduction using Java , 2008, Texts in Computer Science.

[9]  Touradj Ebrahimi,et al.  Evaluation of privacy in high dynamic range video sequences , 2014, Optics & Photonics - Optical Engineering + Applications.

[10]  Christopher Hunt,et al.  Notes on the OpenSURF Library , 2009 .

[11]  Nabil Aouf,et al.  HDR imaging for feature tracking in challenging visibility scenes , 2014, Kybernetes.

[12]  Touradj Ebrahimi,et al.  Impact of Tone-mapping Algorithms on Subjective and Objective Face Recognition in HDR Images , 2015, CrowdMM@ACM Multimedia.

[13]  Karol Myszkowski,et al.  Adaptive Logarithmic Mapping For Displaying High Contrast Scenes , 2003, Comput. Graph. Forum.

[14]  Zia-ur Rahman,et al.  Properties and performance of a center/surround retinex , 1997, IEEE Trans. Image Process..

[15]  Alexei A. Efros,et al.  Fast bilateral filtering for the display of high-dynamic-range images , 2002 .

[16]  Cordelia Schmid,et al.  A performance evaluation of local descriptors , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Giuseppe Valenzise,et al.  Evaluation of Feature Detection in HDR Based Imaging Under Changes in Illumination Conditions , 2015, 2015 IEEE International Symposium on Multimedia (ISM).

[18]  Hans-Peter Seidel,et al.  A perceptual framework for contrast processing of high dynamic range images , 2006, TAP.

[19]  Kenneth Chiu,et al.  Spatially Nonuniform Scaling Functions for High Contrast Images , 1993 .

[20]  Pavel Zemcík,et al.  Evaluation of feature point detection in high dynamic range imagery , 2016, J. Vis. Commun. Image Represent..