Luminance regionalization-based saliency detection for high dynamic range image

The existing saliency detection methods are not suitable for high dynamic range (HDR) images. In this work, based on human visual system, we propose a new method for detecting the saliency of HDR images via luminance regionalization. First, considering the visual characteristics of a wider luminance range of HDR images, luminance information of the HDR image is extracted, and the HDR image is divided into high, medium, and low luminance regions by luminance thresholding. Then, saliency map of each luminance region is detected, respectively. Color and texture features are extracted for the high luminance region, luminance and texture features are extracted for the low luminance region, and an existing LDR image saliency detection method is used for the medium luminance region. Finally, the three saliency maps are linearly fused to obtain the final HDR image saliency map. Experimental results on two public databases (EPFL HDR eye tracking database and TMID database) demonstrate that the proposed method performs well when against the five state-of-the-art methods in terms of detecting the salient regions of HDR images.

[1]  Touradj Ebrahimi,et al.  High Dynamic Range Imaging Technology [Lecture Notes] , 2017, IEEE Signal Processing Magazine.

[2]  Hans-Peter Seidel,et al.  Predicting visible differences in high dynamic range images: model and its calibration , 2005, IS&T/SPIE Electronic Imaging.

[3]  Hans-Peter Seidel,et al.  Lossy compression of high dynamic range images and video , 2006, Electronic Imaging.

[4]  Touradj Ebrahimi,et al.  JPEG XT: A Compression Standard for HDR and WCG Images [Standards in a Nutshell] , 2016, IEEE Signal Processing Magazine.

[5]  Jean-Philippe Tarel,et al.  Saliency Maps of High Dynamic Range Images , 2010, ECCV Workshops.

[6]  S. Süsstrunk,et al.  Frequency-tuned salient region detection , 2009, CVPR 2009.

[7]  Zhou Wang,et al.  Objective Quality Assessment of Tone-Mapped Images , 2013, IEEE Transactions on Image Processing.

[8]  Huchuan Lu,et al.  Saliency Detection via Graph-Based Manifold Ranking , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Shi-Min Hu,et al.  Global contrast based salient region detection , 2011, CVPR 2011.

[10]  Panos Nasiopoulos,et al.  Human Visual System-Based Saliency Detection for High Dynamic Range Content , 2016, IEEE Transactions on Multimedia.

[11]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[12]  Laurence Meylan,et al.  High dynamic range image rendering with a retinex-based adaptive filter , 2006, IEEE Transactions on Image Processing.

[13]  Touradj Ebrahimi,et al.  Visual attention in LDR and HDR images , 2015 .

[14]  C. Koch,et al.  A saliency-based search mechanism for overt and covert shifts of visual attention , 2000, Vision Research.

[15]  Liqing Zhang,et al.  Saliency Detection: A Spectral Residual Approach , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[16]  Min H. Kim,et al.  Modeling human color perception under extended luminance levels , 2009, ACM Trans. Graph..

[17]  Huchuan Lu,et al.  Amulet: Aggregating Multi-level Convolutional Features for Salient Object Detection , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).