Visual Saliency Guided High Dynamic Range Image Compression

Recent years have seen the emergence of the visual saliency-based image and video compression for low dynamic range (LDR) visual content. The high dynamic range (HDR) imaging is yet to follow such an approach for compression as the state-of-the-art visual saliency detection models are mainly concerned with LDR content. Although a few HDR saliency detection models have been proposed in the recent years, they lack the comprehensive validation. Current HDR image compression schemes do not differentiate salient and non-salient regions, which has been proved redundant in terms of the Human Visual System. In this paper, we propose a novel visual saliency guided layered compression scheme for HDR images. The proposed saliency detection model is robust and highly correlates with the ground truth saliency maps obtained from eye tracker. The results show a reduction of bit-rates up to 50% while retaining the same high visual quality in terms of HDR-Visual Difference Predictor (HDR-VDP) and the visual saliency-induced index for perceptual image quality assessment (VSI) metrics in the salient regions.

[1]  Dirk V. Arnold,et al.  Virtual photograph based saliency analysis of high dynamic range images , 2013, CAE '13.

[2]  Frédo Durand,et al.  What Do Different Evaluation Metrics Tell Us About Saliency Models? , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Liming Zhang,et al.  A Novel Multiresolution Spatiotemporal Saliency Detection Model and Its Applications in Image and Video Compression , 2010, IEEE Transactions on Image Processing.

[4]  E. Reinhard Photographic Tone Reproduction for Digital Images , 2002 .

[5]  Wen-Chieh Lin,et al.  Attention-based high dynamic range imaging , 2011, The Visual Computer.

[6]  Touradj Ebrahimi,et al.  Benchmarking of objective quality metrics for HDR image quality assessment , 2015, EURASIP Journal on Image and Video Processing.

[7]  Touradj Ebrahimi,et al.  HDR image compression: A new challenge for objective quality metrics , 2014, 2014 Sixth International Workshop on Quality of Multimedia Experience (QoMEX).

[8]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[9]  F. Pellandini,et al.  Adaptive color image compression based on visual attention , 2001, Proceedings 11th International Conference on Image Analysis and Processing.

[10]  Maryann Simmons,et al.  JPEG-HDR: a backwards-compatible, high dynamic range extension to JPEG , 2005, CIC.

[11]  Touradj Ebrahimi,et al.  JPEG XT: A Compression Standard for HDR and WCG Images [Standards in a Nutshell] , 2016, IEEE Signal Processing Magazine.

[12]  Ivan V. Bajic,et al.  Saliency-Aware Video Compression , 2014, IEEE Transactions on Image Processing.

[13]  Dirk V. Arnold,et al.  Automated parameter tuning for tone mapping using visual saliency , 2015, Comput. Graph..

[14]  Guoliang Fan,et al.  A new JPEG2000 region-of-interest image coding method: partial significant bitplanes shift , 2003, IEEE Signal Processing Letters.

[15]  Erik Reinhard,et al.  Parameter Estimation for Photographic Tone Reproduction , 2002, J. Graphics, GPU, & Game Tools.

[16]  Ali Borji,et al.  State-of-the-Art in Visual Attention Modeling , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Jitendra Malik,et al.  Recovering high dynamic range radiance maps from photographs , 1997, SIGGRAPH.

[18]  Laurent Itti,et al.  Automatic foveation for video compression using a neurobiological model of visual attention , 2004, IEEE Transactions on Image Processing.

[19]  Touradj Ebrahimi,et al.  Visual attention in LDR and HDR images , 2015 .

[20]  Tian Feng,et al.  Mapping-free high dynamic range image compression , 2015, 2015 IEEE 5th International Conference on Consumer Electronics - Berlin (ICCE-Berlin).

[21]  Panos Nasiopoulos,et al.  Evaluating the Performance of Existing Full-Reference Quality Metrics on High Dynamic Range (HDR) Video Content , 2018, 1803.04815.

[22]  Jean-Philippe Tarel,et al.  Saliency Maps of High Dynamic Range Images , 2010, ECCV Workshops.

[23]  Charles E. Hughes,et al.  High-dynamic-range still-image encoding in JPEG 2000 , 2005, IEEE Computer Graphics and Applications.

[24]  Wolfgang Heidrich,et al.  HDR-VDP-2: a calibrated visual metric for visibility and quality predictions in all luminance conditions , 2011, SIGGRAPH 2011.

[25]  Panos Nasiopoulos,et al.  Human Visual System-Based Saliency Detection for High Dynamic Range Content , 2016, IEEE Transactions on Multimedia.

[26]  Hongyu Li,et al.  VSI: A Visual Saliency-Induced Index for Perceptual Image Quality Assessment , 2014, IEEE Transactions on Image Processing.