Virtual photograph based saliency analysis of high dynamic range images

Computational visual attention systems detect regions of interest in images. These systems have a broad range of applications in areas such as computer vision, computational aesthetics, and non-photorealistic rendering. However, almost all the systems to date are designed for low dynamic range (LDR) images and may not be suitable for analyzing saliency in high dynamic range (HDR) images. We propose a novel algorithm for saliency analysis of HDR images that is based on virtual photographs. Taking virtual photographs is the inverse process of generating HDR images from multiple LDR exposures, and the virtual photograph sequence has the capacity to more comprehensively reveal salient content in HDR images. We demonstrate that our method can produce more consistently reliable results than existing methods.

[1]  C. Koch,et al.  A saliency-based search mechanism for overt and covert shifts of visual attention , 2000, Vision Research.

[2]  T. Duckett,et al.  VOCUS : A Visual Attention System for Object Detection and Goal-directed Search , 2010 .

[3]  Xiaogang Jin,et al.  Real-time image-based chinese ink painting rendering , 2012, Multimedia Tools and Applications.

[4]  Christian Richardt Flash-exposure high dynamic range imaging: virtual photography and depth-compensating flash , 2008 .

[5]  Ariel Shamir,et al.  Seam Carving for Content-Aware Image Resizing , 2007, ACM Trans. Graph..

[6]  Jitendra Malik,et al.  Recovering high dynamic range radiance maps from photographs , 1997, SIGGRAPH.

[7]  Laurent Itti,et al.  Automatic foveation for video compression using a neurobiological model of visual attention , 2004, IEEE Transactions on Image Processing.

[8]  Tomaso A. Poggio,et al.  Example-Based Object Detection in Images by Components , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[10]  Manish Narwaria,et al.  Effect of tone mapping operators on visual attention deployment , 2012, Other Conferences.

[11]  Kyunghyun Yoon,et al.  A multi-level depiction method for painterly rendering based on visual perception cue , 2012, Multimedia Tools and Applications.

[12]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[13]  Wen-Chieh Lin,et al.  Attention-based high dynamic range imaging , 2011, The Visual Computer.

[14]  O. Sorkine,et al.  Optimized scale-and-stretch for image resizing , 2008, SIGGRAPH 2008.

[15]  Christof Koch,et al.  Modeling attention to salient proto-objects , 2006, Neural Networks.

[16]  Jean-Philippe Tarel,et al.  Saliency Maps of High Dynamic Range Images , 2010, ECCV Workshops.

[17]  S Ullman,et al.  Shifts in selective visual attention: towards the underlying neural circuitry. , 1985, Human neurobiology.

[18]  Steve Mann,et al.  ON BEING `UNDIGITAL' WITH DIGITAL CAMERAS: EXTENDING DYNAMIC RANGE BY COMBINING DIFFERENTLY EXPOSED PICTURES , 1995 .

[19]  Ramesh Raskar,et al.  Removing photography artifacts using gradient projection and flash-exposure sampling , 2005, SIGGRAPH 2005.

[20]  E. Reinhard Photographic Tone Reproduction for Digital Images , 2002 .

[21]  S. Avidan,et al.  Seam carving for content-aware image resizing , 2007, SIGGRAPH 2007.

[22]  Henrik I. Christensen,et al.  Computational visual attention systems and their cognitive foundations: A survey , 2010, TAP.

[23]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.