Recovery limits in pointwise degradation

Pointwise image formation models appear in a variety of computational vision and photography problems. Prior studies aim to recover visibility or reflectance under the effects of specular or indirect reflections, additive scattering, radiance attenuation in haze and flash, etc. This work considers bounds to recovery from pointwise degradation. The analysis uses a physical model for the acquired signal and noise, and also accounts for potential post-acquisition noise filtering. Linear-systems analysis yields an effective cutoff-frequency, which is induced by noise, despite having no optical blur in the imaging model. We apply this analysis to hazy images. The result is a tool that assesses the ability to recover (within a desirable success rate) an object or feature having a certain size, distance from the camera, and radiance difference from its nearby background, per attenuation coefficient of the medium. The bounds rely on the camera specifications. The theory considers the pointwise degradation that exists in the scene during acquisition, which fundamentally limits recovery, even if the parameters of an algorithm are perfectly set.

[1]  M. Unser,et al.  A new resolution criterion based on spectral signal-to-noise ratios. , 1987, Ultramicroscopy.

[2]  Glenn Healey,et al.  Radiometric CCD camera calibration and noise estimation , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  J C Leachtenauer,et al.  General Image-Quality Equation: GIQE. , 1997, Applied optics.

[4]  Norman S. Kopeika,et al.  A System Engineering Approach to Imaging , 1998 .

[5]  H Farid,et al.  Separating reflections from images by use of independent component analysis. , 1999, Journal of the Optical Society of America. A, Optics, image science, and vision.

[6]  Shigeo Abe DrEng Pattern Classification , 2001, Springer London.

[7]  Shree K. Nayar,et al.  All the Images of an Outdoor Scene , 2002, ECCV.

[8]  Yoav Y Schechner,et al.  Polarization-based vision through haze. , 2008, Applied optics.

[9]  Richard Szeliski,et al.  Digital photography with flash and no-flash image pairs , 2004, ACM Trans. Graph..

[10]  Marc Levoy,et al.  Synthetic aperture confocal imaging , 2004, SIGGRAPH 2004.

[11]  Shree K. Nayar,et al.  Separation of Reflection Components Using Color and Polarization , 1997, International Journal of Computer Vision.

[12]  Michael F. Cohen,et al.  Digital photography with flash and no-flash image pairs , 2004, ACM Trans. Graph..

[13]  Andrew Gardner,et al.  Performance relighting and reflectance transformation with time-multiplexed illumination , 2005, SIGGRAPH 2005.

[14]  Andrew Gardner,et al.  Performance relighting and reflectance transformation with time-multiplexed illumination , 2005, ACM Trans. Graph..

[15]  Kiriakos N. Kutulakos,et al.  A theory of inverse light transport , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[16]  Ramesh Raskar,et al.  Removing photography artifacts using gradient projection and flash-exposure sampling , 2005, SIGGRAPH 2005.

[17]  Jean-Michel Morel,et al.  A Review of Image Denoising Algorithms, with a New One , 2005, Multiscale Model. Simul..

[18]  Yasuyuki Matsushita,et al.  An Intensity Similarity Measure in Low-Light Conditions , 2006, ECCV.

[19]  Ramesh Raskar,et al.  Fast separation of direct and global components of a scene using high frequency illumination , 2006, ACM Trans. Graph..

[20]  Michael Elad,et al.  Image Denoising Via Sparse and Redundant Representations Over Learned Dictionaries , 2006, IEEE Transactions on Image Processing.

[21]  Yehoshua Y. Zeevi,et al.  Variational Distance-Dependent Image Restoration , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[22]  Stephen Lin,et al.  Radiometric Calibration from Noise Distributions , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[23]  Shree K. Nayar,et al.  Multiplexing for Optimal Lighting , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Shree K. Nayar,et al.  Dirty Glass: Rendering Contamination on Transparent Surfaces , 2007, Rendering Techniques.

[25]  Yoav Y. Schechner,et al.  Regularized Image Recovery in Scattering Media , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Yoav Y Schechner,et al.  Image-based prediction of imaging and vision performance. , 2007, Journal of the Optical Society of America. A, Optics, image science, and vision.

[27]  Katsushi Ikeuchi,et al.  Estimating Radiometric Response Functions from Image Noise Variance , 2008, ECCV.

[28]  Robby T. Tan,et al.  Visibility in bad weather from a single image , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[29]  Richard Szeliski,et al.  Automatic Estimation and Removal of Noise from a Single Image , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Raanan Fattal,et al.  Single image dehazing , 2008, ACM Trans. Graph..

[31]  Dani Lischinski,et al.  Deep photo: model-based photograph enhancement and viewing , 2008, SIGGRAPH 2008.

[32]  Yoav Y. Schechner,et al.  Active Polarization Descattering , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  Y. Schechner,et al.  Geometry by deflaring , 2009, 2009 IEEE International Conference on Computational Photography (ICCP).