Non-Uniform Deblurring in HDR Image Reconstruction

Hand-held cameras inevitably result in blurred images caused by camera-shake, and even more so in high dynamic range imaging applications where multiple images are captured over a wide range of exposure settings. The degree of blurring depends on many factors such as exposure time, stability of the platform, and user experience. Camera shake involves not only translations but also rotations resulting in nonuniform blurring. In this paper, we develop a method that takes input non-uniformly blurred and differently exposed images to extract the deblurred, latent irradiance image. We use transformation spread function (TSF) to effectively model the blur caused by camera motion. We first estimate the TSFs of the blurred images from locally derived point spread functions by exploiting their linear relationship. The scene irradiance is then estimated by minimizing a suitably derived cost functional. Two important cases are investigated wherein 1) only the higher exposures are blurred and 2) all the captured frames are blurred.

[1]  Subhasis Chaudhuri,et al.  Bilateral Filter Based Compositing for Variable Exposure Photography , 2009, Eurographics.

[2]  A. N. Rajagopalan,et al.  Inferring Image Transformation and Structure from Motion-Blurred Images , 2010, BMVC.

[3]  Sundaresh Ram,et al.  Removing Camera Shake from a Single Photograph , 2009 .

[4]  Dani Lischinski,et al.  Gradient Domain High Dynamic Range Compression , 2023 .

[5]  Yung-Yu Chuang,et al.  High dynamic range image reconstruction from hand-held cameras , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Shree K. Nayar,et al.  Modeling the space of camera response functions , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Shuiwang Ji,et al.  SLEP: Sparse Learning with Efficient Projections , 2011 .

[8]  Andrew Zisserman,et al.  Deblurring shaken and partially saturated images , 2011, ICCV Workshops.

[9]  Ankit Gupta,et al.  Single Image Deblurring Using Motion Density Functions , 2010, ECCV.

[10]  Paramanand Chandramouli,et al.  HDR Imaging under Non-uniform Blurring , 2012, ECCV Workshops.

[11]  Seungyong Lee,et al.  Handling outliers in non-blind image deconvolution , 2011, 2011 International Conference on Computer Vision.

[12]  Alexei A. Efros,et al.  Fast bilateral filtering for the display of high-dynamic-range images , 2002 .

[13]  Ramesh Raskar,et al.  Image fusion for context enhancement and video surrealism , 2004, NPAR '04.

[14]  Frédo Durand,et al.  Understanding Blind Deconvolution Algorithms , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Li Zhang,et al.  Denoising vs. deblurring: HDR imaging techniques using moving cameras , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[16]  Shree K. Nayar,et al.  Determining the Camera Response from Images: What Is Knowable? , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Michael S. Brown,et al.  Richardson-Lucy Deblurring for Scenes under a Projective Motion Path , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Frédo Durand,et al.  Two-scale tone management for photographic look , 2006, ACM Trans. Graph..

[19]  Jiaya Jia,et al.  High-quality motion deblurring from a single image , 2008, ACM Trans. Graph..

[20]  S. Gabarda,et al.  Blind image quality assessment through anisotropy. , 2007, Journal of the Optical Society of America. A, Optics, image science, and vision.

[21]  Jan Flusser,et al.  Multichannel blind iterative image restoration , 2003, IEEE Trans. Image Process..

[22]  Hiroshi Nagahashi,et al.  Cross-Parameterization for Triangular Meshes with Semantic Features , 2007 .

[23]  Jian-Feng Cai,et al.  Framelet-Based Blind Motion Deblurring From a Single Image , 2012, IEEE Transactions on Image Processing.

[24]  Kiriakos N. Kutulakos,et al.  Multiple-Aperture Photography for High Dynamic Range and Post-Capture Refocusing , 2009 .

[25]  Steve Mann,et al.  ON BEING `UNDIGITAL' WITH DIGITAL CAMERAS: EXTENDING DYNAMIC RANGE BY COMBINING DIFFERENTLY EXPOSED PICTURES , 1995 .

[26]  Jitendra Malik,et al.  Recovering high dynamic range radiance maps from photographs , 1997, SIGGRAPH '08.

[27]  Jean Ponce,et al.  Non-uniform Deblurring for Shaken Images , 2012, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[28]  Erik Reinhard,et al.  Photographic tone reproduction for digital images , 2002, ACM Trans. Graph..

[29]  Jan Flusser,et al.  Space-Variant Restoration of Images Degraded by Camera Motion Blur , 2008, IEEE Transactions on Image Processing.

[30]  Jan Kautz,et al.  Exposure Fusion , 2007, 15th Pacific Conference on Computer Graphics and Applications (PG'07).

[31]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[32]  David G. Lowe,et al.  Shape Descriptors for Maximally Stable Extremal Regions , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[33]  Hui Ma,et al.  Image Deblurring with Blurred / Noisy Image Pairs , 2013 .

[34]  Shree K. Nayar,et al.  Radiometric self calibration , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[35]  Greg Ward,et al.  Fast, Robust Image Registration for Compositing High Dynamic Range Photographs from Hand-Held Exposures , 2003, J. Graphics, GPU, & Game Tools.

[36]  Michael S. Brown,et al.  Nonlinear camera response functions and image deblurring , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.