Noise reduction in high dynamic range images

Multiple images with different exposures are used to produce a high dynamic range (HDR) image. Sometimes high-sensitivity setting is needed for capturing images in low light condition as in an indoor room. However, current digital cameras do not produce a high-quality HDR image when noise occurs in low light condition or high-sensitivity setting. In this paper, we propose a noise reduction method in generating HDR images using a set of low dynamic range (LDR) images with different exposures, where ghost artifacts are effectively removed by image registration and local motion information. In high-sensitivity setting, motion information is used in generating a HDR image. We analyze the characteristics of the proposed method and compare the performance of the proposed and existing HDR image generation methods, in which Reinhard et al.’s global tone mapping method is used for displaying the final HDR images. Experiments with several sets of test LDR images with different exposures show that the proposed method gives better performance than existing methods in terms of visual quality and computation time.

[1]  Erik Reinhard,et al.  High Dynamic Range Imaging: Acquisition, Display, and Image-Based Lighting , 2010 .

[2]  Murat Gevrekci,et al.  On Geometric and Photometric Registration of Images , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[3]  Guang-Zhong Yang,et al.  Structure adaptive anisotropic image filtering , 1996, Image Vis. Comput..

[4]  Thomas W. Parks,et al.  Adaptive principal components and image denoising , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[5]  Masahiro Okuda,et al.  Motion blur free HDR image acquisition using multiple exposures , 2008, 2008 15th IEEE International Conference on Image Processing.

[6]  Greg Ward,et al.  Automatic High-Dynamic Range Image Generation for Dynamic Scenes , 2008, IEEE Computer Graphics and Applications.

[7]  Ralph Arnote,et al.  Hong Kong (China) , 1996, OECD/G20 Base Erosion and Profit Shifting Project.

[8]  Y. Reibel,et al.  CCD or CMOS camera noise characterisation , 2003 .

[9]  P. Lions,et al.  Image recovery via total variation minimization and related problems , 1997 .

[10]  Aleksandra Pizurica,et al.  Wavelet Domain Image Denoising for Non-Stationary Noise and Signal-Dependent Noise , 2006, 2006 International Conference on Image Processing.

[11]  Rae-Hong Park,et al.  Histogram based ghost removal in high dynamic range images , 2009, 2009 IEEE International Conference on Multimedia and Expo.

[12]  ShirleyPeter,et al.  Photographic tone reproduction for digital images , 2002 .

[13]  Erik Reinhard,et al.  Ghost Removal in High Dynamic Range Images , 2006, 2006 International Conference on Image Processing.

[14]  George Wolberg,et al.  Digital image warping , 1990 .

[15]  Eric Warrant,et al.  Motion Dependent Spatiotemporal Smoothing for Noise Reduction in Very Dim Light Image Sequences , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[16]  Martin Vetterli,et al.  Spatially adaptive wavelet thresholding with context modeling for image denoising , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[17]  Antonin Chambolle,et al.  Nonlinear wavelet image processing: variational problems, compression, and noise removal through wavelet shrinkage , 1998, IEEE Trans. Image Process..

[18]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[19]  Susanto Rahardja,et al.  Robust generation of high dynamic range images , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[20]  Andrew Zisserman,et al.  Multiple View Geometry , 1999 .

[21]  ANTONIN CHAMBOLLE,et al.  An Algorithm for Total Variation Minimization and Applications , 2004, Journal of Mathematical Imaging and Vision.

[22]  Anna Tomaszewska,et al.  Image Registration for Multi-exposure High Dynamic Range Image Acquisition , 2007 .

[23]  Jitendra Malik,et al.  Recovering high dynamic range radiance maps from photographs , 1997, SIGGRAPH.

[24]  Erik Reinhard,et al.  High Dynamic Range Imaging: Acquisition, Display, and Image-Based Lighting (The Morgan Kaufmann Series in Computer Graphics) , 2005 .

[25]  Jonathan D. Cohen,et al.  Los Angeles, CA, USA , 2002 .

[26]  Calle Lejdfors,et al.  Adaptive enhancement and noise reduction in very low light-level video , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[27]  Jan Flusser,et al.  Image registration methods: a survey , 2003, Image Vis. Comput..

[28]  Matthijs C. Dorst.  Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[29]  Jean-Michel Morel,et al.  A non-local algorithm for image denoising , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[30]  Thomas W. Parks,et al.  Image denoising using total least squares , 2006, IEEE Transactions on Image Processing.

[31]  Takahiro Saito,et al.  Denoising Via Nonlinear Image Decomposition for a Digital Color Camera , 2007, 2007 IEEE International Conference on Image Processing.

[32]  Shree K. Nayar,et al.  Radiometric self calibration , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[33]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[34]  Greg Ward,et al.  Fast, Robust Image Registration for Compositing High Dynamic Range Photographs from Hand-Held Exposures , 2003, J. Graphics, GPU, & Game Tools.

[35]  Stephen M. Smith,et al.  SUSAN—A New Approach to Low Level Image Processing , 1997, International Journal of Computer Vision.

[36]  E. Reinhard.  Photographic Tone Reproduction for Digital Images , 2002 .

[37]  Erik Reinhard,et al.  Noise reduction in high dynamic range imaging , 2007, J. Vis. Commun. Image Represent..

[38]  Til Aach,et al.  Noise in high dynamic range imaging , 2008, 2008 15th IEEE International Conference on Image Processing.

[39]  Rachid Deriche,et al.  Regularizing Flows for Constrained Matrix-Valued Images , 2004 .

[40]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[41]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).