Adaptive enhancement and noise reduction in very low light-level video

A general methodology for noise reduction and contrast enhancement in very noisy image data with low dynamic range is presented. Video footage recorded in very dim light is especially targeted. Smoothing kernels that automatically adapt to the local spatio-temporal intensity structure in the image sequences are constructed in order to preserve and enhance fine spatial detail and prevent motion blur. In color image data, the chromaticity is restored and demosaicing of raw RGB input data is performed simultaneously with the noise reduction. The method is very general, contains few user-defined parameters and has been developed for efficient parallel computation using a GPU. The technique has been applied to image sequences with various degrees of darkness and noise levels, and results from some of these tests, and comparisons to other methods, are presented. The present work has been inspired by research on vision in nocturnal animals, particularly the spatial and temporal visual summation that allows these animals to see in dim light.

[1]  Guang-Zhong Yang,et al.  Structure adaptive anisotropic image filtering , 1996, Image Vis. Comput..

[2]  Akira Taguchi,et al.  Spatio-temporal separable data-dependent weighted average filtering for restoration of the image sequences , 2002, 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[3]  Narendra Ahuja,et al.  Video denoising by combining Kalman and Wiener estimates , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[4]  Richard Szeliski,et al.  High dynamic range video , 2003, ACM Trans. Graph..

[5]  A. A. Sawchuk,et al.  Motion compensated enhancement of noisy image sequences , 1990, International Conference on Acoustics, Speech, and Signal Processing.

[6]  W. Eric L. Grimson,et al.  Adaptive background mixture models for real-time tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[7]  Yasuyuki Matsushita,et al.  An Intensity Similarity Measure in Low-Light Conditions , 2006, ECCV.

[8]  Y. Reibel,et al.  CCD or CMOS camera noise characterisation , 2003 .

[9]  Seong-Won Lee,et al.  Noise-adaptive spatio-temporal filter for real-time noise removal in low light level images , 2005, IEEE Trans. Consumer Electron..

[10]  Bernd Jähne,et al.  Spatio-Temporal Image Processing , 1993, Lecture Notes in Computer Science.

[11]  A. Murat Tekalp,et al.  Adaptive motion-compensated filtering of noisy image sequences , 1993, IEEE Trans. Circuits Syst. Video Technol..

[12]  Leonard McMillan,et al.  Video enhancement using per-pixel virtual exposures , 2005, ACM Trans. Graph..

[13]  Mehmet K. Özkan,et al.  Temporally adaptive filtering of noisy image sequences using a robust motion estimation algorithm , 1991, [Proceedings] ICASSP 91: 1991 International Conference on Acoustics, Speech, and Signal Processing.

[14]  S. Lippman,et al.  The Scripps Institution of Oceanography , 1959, Nature.

[15]  B. Jähne,et al.  Spatiotemporal anisotropic diffusion filtering to improve signal-to-noise ratios and object restoration in fluorescence microscopic image sequences. , 2003, Journal of biomedical optics.

[16]  Jitendra Malik,et al.  Scale-Space and Edge Detection Using Anisotropic Diffusion , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Karol Myszkowski,et al.  Adaptive Logarithmic Mapping For Displaying High Contrast Scenes , 2003, Comput. Graph. Forum.

[18]  Dorin Comaniciu,et al.  A common framework for nonlinear diffusion, adaptive smoothing, bilateral filtering and mean shift , 2004, Image Vis. Comput..

[19]  Joachim Weickert,et al.  Anisotropic diffusion in image processing , 1996 .

[20]  Thomas W. Parks,et al.  Joint demosaicing and denoising , 2006, IEEE Transactions on Image Processing.

[21]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[22]  Eric Warrant,et al.  Motion Dependent Spatiotemporal Smoothing for Noise Reduction in Very Dim Light Image Sequences , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[23]  Joachim Weickert,et al.  Coherence-Enhancing Diffusion Filtering , 1999, International Journal of Computer Vision.

[24]  J. Weickert,et al.  Lucas/Kanade meets Horn/Schunck: combining local and global optic flow methods , 2005 .

[25]  E. Warrant.  Seeing better at night: life style, eye design and the optimum strategy of spatial and temporal summation , 1999, Vision Research.

[26]  John D. Austin,et al.  Adaptive histogram equalization and its variations , 1987 .

[27]  Suk Ho Lee,et al.  Spatio-temporal video filtering algorithm based on 3-D anisotropic diffusion equation , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).