A novel approach for denoising and enhancement of extremely low-light video

In this paper, a novel approach for noise reduction and enhancement of extremely low-light video is proposed. For noise removal, a motion adaptive temporal filtering based on a Kalman structured updating is presented. Dynamic range of denoised video is increased by adjustment of RGB histograms using Gamma correction with adaptive clipping thresholds. Finally, residual noise is removed using a nonlocal means (NLM) denoising filter. The proposed method works directly on the color filter array (CFA) raw video for achieving low memory consumption1.

[1]  Patrick Bouthemy,et al.  Space-Time Adaptation for Patch-Based Image Sequence Restoration , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Michael S. Brown,et al.  Globally Optimized Linear Windowed Tone Mapping , 2010, IEEE Transactions on Visualization and Computer Graphics.

[3]  David R. Bull,et al.  Automatic contrast enhancement of low-light images based on local statistics of wavelet coefficients , 2010, 2010 IEEE International Conference on Image Processing.

[4]  D. L. Donoho,et al.  Ideal spacial adaptation via wavelet shrinkage , 1994 .

[5]  Zhihai Xu,et al.  Image noise removal using Kalman-Filter on dark frame , 2011, Photoelectronic Detection and Imaging.

[6]  Yao Lu,et al.  Fast efficient algorithm for enhancement of low lighting video , 2011, ICME.

[7]  Seong-Won Lee,et al.  Noise-adaptive spatio-temporal filter for real-time noise removal in low light level images , 2005, IEEE Trans. Consumer Electron..

[8]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[9]  Shih-Chia Huang,et al.  Efficient Contrast Enhancement Using Adaptive Gamma Correction With Weighting Distribution , 2013, IEEE Transactions on Image Processing.

[10]  László Neumann,et al.  Global Contrast Factor - a New Approach to Image Contrast , 2005, CAe.

[11]  Peyman Milanfar,et al.  Video denoising using higher order optimal space-time adaptation , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[12]  G. Qu,et al.  Information measure for performance of image fusion , 2002 .

[13]  John M. Boone,et al.  Flat-field correction technique for digital detectors , 1998, Medical Imaging.

[14]  L. McMillan,et al.  Video enhancement using per-pixel virtual exposures , 2005, SIGGRAPH 2005.

[15]  Alan C. Bovik,et al.  Making a “Completely Blind” Image Quality Analyzer , 2013, IEEE Signal Processing Letters.

[16]  Chul Lee,et al.  Optimized Brightness Compensation and Contrast Enhancement for Transmissive Liquid Crystal Displays , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[17]  Henrique S. Malvar,et al.  High-quality linear interpolation for demosaicing of Bayer-patterned color images , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[18]  Byungyong Ryu,et al.  Content-Aware Dark Image Enhancement Through Channel Division , 2012, IEEE Transactions on Image Processing.

[19]  Jean-Michel Morel,et al.  A non-local algorithm for image denoising , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[20]  John D. Austin,et al.  Adaptive histogram equalization and its variations , 1987 .

[21]  Joonki Paik,et al.  Contrast enhancement system using spatially adaptive histogram equalization with temporal filtering , 1998 .

[22]  Rushan Chen,et al.  Efficient video denoising based on dynamic nonlocal means , 2012, Image Vis. Comput..

[23]  Karol Myszkowski,et al.  Adaptive Logarithmic Mapping For Displaying High Contrast Scenes , 2003, Comput. Graph. Forum.

[24]  A. Murat Tekalp,et al.  Adaptive motion-compensated filtering of noisy image sequences , 1993, IEEE Trans. Circuits Syst. Video Technol..

[25]  Mateu Sbert,et al.  A new approach for very dark video denoising and enhancement , 2010, 2010 IEEE International Conference on Image Processing.

[26]  Yasuyuki Matsushita,et al.  Noise suppression in low-light images through joint denoising and demosaicing , 2011, CVPR 2011.

[27]  I. Johnstone,et al.  Ideal spatial adaptation by wavelet shrinkage , 1994 .

[28]  Calle Lejdfors,et al.  Adaptive enhancement and noise reduction in very low light-level video , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[29]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[30]  Karen O. Egiazarian,et al.  Video denoising by sparse 3D transform-domain collaborative filtering , 2007, 2007 15th European Signal Processing Conference.

[31]  Lifeng Sun,et al.  Video Enhancement Using Adaptive Spatio-Temporal Connective Filter and Piecewise Mapping , 2008, EURASIP J. Adv. Signal Process..

[32]  Hanseok Ko,et al.  Single image haze removal with WLS-based edge-preserving smoothing filter , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[33]  Stephen Lin,et al.  Radiometric Calibration from Noise Distributions , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[34]  Mark D. Fairchild,et al.  iCAM06: A refined image appearance model for HDR image rendering , 2007, J. Vis. Commun. Image Represent..

[35]  Richard Szeliski,et al.  Noise Estimation from a Single Image , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[36]  Juan Song,et al.  Enhancement and noise reduction of very low light level images , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[37]  Jean-Michel Morel,et al.  Nonlocal Image and Movie Denoising , 2008, International Journal of Computer Vision.

[38]  W. James MacLean,et al.  CCD noise removal in digital images , 2006, IEEE Transactions on Image Processing.

[39]  Jechang Jeong,et al.  Contrast enhancement using histogram equalization based on logarithmic mapping , 2012 .

[40]  Hanseok Ko,et al.  A novel framework for extremely low-light video enhancement , 2014, 2014 IEEE International Conference on Consumer Electronics (ICCE).

[41]  Alessandro Foi,et al.  Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering , 2007, IEEE Transactions on Image Processing.