A new fusion-based low light still-shot stabilization

Digital cameras under a dark illumination invoke artifacts like motion blur in a long-exposed shot or salient noise corruption in a short-exposed (High ISO) shot. To suppress such artifacts effectively, multi-frame fusion approaches involving the use of multiple short-exposed images has been studied actively. Moreover, it recently has been being applied to various consumer digital cameras for the practical still-shot stabilization. However, it requires too much computational complexities and costs in order to conduct both multiframe noise filtering and brightness/color appearance restoration well from a set of multiple input images acquired at a harsh low-light situation. In this paper, we propose a new fusion-based low-light stabilization approach, which inputs one proper-/long-exposure blurry image as well as multiple short-exposure noisy images. First, a coarse-to-fine motion compensated noise filtering is done to get a clean image from the multiple short-exposure images. Then, online low-light image restoration is followed to obtain a good visual appearance from the denoised image using a blurry long-exposure input image. More specifically, the noise filtering is conducted by a simple block-wise temporal averaging based on a between-frame motion info, which provides a denoising result with even better detail preservation. Our simulation and real scene tests show the possibility of the proposed algorithm for fast and effective low light stabilization at a programmable computing platform.

[1]  Karen O. Egiazarian,et al.  Video denoising using separable 4D nonlocal spatiotemporal transforms , 2011, Electronic Imaging.

[2]  Jong-Wha Chong,et al.  Real-Time Digital Image Stabilization for Cell Phone Cameras in Low-Light Environments without Frame Memory , 2012 .

[3]  Frédo Durand,et al.  Two-scale tone management for photographic look , 2006, SIGGRAPH 2006.

[4]  Ming Zhang,et al.  Multiresolution Bilateral Filtering for Image Denoising , 2008, IEEE Transactions on Image Processing.

[5]  Marius Tico,et al.  Image enhancement method via blur and noisy image fusion , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[6]  Karen O. Egiazarian,et al.  Video denoising by sparse 3D transform-domain collaborative filtering , 2007, 2007 15th European Signal Processing Conference.

[7]  Karen O. Egiazarian,et al.  Color Image Denoising via Sparse 3D Collaborative Filtering with Grouping Constraint in Luminance-Chrominance Space , 2007, 2007 IEEE International Conference on Image Processing.

[8]  A. Sibiryakov,et al.  Low Compexity Motion Analysis for Mobile Video Devices , 2007, 2007 Digest of Technical Papers International Conference on Consumer Electronics.

[9]  Boracchi Giacomo,et al.  Multiframe Raw-Data Denoising Based On Block-Matching And 3-D Filtering For Low-Light Imaging And Stabilization , 2008 .

[10]  Alessandro Foi,et al.  Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering , 2007, IEEE Transactions on Image Processing.

[11]  Marius Tico,et al.  Multi-frame image denoising and stabilization , 2008, 2008 16th European Signal Processing Conference.

[12]  Marius Tico,et al.  Low-light imaging solutions for mobile devices , 2009, 2009 Conference Record of the Forty-Third Asilomar Conference on Signals, Systems and Computers.

[13]  Marius Tico Adaptive block-based approach to image stabilization , 2008, 2008 15th IEEE International Conference on Image Processing.

[14]  Jean-Michel Morel,et al.  A Review of Image Denoising Algorithms, with a New One , 2005, Multiscale Model. Simul..