A method for fusing a pair of images in the JPEG domain

We present an efficient algorithm for fusing a pair of long- and short-exposure images that work in the JPEG domain. The algorithm uses the spatial frequency analysis provided by the discrete cosine transform within JPEG to combine the uniform regions of the long-exposure image with the detailed regions of the short-exposure image, thereby reducing noise while providing sharp details. Two additional features of the algorithm enable its implementation at low cost, and in real time, on a digital camera: the camera’s response between exposures is equalized with a look-up table implementing a parametric sigmoidal function; and image fusion is performed by selective overwriting during the JPEG file save operation. The algorithm requires no more than a single JPEG macro-block of the short-exposure image to be maintained in RAM at any one time, and needs only a single pass over both long- and short-exposure images. The performance of the algorithm is demonstrated with examples of image stabilization and high dynamic range image acquisition.

[1]  Luca Bogoni,et al.  Extending dynamic range of monochrome and color images through fusion , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[2]  Erik Reinhard,et al.  09 – Image-based Lighting , 2006 .

[3]  Tania Stathaki,et al.  Image Fusion: Algorithms and Applications , 2008 .

[4]  Patricia Ladret,et al.  The blur effect: perception and estimation with a new no-reference perceptual blur metric , 2007, Electronic Imaging.

[5]  Erik Reinhard,et al.  High Dynamic Range Imaging: Acquisition, Display, and Image-Based Lighting (The Morgan Kaufmann Series in Computer Graphics) , 2005 .

[6]  Natasha Gelfand,et al.  Multi-exposure imaging on mobile devices , 2010, ACM Multimedia.

[7]  Ramakrishna Kakarala,et al.  A method for signalling block-adaptive quantization in baseline sequential JPEG , 2009, TENCON 2009 - 2009 IEEE Region 10 Conference.

[8]  Gregory K. Wallace,et al.  The JPEG Still Image Compression Standard , 1991 .

[9]  Yung-Yu Chuang,et al.  High dynamic range image reconstruction from hand-held cameras , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Barak Fishbain,et al.  No-reference method for image effective bandwidth estimation , 2008, Electronic Imaging.

[11]  Marius Tico,et al.  Artifact-free High Dynamic Range imaging , 2009, 2009 IEEE International Conference on Computational Photography (ICCP).

[12]  리차드 스젤리스키,et al.  A system and process for generating high dynamic range video , 2004 .

[13]  Erik Reinhard,et al.  Ghost Removal in High Dynamic Range Images , 2006, 2006 International Conference on Image Processing.

[14]  Mohamed Akil,et al.  Real-time dynamic tone-mapping operator on GPU , 2011, Journal of Real-Time Image Processing.

[15]  Yung-Yu Chuang,et al.  High dynamic range image reconstruction from hand-held cameras , 2009, CVPR.

[16]  Greg Ward,et al.  Automatic High-Dynamic Range Image Generation for Dynamic Scenes , 2008, IEEE Computer Graphics and Applications.

[17]  Erik Reinhard,et al.  High Dynamic Range Imaging: Acquisition, Display, and Image-Based Lighting , 2010 .

[18]  Frédo Durand,et al.  Noise-optimal capture for high dynamic range photography , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[19]  H. B. Mitchell Image Fusion: Theories, Techniques and Applications , 2010 .

[20]  Shuvra S. Bhattacharyya,et al.  Model-based mapping of reconfigurable image registration on FPGA platforms , 2008, Journal of Real-Time Image Processing.

[21]  Marius Tico,et al.  Image enhancement method via blur and noisy image fusion , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[22]  Natasha Gelfand,et al.  Motion-blur-free exposure fusion , 2010, 2010 IEEE International Conference on Image Processing.

[23]  Gregory K. Wallace,et al.  The JPEG still picture compression standard , 1992 .

[24]  Junichi Nakamura,et al.  Image Sensors and Signal Processing for Digital Still Cameras , 2005 .