Pattern-selective color image fusion

Abstract This paper introduces pattern-selective color image fusion and shows how it can be applied to two domains of image enhancement: extension of dynamic range and depth of focus. Pattern-selective fusion methods provide a mechanism for combining multiple monochromatic source images through identifying salient features in the source images at multiple scales and orientations, and combining those features into a single composite image result. In this paper, the pattern-selective fusion method is generalized into a framework that is equally applicable to monochrome, color, and multi-spectral imagery. This proposed fusion framework is then used to combine a set of color source images, taken from a sensor with varying aperture and focus settings, into a single fused image result that has improved dynamic range and depth of field over any of the other frames in the input sequence. Experimental results show the performance of the dynamic range and depth-of-field extension on imagery taken from consumer-grade video camera equipment.

[1]  Edward H. Adelson,et al.  The Laplacian Pyramid as a Compact Image Code , 1983, IEEE Trans. Commun..

[2]  Kristin J. Dana,et al.  Real-time scene stabilization and mosaic construction , 1994, Proceedings of 1994 IEEE Workshop on Applications of Computer Vision.

[3]  Shree K. Nayar,et al.  Radiometric self calibration , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[4]  Laure J. Chipman,et al.  Wavelets and image fusion , 1995, Optics + Photonics.

[5]  Peter J. Burt,et al.  Enhanced image capture through fusion , 1993, 1993 (4th) International Conference on Computer Vision.

[6]  Shmuel Peleg,et al.  Computing two motions from three frames , 1990, [1990] Proceedings Third International Conference on Computer Vision.