Chapter # IMAGE FUSION USING THE EXPECTATION-MAXIMIZATION ALGORITHM AND A GAUSSIAN MIXTURE MODEL

1. INTRODUCTION Image fusion refers the process of combining multiple images of a scene to obtain a single composite image [1-4]. The different images to be fused can come from different sensors of the same basic type or they may come from different types of sensors. The composite image should contain a more useful description of the scene than provided by any of the individual source images. This fused image should be more useful for human visual or machine perception. In recent years, image fusion has become an important and useful technique for image analysis, computer vision [4-7], concealed weapon detection (CWD) [8,9], and autonomous landing guidance (ALG) [10-11]. A simple image fusion method is to take the average of the source images pixel by pixel. While simple this approach can produce several undesired side effects including reduced contrast. In recent years, many researchers recognized that multiscale transforms are very useful for analyzing the information content of images for the purpose of fusion [12-14]. Several multiscale transforms have become very popular. These include t he Laplacian pyramid transform [15], the contrast pyramid transform [16-17], the gradient pyramid transform [18], and the wavelet transform [12,14,19]. At the same time, some sophisticated image fusion approaches based on

[1]  Rick S. Blum,et al.  A hybrid image registration technique for a digital camera image fusion application , 2001, Inf. Fusion.

[2]  Ravi K. Sharma,et al.  Probabilistic Image Sensor Fusion , 1998, NIPS.

[3]  Pramod K. Varshney,et al.  Enhancement and fusion of data for concealed weapon detection , 1997, Defense, Security, and Sensing.

[4]  Michael C. Wicks,et al.  Sensors for military special operations and law enforcement applications , 1997 .

[5]  Rick S. Blum,et al.  An adaptive spatial diversity receiver for non-Gaussian interference and noise , 1997, First IEEE Signal Processing Workshop on Signal Processing Advances in Wireless Communications.

[6]  Saleem A. Kassam,et al.  RBFN restoration of nonlinearly degraded images , 1996, IEEE Trans. Image Process..

[7]  Duane P. Pond,et al.  Infrared-optical multisensor for autonomous landing guidance , 1995, Defense, Security, and Sensing.

[8]  Michael R. Franklin Application of an autonomous landing guidance system for civil and military aircraft , 1995, Defense, Security, and Sensing.

[9]  Alfred O. Hero,et al.  Space-alternating generalized expectation-maximization algorithm , 1994, IEEE Trans. Signal Process..

[10]  Lawrence A. Klein,et al.  Sensor and Data Fusion Concepts and Applications , 1993 .

[11]  Peter J. Burt,et al.  Enhanced image capture through fusion , 1993, 1993 (4th) International Conference on Computer Vision.

[12]  D. L. Hall,et al.  Mathematical Techniques in Multisensor Data Fusion , 1992 .

[13]  J. Llinas,et al.  Multisensor Data Fusion , 1990 .

[14]  Stéphane Mallat,et al.  Multifrequency channel decompositions of images and wavelet models , 1989, IEEE Trans. Acoust. Speech Signal Process..

[15]  Alexander Toet,et al.  Merging thermal and visual images by a contrast pyramid , 1989 .

[16]  Alexander Toet,et al.  Image fusion by a ration of low-pass pyramid , 1989, Pattern Recognit. Lett..

[17]  R. Redner,et al.  Mixture densities, maximum likelihood, and the EM algorithm , 1984 .

[18]  Edward H. Adelson,et al.  The Laplacian Pyramid as a Compact Image Code , 1983, IEEE Trans. Commun..

[19]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[20]  T. Leen,et al.  Probabilistic model-based multisensor image fusion , 1999 .

[21]  Rick S. Blum,et al.  Investigations of image fusion , 1999 .

[22]  Pramod K. Varshney,et al.  Special issue on data fusion , 1997 .

[23]  James Llinas,et al.  An introduction to multisensor data fusion , 1997, Proc. IEEE.

[24]  Jake K. Aggarwal,et al.  Multisensor Fusion for Computer Vision , 1993, NATO ASI Series.