Advances in Multi-Sensor Data Fusion: Algorithms and Applications

With the development of satellite and remote sensing techniques, more and more image data from airborne/satellite sensors have become available. Multi-sensor image fusion seeks to combine information from different images to obtain more inferences than can be derived from a single sensor. In image-based application fields, image fusion has emerged as a promising research area since the end of the last century. The paper presents an overview of recent advances in multi-sensor satellite image fusion. Firstly, the most popular existing fusion algorithms are introduced, with emphasis on their recent improvements. Advances in main applications fields in remote sensing, including object identification, classification, change detection and maneuvering targets tracking, are described. Both advantages and limitations of those applications are then discussed. Recommendations are addressed, including: (1) Improvements of fusion algorithms; (2) Development of “algorithm fusion” methods; (3) Establishment of an automatic quality assessment scheme.

[1]  C. O'Hara,et al.  Concepts of Image Fusion in Remote Sensing Applications , 2006, 2006 IEEE International Symposium on Geoscience and Remote Sensing.

[2]  M. Do.  Directional multiresolution image representations , 2002 .

[3]  G.A. Carpenter,et al.  Self-organizing hierarchical knowledge discovery by an ARTMAP information fusion system , 2005, Proceedings. 2005 IEEE International Joint Conference on Neural Networks, 2005..

[4]  Thomas Fechner,et al.  Optimal fusion of TV and infrared images using artificial neural networks , 1995, SPIE Defense + Commercial Sensing.

[5]  Pascal Vasseur,et al.  Introduction to Multisensor Data Fusion , 2005, The Industrial Information Technology Handbook.

[6]  Feng Xin-xi.  An Algorithm of Tracking a Maneuvering Target Based on IR Sensor and Radar in Dense Environment , 2006 .

[7]  Tian Hong-wei.  Maneuvering Target Tracking Based on Fusion of Multi-sensor , 2006 .

[8]  Rong Wang,et al.  A Feature-Level Image Fusion Algorithm Based on Neural Networks , 2007, 2007 1st International Conference on Bioinformatics and Biomedical Engineering.

[9]  Su Xiu-qin.  A Pyramid Transform of Image Denoising Algorithm Based on Morphology , 2009 .

[10]  Gail A. Carpenter,et al.  Self-organizing Hierarchical Knowledge Discovery by an ARTMAP Image Fusion System , 2004 .

[11]  Yun Zhang,et al.  Wavelet based image fusion techniques — An introduction, review and comparison , 2007 .

[12]  Wu Yan,et al.  Multi-focus image fusion based on wavelet decomposition and evolutionary strategy , 2003, International Conference on Neural Networks and Signal Processing, 2003. Proceedings of the 2003.

[13]  P. Behnia.  Comparison between four methods for data fusion of ETM+ multispectral and pan images , 2005 .

[14]  Zhiming Cui,et al.  Multi-source remote sensing image fusion classification based on DS evidence theory , 2007, International Symposium on Multispectral Image Processing and Pattern Recognition.

[15]  Gail A. Carpenter,et al.  Self-organizing information fusion and hierarchical knowledge discovery: a new framework using ARTMAP neural networks , 2005, Neural Networks.

[16]  Myeong-Ryong Nam,et al.  Fusion of multispectral and panchromatic Satellite images using the curvelet transform , 2005, IEEE Geosci. Remote. Sens. Lett..

[17]  Gonzalo Pajares,et al.  A wavelet-based image fusion tutorial , 2004, Pattern Recognit..

[18]  E. Vahdati-khajeh.  Tracking the maneuvering targets using multiple scan joint probabilistic data association algorithm , 2004 .

[19]  Philippe De Maeyer,et al.  Object-oriented change detection for the city of Harare, Zimbabwe , 2009, Expert Syst. Appl..

[20]  Yun Zhang,et al.  Understanding image fusion , 2004 .

[21]  Edward H. Adelson,et al.  PYRAMID METHODS IN IMAGE PROCESSING. , 1984 .

[22]  Sun Zhen-zhen,et al.  The High-Resolution SAR Image Terrain Classification Algorithm Based on Mixed Double Hint Layers RBFN Model , 2003 .

[23]  CHENYing,et al.  Maneuvering Vehicle Tracking Based on Multi-sensor Fusion , 2005 .

[24]  Yaonan Wang,et al.  Multifocus image fusion using artificial neural networks , 2002, Pattern Recognit. Lett..

[25]  Curt H. Davis,et al.  An integrated system for automatic road mapping from high-resolution multi-spectral satellite imagery by information fusion , 2005, Inf. Fusion.

[26]  Shuang Liu,et al.  Multisource Image Fusion Based on Wavelet Transform , 2006 .

[27]  Lei Liu,et al.  Image Fusion Algorithm Using RBF Neural Networks , 2008, HAIS.

[28]  GamanyaRuvimbo,et al.  Object-oriented change detection for the city of Harare, Zimbabwe , 2009 .

[29]  Andrea Garzelli,et al.  Panchromatic sharpening of remote sensing images using a multiscale Kalman filter , 2007, Pattern Recognit..

[30]  Belur V. Dasarathy.  A special issue on image fusion: Advances in the state of the art , 2007, Inf. Fusion.

[31]  S. Khorram,et al.  Data fusion using artificial neural networks: a case study on multitemporal change analysis , 1999 .

[32]  Stéphane Mallat,et al.  A Theory for Multiresolution Signal Decomposition: The Wavelet Representation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[33]  Xiao‐Hai Yan,et al.  A Neural Network Model for Estimating Sea Surface Chlorophyll and Sediments from Thematic Mapper Imagery , 1998 .

[34]  Han Chong.  Maneuvering Vehicle Tracking Based on Multi-sensor Fusion , 2005 .

[35]  Lorenzo Bruzzone,et al.  Image fusion techniques for remote sensing applications , 2002, Inf. Fusion.

[36]  Christine Pohl,et al.  Multisensor image fusion in remote sensing: concepts, methods and applications , 1998 .

[37]  Jamie P. Heather,et al.  A review of image fusion technology in 2005 , 2005, SPIE Defense + Commercial Sensing.

[38]  Anjan Sarkar,et al.  Landcover classification in MRF context using Dempster-Shafer fusion for multisensor imagery , 2005, IEEE Transactions on Image Processing.

[39]  Brian C. Lovell,et al.  Building detection by Dempster-Shafer fusion of LIDAR data and multispectral aerial imagery , 2004, ICPR 2004.

[40]  Rick S. Blum,et al.  Theoretical analysis of an information-based quality measure for image fusion , 2008, Inf. Fusion.

[41]  Sameer Singh,et al.  Approaches to Multisensor Data Fusion in Target Tracking: A Survey , 2006, IEEE Transactions on Knowledge and Data Engineering.

[42]  E. Candès,et al.  Curvelets: A Surprisingly Effective Nonadaptive Representation for Objects with Edges , 2000 .

[43]  Stavri G. Nikolov,et al.  Image fusion: Advances in the state of the art , 2007, Inf. Fusion.

[44]  Zheng Liu,et al.  Image Fusion Algorithm Assessment Based on Feature Measurement , 2006, First International Conference on Innovative Computing, Information and Control - Volume I (ICICIC'06).

[45]  Zhongliang Jing,et al.  Multi-focus image fusion using pulse coupled neural network , 2007, Pattern Recognit. Lett..

[46]  Minh N. Do,et al.  Ieee Transactions on Image Processing the Contourlet Transform: an Efficient Directional Multiresolution Image Representation , 2022 .

[47]  Dong Jiang,et al.  An artificial neural network model for estimating crop yields using remotely sensed information , 2004 .

[48]  Yun Zhang,et al.  An IHS and wavelet integrated approach to improve pan-sharpening visual quality of natural colour IKONOS and QuickBird images , 2005, Inf. Fusion.