Contribution to multisensor fusion formalization

Abstract Using data fusion for scene analysis to take advantage of the capabilities of each sensor, and palliate their limitations, is very attractive. However, data fusion involves new problems such as control of increasing data flow, knowledge modeling, or strategy and reasoning determination. Controlling these problems is the only way to obtain all the potential advantages of data fusion. Thus, in Part 2, we focus on sensor relationships. We propose a quantitative measure or redundancy and complementarity between various types of sensors. For this, we use information theory, introduced by Shannon, that gives a very interesting mathematical framework. In Part 3, we focus on data fusion mechanisms. We give a brief review of multisensor fusion methods that can be found in the literature, and we indicate the few attempts at classification we found. These classifications usually describe only some characteristics of a multisensor fusion process. In order to better formalize these characteristics, we define a generic fusion cell that can describe any fusion process. Integration is viewed as an association of different fusion cells. This formalization gives us a more generic representation of the integration problems, while splitting off conceptually the fusion problems from the integration problems.

[1]  Amy R. Reibman,et al.  Optimal Detection and Performance of Distributed Sensor Systems , 1987 .

[2]  W. Gesing,et al.  An integrated multisensor aircraft track recovery system for remote sensing , 1983 .

[3]  Ren C. Luo,et al.  Robot multi-sensor fusion and integration: optimum estimation of fused sensor data , 1988, Proceedings. 1988 IEEE International Conference on Robotics and Automation.

[4]  John C. Pearson,et al.  Neural Network Approach To Sensory Fusion , 1988, Defense, Security, and Sensing.

[5]  Augustin Lux Algorithmique et contrôle en vision par ordinateur , 1985 .

[6]  Stéphane Houzelle,et al.  Interpretation of remotely sensed images in a context of multisensor fusion using a multispecialist architecture , 1993, IEEE Trans. Geosci. Remote. Sens..

[7]  C. E. SHANNON,et al.  A mathematical theory of communication , 1948, MOCO.

[8]  Demosthenis Teneketzis The decentralized quickest detection problem , 1982, 1982 21st IEEE Conference on Decision and Control.

[9]  Ramanarayanan Viswanathan,et al.  Optimal Decision Fusion in Multiple Sensor Systems , 1987, IEEE Transactions on Aerospace and Electronic Systems.

[10]  Bir Bhanu,et al.  A Framework for Distributed Sensing and Control , 1985, IJCAI.

[11]  Oleg G. Jakubowicz Autonomous Reconfiguration Of Sensor Systems Using Neural Nets , 1988, Defense, Security, and Sensing.

[12]  H. F. Durrant-White Consistent integration and propagation of disparate sensor observations , 1987 .

[13]  James J. Clark,et al.  Data Fusion for Sensory Information Processing Systems , 1990 .

[14]  Ramanarayanan Viswanathan,et al.  Optimal serial distributed decision fusion , 1988 .

[15]  Ren C. Luo,et al.  Multisensor integration and fusion in intelligent systems , 1989, IEEE Trans. Syst. Man Cybern..

[16]  L. Pau Knowledge representation approaches in sensor fusion , 1989, Autom..

[17]  Max Mintz,et al.  Robust fusion of location information , 1988, Proceedings. 1988 IEEE International Conference on Robotics and Automation.

[18]  John D. Lowrance,et al.  An Inference Technique for Integrating Knowledge from Disparate Sources , 1981, IJCAI.

[19]  Amar Mitiche,et al.  Multisensor Knowledge Systems , 1988, Int. J. Robotics Res..

[20]  Claude E. Shannon,et al.  The mathematical theory of communication , 1950 .

[21]  C. W. Helstrom,et al.  Improved multilevel quantization for detection of narrowband signals , 1988 .

[22]  Thomas C. Henderson,et al.  High-Level Multisensor Integration , 1989, Optics East.

[23]  Steven A. Shafer,et al.  An architecture for sensor fusion in a mobile robot , 1986, Proceedings. 1986 IEEE International Conference on Robotics and Automation.

[24]  Victor S. Frost,et al.  A Model for Radar Images and Its Application to Adaptive Digital Filtering of Multiplicative Noise , 1982, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Allen R. Hanson,et al.  Sensor And Information Fusion From Knowledge-Based Constraints , 1988, Defense, Security, and Sensing.

[26]  Scott Y. Harmon,et al.  Sensor data fusion through a distributed blackboard , 1986, Proceedings. 1986 IEEE International Conference on Robotics and Automation.

[27]  Bernard Picinbono,et al.  Quantization and distributed detection , 1989, International Conference on Acoustics, Speech, and Signal Processing,.

[28]  Glenn Shafer,et al.  A Mathematical Theory of Evidence , 2020, A Mathematical Theory of Evidence.

[29]  Olivier D. Faugeras,et al.  Building, Registrating, and Fusing Noisy Visual Maps , 1988, Int. J. Robotics Res..

[30]  Peter Seitz,et al.  Minimum class entropy: A maximum information approach to layered networks , 1989, Neural Networks.

[31]  Tong Lee,et al.  Probabilistic and Evidential Approaches for Multisource Data Analysis , 1987, IEEE Transactions on Geoscience and Remote Sensing.

[32]  Ralph Linsker,et al.  Self-organization in a perceptual network , 1988, Computer.

[33]  P. Schönemann On artificial intelligence , 1985, Behavioral and Brain Sciences.

[34]  S.-T. Wu,et al.  Analysis of data acquired by Shuttle Imaging Radar SIR-A and Landsat Thematic Mapper over Baldwin County, Alabama , 1985 .

[35]  John N. Tsitsiklis,et al.  On the complexity of decentralized decision making and detection problems , 1985 .