An Asynchronous, Robust, and Distributed Multisensor Fusion System for Mobile Robots

In this paper, a multisensor fusion system that is used for calculating the position and orientation of an autonomous mobile robot is presented. The developed fusion system is distributed, robust, and asynchronous. It is distributed to permit the parallel function of all the sensors. It is robust because, being distributed, the system has been designed to keep working properly in spite of the failure, removal, or change of any sensor. It is asynchronous to take advantage of the different features and rates of each sensor. The implementation of the system is based on the distributed Kalman filter developed by Durrant-Whyte and Rao. In that distributed filter, all the sensors work in parallel to obtain their own estimate based on their own observations and on the observations coming from other sensors. Changes have been made to simplify and speed up the computation of the external validation equations and to allow the use of any sensor model. The equations have also been adapted to deal with asynchronously operating sensors and with the existence of communication delays. The fusion system is used to estimate the position and orientation of a mobile robot. The performance of the fusion system is shown both under simulation and in a real test with a mobile robot.

[1]  José Antonio López Orozco.  Integración y fusión multisensorial en robots móviles autónomos , 1999 .

[2]  Yaakov Bar-Shalom,et al.  Multitarget-multisensor tracking: Advanced applications , 1989 .

[3]  John Durkin,et al.  Expert systems - design and development , 1994 .

[4]  Hobart R. Everett,et al.  Sensors for Mobile Robots: Theory and Application , 1995 .

[5]  D. L. Hall,et al.  Mathematical Techniques in Multisensor Data Fusion , 1992 .

[6]  Peter W. Tse,et al.  Fuzzy mobile robot navigation and sensor integration , 1996, Proceedings of IEEE 5th International Fuzzy Systems.

[7]  Gonzalo Pajares,et al.  A Neural Network model in stereovision matching , 1995, Neural Networks.

[8]  Petros G. Voulgaris,et al.  On optimal ℓ∞ to ℓ∞ filtering , 1995, Autom..

[9]  Jesús Manuel de la Cruz García,et al.  Multisensor fusion of environment measures using Bayesian Networks , 1998 .

[10]  Mongi A. Abidi,et al.  Data fusion in robotics and machine intelligence , 1992 .

[11]  Dean A. Pomerleau,et al.  Neural Network Perception for Mobile Robot Guidance , 1993 .

[12]  Hugh Durrant-Whyte,et al.  Integration, coordination, and control of multi-sensor robot systems , 1987 .

[13]  Yaakov Bar-Shalom,et al.  Estimation and Tracking: Principles, Techniques, and Software , 1993 .

[14]  Moshe Kam,et al.  Sensor Fusion for Mobile Robot Navigation , 1997, Proc. IEEE.

[15]  H. Sorenson.  Least-squares estimation: from Gauss to Kalman , 1970, IEEE Spectrum.

[16]  R. H. Deaves,et al.  The management of communications in decentralised Bayesian data fusion system , 1998 .

[17]  Krishna R. Pattipati,et al.  IMM estimation for multitarget-multisensor air traffic surveillance , 1997 .

[18]  Sumit Roy,et al.  Decentralized structures for parallel Kalman filtering , 1988 .

[19]  Hobart R. Everett,et al.  Sensors for Mobile Robots , 1995 .

[20]  Keinosuke Fukunaga,et al.  Introduction to Statistical Pattern Recognition , 1972 .

[21]  James Llinas,et al.  Multisensor Data Fusion , 1990 .

[22]  Huosheng Hu,et al.  Toward a fully decentralized architecture for multi-sensor data fusion , 1990, Proceedings., IEEE International Conference on Robotics and Automation.

[23]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.

[24]  Richard E. Neapolitan,et al.  Probabilistic reasoning in expert systems - theory and algorithms , 2012 .

[25]  Solomon Eyal Shimony,et al.  Bayes Networks for Sonar Sensor Fusion , 1997, UAI.

[26]  Hugh F. Durrant-Whyte,et al.  A Fully Decentralized Multi-Sensor System For Tracking and Surveillance , 1993, Int. J. Robotics Res..

[27]  Arthur G. O. Mutambara,et al.  Decentralized Estimation and Control for Multisensor Systems , 2019 .

[28]  Alessandro Saffiotti,et al.  Fuzzy Logic Techniques for Autonomous Vehicle Navigation , 2001 .

[29]  H. W. Sorenson,et al.  Kalman filtering : theory and application , 1985 .

[30]  J. Gasós.  Integrating Linguistic Descriptions and Sensor Observations for the Navigation of Autonomous Robots , 2001 .

[31]  Gene H. Golub,et al.  Matrix computations , 1983 .

[32]  E. Besada,et al.  An open sensing architecture to autonomous mobile robots , 1998, Proceedings of the 1998 IEEE International Symposium on Intelligent Control (ISIC) held jointly with IEEE International Symposium on Computational Intelligence in Robotics and Automation (CIRA) Intell.

[33]  Mohinder S. Grewal,et al.  Kalman Filtering: Theory and Practice , 1993 .

[34]  Dennis M. Buede,et al.  A target identification comparison of Bayesian and Dempster-Shafer multisensor fusion , 1997, IEEE Trans. Syst. Man Cybern. Part A.

[35]  Hugh F. Durrant-Whyte,et al.  Decentralized multiplatform data fusion , 1998, Defense, Security, and Sensing.

[36]  Arthur Gelb,et al.  Applied Optimal Estimation , 1974 .