A Decentralized Sensor Fusion Scheme for Multi Sensorial Fault Resilient Pose Estimation

This article proposes a novel decentralized two-layered and multi-sensorial based fusion architecture for establishing a novel resilient pose estimation scheme. As it will be presented, the first layer of the fusion architecture considers a set of distributed nodes. All the possible combinations of pose information, appearing from different sensors, are integrated to acquire various possibilities of estimated pose obtained by involving multiple extended Kalman filters. Based on the estimated poses, obtained from the first layer, a Fault Resilient Optimal Information Fusion (FR-OIF) paradigm is introduced in the second layer to provide a trusted pose estimation. The second layer incorporates the output of each node (constructed in the first layer) in a weighted linear combination form, while explicitly accounting for the maximum likelihood fusion criterion. Moreover, in the case of inaccurate measurements, the proposed FR-OIF formulation enables a self resiliency by embedding a built-in fault isolation mechanism. Additionally, the FR-OIF scheme is also able to address accurate localization in the presence of sensor failures or erroneous measurements. To demonstrate the effectiveness of the proposed fusion architecture, extensive experimental studies have been conducted with a micro aerial vehicle, equipped with various onboard pose sensors, such as a 3D lidar, a real-sense camera, an ultra wide band node, and an IMU. The efficiency of the proposed novel framework is extensively evaluated through multiple experimental results, while its superiority is also demonstrated through a comparison with the classical multi-sensorial centralized fusion approach.

[1]  Kazuma Sekiguchi,et al.  Vehicle localization by sensor fusion of LRS measurement and odometry information based on moving horizon estimation , 2014, 2014 IEEE Conference on Control Applications (CCA).

[2]  Fawzi Nashashibi,et al.  Cooperative Multi-Vehicle Localization Using Split Covariance Intersection Filter , 2013, IEEE Intelligent Transportation Systems Magazine.

[3]  Orbiting a Moving Target with Multi-Robot Collaborative Visual SLAM , 2015 .

[4]  Joan Solà,et al.  Quaternion kinematics for the error-state Kalman filter , 2015, ArXiv.

[5]  Oscar Mayora-Ibarra,et al.  Choosing the Best Sensor Fusion Method: A Machine-Learning Approach , 2020, Sensors.

[6]  James Llinas,et al.  Handbook of Multisensor Data Fusion : Theory and Practice, Second Edition , 2008 .

[7]  Lihua Xie,et al.  Graph Optimization Approach to Range-based Localization , 2018 .

[8]  Shu-Li Sun,et al.  Multi-sensor optimal information fusion Kalman filter , 2004, Autom..

[9]  Hugh F. Durrant-Whyte,et al.  Decentralized Architecture for Asynchronous Sensors , 1999, Auton. Robots.

[10]  James Llinas,et al.  Distributed Data Fusion for Network-Centric Operations , 2012 .

[11]  Jurek Z. Sasiadek,et al.  Multi Sensor Fusion Based on Adaptive Kalman Filtering , 2018 .

[12]  Walter Lucia,et al.  Extended and Unscented Kalman Filters for mobile robot localization and environment reconstruction , 2013, 21st Mediterranean Conference on Control and Automation.

[13]  Huosheng Hu,et al.  Toward a fully decentralized architecture for multi-sensor data fusion , 1990, Proceedings., IEEE International Conference on Robotics and Automation.

[14]  Xin Su,et al.  A Localization Based on Unscented Kalman Filter and Particle Filter Localization Algorithms , 2020, IEEE Access.

[15]  Mircea Lazar,et al.  State fusion with unknown correlation: Ellipsoidal intersection , 2010, Proceedings of the 2010 American Control Conference.

[16]  Mohammad Bozorg,et al.  Localization of an indoor mobile robot using decentralized data fusion , 2019, 2019 7th International Conference on Robotics and Mechatronics (ICRoM).

[17]  Singiresu S. Rao Engineering Optimization : Theory and Practice , 2010 .

[18]  Sukhan Lee,et al.  Distributed Multisensor Data Fusion under Unknown Correlation and Data Inconsistency , 2017, Sensors.

[19]  F. Martinelli Robot localization: comparable performance of EKF and UKF in some interesting indoor settings , 2008, 2008 16th Mediterranean Conference on Control and Automation.

[20]  Gerhard P. Hancke,et al.  A Review on Challenges of Autonomous Mobile Robot and Sensor Fusion Methods , 2020, IEEE Access.

[21]  George K. I. Mann,et al.  Decentralized Cooperative Localization for Heterogeneous Multi-robot System Using Split Covariance Intersection Filter , 2014, 2014 Canadian Conference on Computer and Robot Vision.

[22]  Gregory Dudek,et al.  Cooperative localization and multi-robot exploration , 2003 .

[23]  E. Rivin,et al.  Denavit, J. & Hartenberg, R. (1964). "Kinematic Synthesis of Linkages". Estados Unidos de América: McGraw-Hill, Inc. Corke, P. (2011). "Robotics, Vision and Control: Fundamental Algorithms in MATLAB". , 2011 .

[24]  Wei Wang,et al.  LIO-SAM: Tightly-coupled Lidar Inertial Odometry via Smoothing and Mapping , 2020, 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[25]  Walter Lucia,et al.  Mobile robot localization via EKF and UKF: A comparison based on real data , 2015, Robotics Auton. Syst..

[26]  Gerasimos G. Rigatos,et al.  Extended Kalman and Particle Filtering for sensor fusion in motion control of mobile robots , 2010, Math. Comput. Simul..

[27]  Calvin Coopmans,et al.  A Survey of Inertial Sensor Fusion: Applications in sUAS Navigation and Data Collection , 2019, 2019 International Conference on Unmanned Aircraft Systems (ICUAS).

[28]  Mark W. Mueller,et al.  Fusing ultra-wideband range measurements with accelerometers and rate gyroscopes for quadrocopter state estimation , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[29]  James M. Conrad,et al.  A Survey of Implementation of Multi-Robot Simultaneous Localization and Mapping , 2018, SoutheastCon 2018.

[30]  Stergios I. Roumeliotis,et al.  Decentralized multi-robot cooperative localization using covariance intersection , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[31]  D. Simon Optimal State Estimation: Kalman, H Infinity, and Nonlinear Approaches , 2006 .

[32]  Mohammad A. Jaradat,et al.  Multiple sensor fusion for mobile robot localization and navigation using the Extended Kalman Filter , 2015, 2015 10th International Symposium on Mechatronics and its Applications (ISMA).

[33]  O. Isik,et al.  Numerical analysis of Backward-Euler discretization for simplified magnetohydrodynamic flows , 2015 .

[34]  Mário Sarcinelli Filho,et al.  Estimating and controlling UAV position using RGB-D/IMU data fusion with decentralized information/Kalman filter , 2015, 2015 IEEE International Conference on Industrial Technology (ICIT).

[35]  Hongbin Ma,et al.  Decentralized Cooperative Localization with Fault Detection and Isolation in Robot Teams , 2018, Sensors.

[36]  T. T. Hoang,et al.  Multi-sensor perceptual system for mobile robot and sensor fusion-based localization , 2012, 2012 International Conference on Control, Automation and Information Sciences (ICCAIS).

[37]  Juan M. Corchado,et al.  Partial Consensus and Conservative Fusion of Gaussian Mixtures for Distributed PHD Fusion , 2017, IEEE Transactions on Aerospace and Electronic Systems.

[38]  Ruben Gonzalez,et al.  Sensor Fusion for Tour-Guide Robot Localization , 2018, IEEE Access.

[39]  Hyun-il Kwon,et al.  Sensor data fusion using Unscented Kalman Filter for accurate localization of mobile robots , 2010, ICCAS 2010.

[40]  Lihua Xie,et al.  VIRAL-Fusion: A Visual-Inertial-Ranging-Lidar Sensor Fusion Approach , 2020, IEEE Transactions on Robotics.

[41]  Ling Chen,et al.  An optimization based Moving Horizon Estimation with application to localization of Autonomous Underwater Vehicles , 2014, Robotics Auton. Syst..

[42]  Peter I. Corke,et al.  Robotics, Vision and Control - Fundamental Algorithms in MATLAB® , 2011, Springer Tracts in Advanced Robotics.

[43]  Maan El Badaoui El Najjar,et al.  Multi-sensor fusion approach with fault detection and exclusion based on the Kullback-Leibler Divergence: Application on collaborative multi-robot system , 2017, Inf. Fusion.