Estimating and controlling UAV position using RGB-D/IMU data fusion with decentralized information/Kalman filter

This paper proposes a 3D data capture system, based on the fusion of data coming from an active depth sensor and a inertial measurement unit (IMU), to determine the position of an aerial unmanned vehicle (UAV) in indoor environments, for control purposes. Firstly, the method adopted to detect the vehicle through using a sequence of RGB-D images. After that, the information provided by the active depth sensor is fused with the data provided by the IMU onboard the vehicle, using a Decentralized Kalman Filter (DKF) and a Decentralized Information Filter (DIF), whose performance are compared. In the sequel, a nonlinear controller is used for positioning the UAV. Finally, the performance differences between the DKF and the DIF are highlighted, as well as the divergence between the results of the depth sensor and the inertial one, in experiments involving abrupt maneuvers to induce estimation errors in the inertial unit, to check the effectiveness of the developed 3D data capture system.

[1]  S. Shankar Sastry,et al.  An Invitation to 3-D Vision , 2004 .

[2]  Daniel Cremers,et al.  Camera-based navigation of a low-cost quadrocopter , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[3]  Christoph H. Lampert,et al.  Oblivious Document Capture and Real-Time Retrieval , 2005 .

[4]  Ayoub Al-Hamadi,et al.  Improving Hand Gesture Recognition Using 3D Combined Features , 2009, 2009 Second International Conference on Machine Vision.

[5]  Weiping Li,et al.  Applied Nonlinear Control , 1991 .

[6]  Mamoun F. Abdel-Hafez,et al.  Estimating Vehicle State by GPS/IMU Fusion with Vehicle Dynamics , 2013, 2013 International Conference on Unmanned Aircraft Systems (ICUAS).

[7]  Arthur G. O. Mutambara,et al.  Decentralized Estimation and Control for Multisensor Systems , 2019 .

[8]  Ricardo Carelli,et al.  A trajectory tracking and 3D positioning controller for the AR.Drone quadrotor , 2014, 2014 International Conference on Unmanned Aircraft Systems (ICUAS).

[9]  Teodiano Freire Bastos Filho,et al.  A new mobile robot control approach via fusion of control signals , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[10]  Mário Sarcinelli Filho,et al.  PVTOL maneuvers guided by a high-level nonlinear controller applied to a rotorcraft machine , 2014, Eur. J. Control.

[11]  Mário Sarcinelli Filho,et al.  Estimation and control of the 3D position of a quadrotor in indoor environments , 2013, 2013 16th International Conference on Advanced Robotics (ICAR).

[12]  Nong Cheng,et al.  Combined RGBD-inertial based state estimation for MAV in GPS-denied indoor environments , 2013, 2013 9th Asian Control Conference (ASCC).

[13]  Roman Czyba,et al.  Altitude estimation for the UAV's applications based on sensors fusion algorithm , 2013, 2013 International Conference on Unmanned Aircraft Systems (ICUAS).