A fusion strategy for reliable attitude measurement using MEMS gyroscope and camera during discontinuous vision observations

Abstract For indoor close-range high-accuracy attitude measurement using inertial and vision sensors, the major challenge is to achieve a reliable attitude in various scenarios, specifically in the absence of vision information. To address this challenge, we present a fusion strategy for reliable attitude measurement using a micro electro mechanical system (MEMS) gyroscope and camera, particularly during discontinuous vision observations. The proposed algorithm consecutively executes update and prediction modes. In the update mode, when both inertial and visual data are available, the complete Kalman Filter (KF) conducts the entire filtering process and updates residual and state errors. In the absence of visual data, the partial KF operates only when the time update and filtering state vectors are compensated by the transfer residual, which is estimated through self-propagating state error. The parameters of least-squares support vector machine (LSSVM-NARX) continuously update until the next discontinuous vision observation occurs, with the desired outputs and inner inputs being the error angles and the exogenous inputs being the gyroscope values and time. In the prediction mode, without visual data, LSSVM-NARX can provide estimated angle errors between the complete and partial KFs, which are used to eliminate errors from partial KF output vectors to obtain a reliable and accurate attitude solution. Comparisons and extensive semi-physical simulation experiments under various motion trajectories were performed to validate the effectiveness and superiority of the proposed scheme in an accurate and reliable attitude measurement capability associated with discontinuous observations.

[1]  Weigong Zhang,et al.  A fusion strategy for reliable vehicle positioning utilizing RFID and in-vehicle sensors , 2016, Inf. Fusion.

[2]  Chong Shen,et al.  Attitude measurement based on imaging ray tracking model and orthographic projection with iteration algorithm. , 2019, ISA transactions.

[3]  Juan Li,et al.  A novel system for object pose estimation using fused vision and inertial data , 2017, Inf. Fusion.

[4]  Michael Harrington,et al.  FlightTracker: a novel optical/inertial tracker for cockpit enhanced vision , 2004, Third IEEE and ACM International Symposium on Mixed and Augmented Reality.

[5]  Bin Li,et al.  Multi-sensor fusion methodology for enhanced land vehicle positioning , 2019, Inf. Fusion.

[6]  Yoichi Hori,et al.  Multirate Estimation and Control of Body Slip Angle for Electric Vehicles Based on Onboard Vision System , 2014, IEEE Transactions on Industrial Electronics.

[7]  A. Smyth,et al.  Multi-rate Kalman filtering for the data fusion of displacement and acceleration response measurement in dynamic system monitoring , 2007 .

[8]  Qimin Xu,et al.  A Reliable Fusion Positioning Strategy for Land Vehicles in GPS-Denied Environments Based on Low-Cost Sensors , 2017, IEEE Transactions on Industrial Electronics.

[9]  Randal W. Beard,et al.  Relative Heading Estimation and Its Application in Target Handoff in GPS-Denied Environments , 2019, IEEE Transactions on Control Systems Technology.

[10]  Lihui Wang,et al.  A Hybrid Intelligent Algorithm DGP-MLP for GNSS/INS Integration during GNSS Outages , 2018, Journal of Navigation.

[11]  Chan Gook Park,et al.  Motion and Structure Estimation Using Fusion of Inertial and Vision Data for Helmet Tracker , 2010 .

[12]  Youguang Guo,et al.  A Hybrid Feedforward-Feedback Hysteresis Compensator in Piezoelectric Actuators Based on Least-Squares Support Vector Machine , 2018, IEEE Transactions on Industrial Electronics.

[13]  Jiancheng Fang,et al.  A Hybrid Prediction Method for Bridging GPS Outages in High-Precision POS Application , 2014, IEEE Transactions on Instrumentation and Measurement.

[14]  Chong Shen,et al.  Determine turntable coordinate system considering its non-orthogonality. , 2019, The Review of scientific instruments.

[15]  Qingsong Xu,et al.  Rate-Dependent Hysteresis Modeling and Control of a Piezostage Using Online Support Vector Machine and Relevance Vector Machine , 2012, IEEE Transactions on Industrial Electronics.

[16]  Yue Meng,et al.  A visual/inertial integrated landing guidance method for UAV landing on the ship , 2019, Aerospace Science and Technology.

[17]  Yunhui Liu,et al.  2D Human Gesture Tracking and Recognition by the Fusion of MEMS Inertial and Vision Sensors , 2014, IEEE Sensors Journal.

[18]  Markus Vincze,et al.  Fast Ego-motion Estimation with Multi-rate Fusion of Inertial and Vision , 2007, Int. J. Robotics Res..

[19]  Shaojie Su,et al.  Monocular Vision- and IMU-Based System for Prosthesis Pose Estimation During Total Hip Replacement Surgery , 2017, IEEE Transactions on Biomedical Circuits and Systems.

[20]  M. O. Tokhi,et al.  Non-linear modelling of a one-degree-of-freedom twin-rotor multi-input multi-output system using radial basis function networks , 2002 .

[21]  M. Kemal Leblebicioglu,et al.  Experimental test of vision-based navigation and system identification of an unmanned underwater survey vehicle (SAGA) for the yaw motion , 2019 .

[22]  Rui Song,et al.  Vehicle state estimation for INS/GPS aided by sensors fusion and SCKF-based algorithm , 2021 .

[23]  Kamran Mohseni,et al.  Visual-Inertial Guidance With a Plenoptic Camera for Autonomous Underwater Vehicles , 2019, IEEE Robotics and Automation Letters.

[24]  Zhilu Wu,et al.  SVM-CNN-Based Fusion Algorithm for Vehicle Navigation Considering Atypical Observations , 2019, IEEE Signal Processing Letters.

[25]  Shaojiang Dong,et al.  Bearing degradation process prediction based on the PCA and optimized LS-SVM model , 2013 .