A Simulation Environment for Benchmarking Sensor Fusion-Based Pose Estimators

In-depth analysis and performance evaluation of sensor fusion-based estimators may be critical when performed using real-world sensor data. For this reason, simulation is widely recognized as one of the most powerful tools for algorithm benchmarking. In this paper, we present a simulation framework suitable for assessing the performance of sensor fusion-based pose estimators. The systems used for implementing the framework were magnetic/inertial measurement units (MIMUs) and a camera, although the addition of further sensing modalities is straightforward. Typical nuisance factors were also included for each sensor. The proposed simulation environment was validated using real-life sensor data employed for motion tracking. The higher mismatch between real and simulated sensors was about 5% of the measured quantity (for the camera simulation), whereas a lower correlation was found for an axis of the gyroscope (0.90). In addition, a real benchmarking example of an extended Kalman filter for pose estimation from MIMU and camera data is presented.

[1]  W. H. Baird.  An introduction to inertial navigation , 2009 .

[2]  Fernando Seco Granja,et al.  Simulation of foot-mounted IMU signals for the evaluation of PDR algorithms , 2011, 2011 International Conference on Indoor Positioning and Indoor Navigation.

[3]  Yuichi Motai,et al.  Hand–Eye Calibration Applied to Viewpoint Selection for Robotic Vision , 2008, IEEE Transactions on Industrial Electronics.

[4]  Gaurav S. Sukhatme,et al.  Visual-Inertial Sensor Fusion: Localization, Mapping and Sensor-to-Sensor Self-calibration , 2011, Int. J. Robotics Res..

[5]  Patrick Robertson,et al.  Characterization of the indoor magnetic field for applications in Localization and Mapping , 2012, 2012 International Conference on Indoor Positioning and Indoor Navigation (IPIN).

[6]  S. L. Eddins,et al.  Automated Software Testing for Matlab , 2009, Computing in Science & Engineering.

[7]  Malcolm D. Shuster.  Survey of attitude representations , 1993 .

[8]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[9]  H. S. Wolff,et al.  iRun: Horizontal and Vertical Shape of a Region-Based Graph Compression , 2022, Sensors.

[10]  Jr. J.J. LaViola,et al.  A comparison of unscented and extended Kalman filtering for estimating quaternion motion , 2003, Proceedings of the 2003 American Control Conference, 2003..

[11]  D. K. Arvind,et al.  IMUSim: A simulation environment for inertial sensing algorithm design and evaluation , 2011, Proceedings of the 10th ACM/IEEE International Conference on Information Processing in Sensor Networks.

[12]  Sébastien Changey,et al.  Magnetometer-Augmented IMU Simulator: In-Depth Elaboration , 2015, Sensors.

[13]  Jean-Yves Bouguet,et al.  Camera calibration toolbox for matlab , 2001 .

[14]  Dimitrios G. Kottas,et al.  Camera-IMU-based localization: Observability analysis and consistency improvement , 2014, Int. J. Robotics Res..

[15]  Joseph J. LaViola,et al.  A testbed for studying and choosing predictive tracking algorithms in virtual environments , 2003, IPT/EGVE.

[16]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[17]  Dean Brown,et al.  Decentering distortion of lenses , 1966 .

[18]  Gérard Lachapelle,et al.  Multi‐Magnetometer Based Perturbation Mitigation for Indoor Orientation Estimation , 2011 .

[19]  Patrick Robertson,et al.  Magnetic maps of indoor environments for precise localization of legged and non-legged locomotion , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[20]  J.-Y. Bouguet,et al.  Pyramidal implementation of the lucas kanade feature tracker , 1999 .

[21]  Demoz Gebre-Egziabher,et al.  A Non-linear , Two-step Estimation Algorithm for Calibrating Solid-state Strapdown Magnetometers , 2001 .

[22]  M. Shuster.  A survey of attitude representation , 1993 .

[23]  Thia Kirubarajan,et al.  Estimation with Applications to Tracking and Navigation: Theory, Algorithms and Software , 2001 .

[24]  Angelo M. Sabatini,et al.  Extended Kalman Filter-Based Methods for Pose Estimation Using Visual, Inertial and Magnetic Sensors: Comparative Analysis and Performance Evaluation , 2013, Sensors.

[25]  Yuichi Motai,et al.  Head Orientation Prediction: Delta Quaternions Versus Quaternions , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[26]  Fabio Dovis,et al.  A Comparison between Different Error Modeling of MEMS Applied to GPS/INS Integrated Systems , 2013, Sensors.

[27]  Ralph Johnson,et al.  design patterns elements of reusable object oriented software , 2019 .

[28]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[29]  Angelo M. Sabatini,et al.  Estimating Three-Dimensional Orientation of Human Body Parts by Inertial/Magnetic Sensing , 2011, Sensors.

[30]  Richard O. Duda,et al.  Use of the Hough transformation to detect lines and curves in pictures , 1972, CACM.

[31]  C Haythornwaite,et al.  Gamma, E., Helm, R., Johnson, R. & Vlissides, J. Design Patterns: Elements of Reusable Object Oriented Software. New York: Addison-Wesley, 1995. , 2002 .

[32]  Jorge Dias,et al.  Relative Pose Calibration Between Visual and Inertial Sensors , 2007, Int. J. Robotics Res..