Pose estimation of a mobile robot using monocular vision and inertial sensors data

Practically, today most mobile devices, such as robots require to have ability to determine their pose (location and orientation) from low-cost sensors with high accuracy. This paper presents a novel fusion method to determine the pose estimation of an autonomous mobile robot using inertial sensors and a camera. Speeded up robust features (SURF) is used as a visual algorithm to detect natural landmarks (also known as markerless method) from image sequence. SURF is an effective detector and descriptor algorithm which can detect key point features from images regardless of the lighting or different viewing conditions. The inertial sensors used are six degree of freedom (6DOF) which comprises 3-axis of accelerometer and 3-axis of gyroscope. The data from inertial sensor and vision are fused together using Extended Kalman Filter (EKF). The key contribution of this paper is the low-cost, easy deployment and fast computation. The system combines the best of each sensor, more information derived from the camera and the fast response of the inertial sensors. Experimental and simulated results show that this method is fast in computation, reliable and improves accuracy. Root mean square errors (RMSEs) for position and orientation were achieved in the experiments.

[1]  Juan Li,et al.  A novel system for object pose estimation using fused vision and inertial data , 2017, Inf. Fusion.

[2]  Gerhard P. Hancke,et al.  IR-UWB-Based Non-Line-of-Sight Identification in Harsh Environments: Principles and Challenges , 2016, IEEE Transactions on Industrial Informatics.

[3]  Wen Yan,et al.  Omni-Directional Scanning Localization Method of a Mobile Robot Based on Ultrasonic Sensors , 2016, Sensors.

[4]  Adnan M. Abu-Mahfouz,et al.  Smart water meter system for user-centric consumption measurement , 2015, 2015 IEEE 13th International Conference on Industrial Informatics (INDIN).

[5]  Alper Bozkurt,et al.  Sound Localization Sensors for Search and Rescue Biobots , 2016, IEEE Sensors Journal.

[6]  Jiafu Wan,et al.  A time-recordable cross-layer communication protocol for the positioning of Vehicular Cyber-Physical Systems , 2016, Future Gener. Comput. Syst..

[7]  Michael R. M. Jenkin,et al.  Inertial Sensors, GPS, and Odometry , 2008, Springer Handbook of Robotics.

[8]  Alexander Buyval,et al.  Vision-based pose estimation for indoor navigation of unmanned micro aerial vehicle based on the 3D model of environment , 2015, 2015 International Conference on Mechanical Engineering, Automation and Control Systems (MEACS).

[9]  Karim Djouani,et al.  Toward developing a distributed autonomous energy management system (DAEMS) , 2015, AFRICON 2015.

[10]  Nicholas Gans,et al.  Localization through fusion of discrete and continuous epipolar geometry with wheel and IMU odometry , 2011, Proceedings of the 2011 American Control Conference.

[11]  Gerhard P. Hancke,et al.  Using Cognitive Radio for Interference-Resistant Industrial Wireless Sensor Networks: An Overview , 2015, IEEE Transactions on Industrial Informatics.

[12]  Gerhard P. Hancke,et al.  ns-2 extension to simulate localization system in wireless sensor networks , 2011, IEEE Africon '11.

[13]  Horst Bischof,et al.  Natural landmark-based monocular localization for MAVs , 2011, 2011 IEEE International Conference on Robotics and Automation.

[14]  A. Tanju Erdem,et al.  Fusing Inertial Sensor Data in an Extended Kalman Filter for 3D Camera Tracking , 2015, IEEE Transactions on Image Processing.

[15]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[16]  Tianmiao Wang,et al.  Monocular vision and IMU based navigation for a small unmanned helicopter , 2012, 2012 7th IEEE Conference on Industrial Electronics and Applications (ICIEA).

[17]  Hemendra Arya,et al.  Pose estimation for an autonomous vehicle using monocular vision , 2017, 2017 Indian Control Conference (ICC).

[18]  Gerhard P. Hancke,et al.  An Energy-Efficient Smart Comfort Sensing System Based on the IEEE 1451 Standard for Green Buildings , 2014, IEEE Sensors Journal.

[19]  B. J. Silva,et al.  Machine-to-Machine: Possible applications in industrial networks , 2013, 2013 IEEE International Conference on Industrial Technology (ICIT).

[20]  Gerhard P. Hancke,et al.  Rapid prototyping of a wireless sensor network gateway for the internet of things using off-the-shelf components , 2015, 2015 IEEE International Conference on Industrial Technology (ICIT).

[21]  Christophe Macabiau,et al.  Review and classification of vision-based localisation techniques in unknown environments , 2014 .

[22]  Michael R. M. Jenkin,et al.  Inertial Sensing, GPS and Odometry , 2016, Springer Handbook of Robotics, 2nd Ed..

[23]  Gerhard P. Hancke,et al.  Experimental Link Quality Characterization of Wireless Sensor Networks for Underground Monitoring , 2015, IEEE Transactions on Industrial Informatics.

[24]  Rehman Ullah Khan,et al.  Objects Tracking from Natural Features in Mobile Augmented Reality , 2013 .

[25]  Gerhard P. Hancke,et al.  Using NFC-enabled phones for remote data acquisition and digital control , 2011, IEEE Africon '11.