2D monocular visual odometry using mobile-phone sensors

Smartphone equipped with a high-resolution camera and a variety of motion sensors is a lightweight, inexpensive, and flexible choice for micro-unmanned aerial vehicles (micro-UAVs) payloads. In this study, a Samsung Galaxy S3 smartphone is selected as an on-board sensor platform for UAV localization in an environment that does not have the option of Global Positioning System (GPS)-based navigation. A multi-sensor UAV localization scheme is proposed and developed by using the phone built-in camera, pressure sensor, and orientation sensor. The proposed method does not have to reconstruct an environment map. Furthermore, both indoor and outdoor experiments are carried out based on a robot arm and an eight-rotor UAV, respectively. Experimental results validate the effectiveness of the implemented scheme and corresponding algorithms. A video of this work is available at pan.baidu.com/s/10IwQM.

[1]  Carlos Hernández,et al.  Video-based, real-time multi-view stereo , 2011, Image Vis. Comput..

[2]  Jean-Yves Bouguet,et al.  Camera calibration toolbox for matlab , 2001 .

[3]  Roland Siegwart,et al.  Monocular‐SLAM–based navigation for autonomous micro helicopters in GPS‐denied environments , 2011, J. Field Robotics.

[4]  Kenzo Nonami,et al.  Optic flow-based vision system for autonomous 3D localization and control of small aerial vehicles , 2009, Robotics Auton. Syst..

[5]  Luis Puig,et al.  MEVO: Multi-environment stereo visual odometry , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[6]  Roland Siegwart,et al.  Robust Real-Time Visual Odometry with a Single Camera and an IMU , 2011, BMVC.

[7]  Daniel Cremers,et al.  Semi-dense Visual Odometry for a Monocular Camera , 2013, 2013 IEEE International Conference on Computer Vision.

[8]  S. Shankar Sastry,et al.  An Invitation to 3-D Vision: From Images to Geometric Models , 2003 .

[9]  Davide Scaramuzza,et al.  SVO: Fast semi-direct monocular visual odometry , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[10]  G. Klein,et al.  Parallel Tracking and Mapping for Small AR Workspaces , 2007, 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality.

[11]  Sauro Longhi,et al.  An IMU/UWB/Vision-based Extended Kalman Filter for Mini-UAV Localization in Indoor Environment using 802.15.4a Wireless Sensor Network , 2012, Journal of Intelligent & Robotic Systems.

[12]  Heinrich H. Bülthoff,et al.  Robust optical-flow based self-motion estimation for a quadrotor UAV , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[13]  政子 鶴岡,et al.  1998 IEEE International Conference on SMCに参加して , 1998 .