Employing smartphone as on-board navigator in unmanned aerial vehicles: implementation and experiments

Purpose – This study aims to investigate if smartphone sensors can be used in an unmanned aerial vehicle (UAV) localization system. With the development of technology, smartphones have been tentatively used in micro-UAVs due to their lightweight, inexpensiveness and flexibility. In this study, a Samsung Galaxy S3 smartphone is selected as an on-board sensor platform for UAV localization in Global Positioning System (GPS)-denied environments and two main issues are investigated: Are the phone sensors appropriate for UAV localization? If yes, what are the boundary conditions of employing them? Design/methodology/approach – Efficient accuracy estimation methodologies for the phone sensors are proposed without using any expensive instruments. Using these methods, one can estimate his phone sensors accuracy at any time without special instruments. Then, a visual-inertial odometry scheme is introduced to evaluate the phone sensors-based path estimation performance. Findings – Boundary conditions of using smartp...

[1]  Davide Scaramuzza,et al.  SVO: Fast semi-direct monocular visual odometry , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[2]  Andrey Soloviev,et al.  Fusion of inertial, optical flow, and airspeed measurements for UAV navigation in GPS-denied environments , 2009, Defense + Commercial Sensing.

[3]  Kenzo Nonami,et al.  Optic flow-based vision system for autonomous 3D localization and control of small aerial vehicles , 2009, Robotics Auton. Syst..

[4]  Andreas Zell,et al.  Flyphone: Visual Self-Localisation Using a Mobile Phone as Onboard Image Processor on a Quadrocopter , 2010, J. Intell. Robotic Syst..

[5]  Tianmiao Wang,et al.  Rao-Blackwellized visual SLAM for small UAVs with vehicle model partition , 2014, Ind. Robot.

[6]  Anastasios I. Mourikis,et al.  Real-time motion tracking on a cellphone using inertial sensing and a rolling-shutter camera , 2013, 2013 IEEE International Conference on Robotics and Automation.

[7]  S. Shankar Sastry,et al.  An Invitation to 3-D Vision , 2004 .

[8]  Dieter Schmalstieg,et al.  Pose tracking from natural features on mobile phones , 2008, 2008 7th IEEE/ACM International Symposium on Mixed and Augmented Reality.

[9]  Christian Laugier,et al.  2-Point-based outlier rejection for camera-IMU systems with applications to micro aerial vehicles , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[10]  Sauro Longhi,et al.  An IMU/UWB/Vision-based Extended Kalman Filter for Mini-UAV Localization in Indoor Environment using 802.15.4a Wireless Sensor Network , 2012, Journal of Intelligent & Robotic Systems.

[11]  Salah Sukkarieh,et al.  Vehicle Model Aided Inertial Navigation For A Uav Using Low-Cost Sensors , 2004 .

[12]  Feng Lin,et al.  Homography-based Vision-aided Inertial Navigation of UAVs in Unknown Environments , 2012 .

[13]  Jean-Yves Bouguet,et al.  Camera calibration toolbox for matlab , 2001 .

[14]  Chuluong Choi,et al.  APPLICATION POSSIBILITY OF SMARTPHONE AS PAYLOAD FOR PHOTOGRAMMETRIC UAV SYSTEM , 2012 .

[15]  Roland Siegwart,et al.  Monocular Vision for Long‐term Micro Aerial Vehicle State Estimation: A Compendium , 2013, J. Field Robotics.

[16]  Jin-Soo Kim,et al.  Feasibility of employing a smartphone as the payload in a photogrammetric UAV system , 2013 .