An autonomous flyer photographer

In this paper we explore the combination of a latest generation mobile device and a micro quadrotor platform to perform indoor autonomous navigation for the purpose of autonomous photography. We use the Yellowstone tablet from Google's Tango project [1], equipped with onboard, fully integrated sensing platform and with significant computational capability. To the best of our knowledge we are the first to exploit the Google's Tango tablet as source of pose estimate to control the quadrotor's motion. Using the tablet's onboard camera the system is able to detect people and generate a desired pose that the quadrotor will have to reach in order to take a well framed picture of the detected subject. The experimental results and live video demonstrate the capabilities of the autonomous flying robot photographer using the system described throughout this manuscript.

[1]  Roland Siegwart,et al.  Vision based MAV navigation in unknown and unstructured environments , 2010, 2010 IEEE International Conference on Robotics and Automation.

[2]  Padmanabhan Pillai,et al.  Leveraging Limited Autonomous Mobility to Frame Attractive Group Photos , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[3]  Lorenzo Marconi,et al.  A smartphone based quadrotor: Attitude and position estimation , 2015, 2015 International Conference on Unmanned Aircraft Systems (ICUAS).

[4]  Jizhong Xiao,et al.  An open-source navigation system for micro aerial vehicles , 2013, Auton. Robots.

[5]  Stephen Cameron,et al.  Luke: An autonomous robot photographer , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[6]  Jeffrey L. Krichmar,et al.  Smartphone Based Robotics : Powerful , Flexible and Inexpensive Robots for Hobbyists , Educators , Students and Researchers , 2013 .

[7]  Hannes Bergkvist,et al.  Quadcopter Control using Android-based Sensing , 2013 .

[8]  Dimitrios G. Kottas,et al.  Efficient Visual-Inertial Navigation using a Rolling-Shutter Camera with Inaccurate Timestamps , 2014, Robotics: Science and Systems.

[9]  Roland Siegwart,et al.  Onboard IMU and monocular vision based control for MAVs in unknown in- and outdoor environments , 2011, 2011 IEEE International Conference on Robotics and Automation.

[10]  Michael Bosse,et al.  The gist of maps - summarizing experience for lifelong localization , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[11]  Vijay Kumar,et al.  Flying Smartphones: Automated Flight Enabled by Consumer Electronics , 2015, IEEE Robotics & Automation Magazine.

[12]  Stergios I. Roumeliotis,et al.  A Multi-State Constraint Kalman Filter for Vision-aided Inertial Navigation , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[13]  Marc Pollefeys,et al.  PIXHAWK: A micro aerial vehicle design for autonomous flight using onboard computer vision , 2012, Auton. Robots.

[14]  Siddhartha S. Srinivasa,et al.  Chisel: Real Time Large Scale 3D Reconstruction Onboard a Mobile Device using Spatially Hashed Signed Distance Fields , 2015, Robotics: Science and Systems.

[15]  Jeffrey L. Krichmar,et al.  Neuromodulation, attention and localization using a novel Android™ robotic platform , 2012, 2012 IEEE International Conference on Development and Learning and Epigenetic Robotics (ICDL).

[16]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[17]  Annette Mossel,et al.  Autonomous Flight using a Smartphone as On-Board Processing Unit in GPS-Denied Environments , 2013, MoMM '13.

[18]  Yubin Lan,et al.  Development and prospect of unmanned aerial vehicle technologies for agricultural production management , 2013 .

[19]  Marc Pollefeys,et al.  Vision-based autonomous mapping and exploration using a quadrotor MAV , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[20]  William D. Smart,et al.  An autonomous robot photographer , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[21]  Richard E. Brazier,et al.  Aerial photography collected with a multirotor drone reveals impact of Eurasian beaver reintroduction on ecosystem structure1 , 2015 .

[22]  R. Lozano,et al.  Stereo vision for the stabilization of a quadrotor , 2012, 2012 16th International Conference on System Theory, Control and Computing (ICSTCC).

[23]  Torsten Sattler,et al.  3D Modeling on the Go: Interactive 3D Reconstruction of Large-Scale Scenes on Mobile Devices , 2015, 2015 International Conference on 3D Vision.

[24]  Jae Wook Jeon,et al.  Automatically available photographer robot for controlling composition and taking pictures , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[25]  Larry H. Matthies,et al.  Vision Guided Landing of an Autonomous Helicopter in Hazardous Terrain , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[26]  Anastasios I. Mourikis,et al.  Real-time motion tracking on a cellphone using inertial sensing and a rolling-shutter camera , 2013, 2013 IEEE International Conference on Robotics and Automation.

[27]  Michael Bosse,et al.  Get Out of My Lab: Large-scale, Real-Time Visual-Inertial Localization , 2015, Robotics: Science and Systems.

[28]  Morgan Quigley,et al.  ROS: an open-source Robot Operating System , 2009, ICRA 2009.

[29]  Jizhong Xiao,et al.  Autonomous quadrotor flight using onboard RGB-D visual odometry , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[30]  Albert S. Huang,et al.  Visual Odometry and Mapping for Autonomous Flight Using an RGB-D Camera , 2011, ISRR.

[31]  Wolfram Burgard,et al.  A Fully Autonomous Indoor Quadrotor , 2012, IEEE Transactions on Robotics.

[32]  Ho Seok Ahn,et al.  Visual 3D Model-based Tracking toward Autonomous Live Sports Broadcasting using a VTOL Unmanned Aerial Vehicle in GPS-impaired Environments , 2015 .