Airways: Optimization-Based Planning of Quadrotor Trajectories according to High-Level User Goals

In this paper we propose a computational design tool that allows end-users to create advanced quadrotor trajectories with a variety of application scenarios in mind. Our algorithm allows novice users to create quadrotor based use-cases without requiring deep knowledge in either quadrotor control or the underlying constraints of the target domain. To achieve this goal we propose an optimization-based method that generates feasible trajectories which can be flown in the real world. Furthermore, the method incorporates high-level human objectives into the planning of flight trajectories. An easy to use 3D design tool allows for quick specification and editing of trajectories as well as for intuitive exploration of the resulting solution space. We demonstrate the utility of our approach in several real-world application scenarios, including aerial-videography, robotic light-painting and drone racing.

[1]  Keita Higuchi,et al.  Flying head: head-synchronized unmanned aerial vehicle control for flying telepresence , 2012, SIGGRAPH 2012.

[2]  Richard Szeliski,et al.  First-person hyper-lapse videos , 2014, ACM Trans. Graph..

[3]  Joseph V. Mascelli The five C's of cinematography : motion picture filming techniques simplified , 1965 .

[4]  Marc Pollefeys,et al.  PIXHAWK: A micro aerial vehicle design for autonomous flight using onboard computer vision , 2012, Auton. Robots.

[5]  Patrick Olivier,et al.  Virtual Camera Planning: A Survey , 2005, Smart Graphics.

[6]  T. Flash,et al.  The coordination of arm movements: an experimentally confirmed mathematical model , 1985, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[7]  R. Murray,et al.  Trajectory Planning of Differentially Flat Systems with Dynamics and Inequalities , 2000 .

[8]  Vijay Kumar,et al.  Minimum snap trajectory generation and control for quadrotors , 2011, 2011 IEEE International Conference on Robotics and Automation.

[9]  Michael Gleicher,et al.  Re-cinematography: Improving the camerawork of casual video , 2008, TOMCCAP.

[10]  Takeo Igarashi,et al.  Sketch and run: a stroke-based interface for home robots , 2009, CHI.

[11]  Ernest Callenbach : The Five C's of Cinematography: Motion Picture Filming Techniques Simplified . Joseph V. Mascelli. , 1966 .

[12]  Takeo Igarashi,et al.  Pteromys: interactive design and optimization of free-formed free-flight model airplanes , 2014, ACM Trans. Graph..

[13]  Takeo Igarashi,et al.  Roboshop: multi-layered sketching interface for robot housework assignment and management , 2011, CHI.

[14]  Keita Higuchi,et al.  HoverBall: augmented sports with a flying ball , 2014, AH.

[15]  Peter I. Corke,et al.  Multirotor Aerial Vehicles: Modeling, Estimation, and Control of Quadrotor , 2012, IEEE Robotics & Automation Magazine.

[16]  Nobuyuki Umetani,et al.  OmniAD: data-driven omni-directional aerodynamics , 2015, ACM Trans. Graph..

[17]  Keita Higuchi,et al.  Flying sports assistant: external visual imagery representation for sports training , 2011, AH '11.

[18]  Paul A. Beardsley,et al.  Collision avoidance for aerial vehicles in multi-agent scenarios , 2015, Auton. Robots.

[19]  Irfan A. Essa,et al.  Auto-directed video stabilization with robust L1 optimal camera paths , 2011, CVPR 2011.

[20]  Florian Mueller,et al.  Jogging with a Quadcopter , 2015, CHI.

[21]  Pat Hanrahan,et al.  An interactive tool for designing quadrotor camera shots , 2015, ACM Trans. Graph..

[22]  Daniel Cremers,et al.  FollowMe: Person following and gesture recognition with a quadrocopter , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[23]  Yuta Sugiura,et al.  RoboJockey: Designing an Entertainment Experience with Robots , 2016, IEEE Computer Graphics and Applications.

[24]  Jian Sun,et al.  Bundled camera paths for video stabilization , 2013, ACM Trans. Graph..

[25]  Tsai-Yen Li,et al.  Real-Time Camera Planning for Navigation in Virtual Environments , 2008, Smart Graphics.

[26]  Chao-Hung Lin,et al.  Efficient camera path planning algorithm for human motion overview , 2011, Comput. Animat. Virtual Worlds.

[27]  Jürgen Scheible,et al.  Displaydrone: a flying robot based interactive display , 2013, PerDis.

[28]  Takeo Igarashi,et al.  Phybots: a toolkit for making robotic things , 2012, DIS '12.

[29]  Kentaro Ishii,et al.  Magic cards: a paper tag interface for implicit robot control , 2009, CHI.

[30]  Raffaello D'Andrea,et al.  Adaptive fast open-loop maneuvers for quadrocopters , 2012, Auton. Robots.

[31]  T. J. Diaz Lights, drone... action , 2015, IEEE Spectrum.

[32]  Manfred Morari,et al.  Environment-independent formation flight for micro aerial vehicles , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[33]  Taeyoung Lee,et al.  Nonlinear robust tracking control of a quadrotor UAV on SE(3) , 2011, 2012 American Control Conference (ACC).