Automated Cinematography with Unmanned Aerial Vehicles

The rise of Unmanned Aerial Vehicles and their increasing use in the cinema industry calls for the creation of dedicated tools. Though there is a range of techniques to automatically control drones for a variety of applications, none have considered the problem of producing cinematographic camera motion in real-time for shooting purposes. In this paper we present our approach to UAV navigation for autonomous cinematography. The contributions of this research are twofold: (i) we adapt virtual camera control techniques to UAV navigation; (ii) we introduce a drone-independent platform for high-level user interactions that integrates cinematographic knowledge. The results presented in this paper demonstrate the capacities of our tool to capture live movie scenes involving one or two moving actors.

[1]  Steven D. Katz.  Film directing, shot by shot : visualizing from concept to screen , 1991 .

[2]  Andrew R. Parker,et al.  In The Blink Of An Eye , 2003 .

[3]  Vijay Kumar,et al.  Minimum snap trajectory generation and control for quadrotors , 2011, 2011 IEEE International Conference on Robotics and Automation.

[4]  Marc Christie,et al.  Efficient composition for virtual camera control , 2012, SCA '12.

[5]  Joseph V. Mascelli.  The five C's of cinematography : motion picture filming techniques simplified , 1965 .

[6]  Marc Pollefeys,et al.  PIXHAWK: A micro aerial vehicle design for autonomous flight using onboard computer vision , 2012, Auton. Robots.

[7]  Rémi Ronfard,et al.  Computational Model of Film Editing for Interactive Storytelling , 2011, ICIDS.

[8]  Markus H. Gross,et al.  Visibility Transition Planning for Dynamic Camera Control , 2010, MIG.

[9]  Rémi Ronfard,et al.  Steering Behaviors for Autonomous Cameras , 2013, MIG.

[10]  D. Arijon,et al.  Grammar of Film Language , 1976 .

[11]  Gustavo Mercado,et al.  The Filmmaker's Eye : Learning (and Breaking) the Rules of Cinematic Composition , 2013 .

[12]  Frédo Durand,et al.  Computational rim illumination with aerial robots , 2014, CAe@Expressive.

[13]  Éric Marchand,et al.  Chasing a moving target from a flying UAV , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[14]  Rémi Ronfard,et al.  The Prose Storyboard Language: A Tool for Annotating and Directing Movies , 2015, FDG 2015.

[15]  Nicolas Szilas,et al.  Narrative-driven camera control for cinematic replay of computer games , 2014, MIG.

[16]  Rémi Ronfard,et al.  Film Editing for Third Person Games and Machinima , 2012 .

[17]  Walter Murch.  In the Blink of an Eye , 2005 .

[18]  Vijay Kumar,et al.  Trajectory Generation and Control for Precise Aggressive Maneuvers with Quadrotors , 2010, ISER.

[19]  Pat Hanrahan,et al.  An interactive tool for designing quadrotor camera shots , 2015, ACM Trans. Graph..

[20]  Joan E. Hart,et al.  Film Directing Shot by Shot: Visualizing from Concept to Screen , 1991 .

[21]  Rémi Ronfard,et al.  Camera-on-rails: automated computation of constrained camera paths , 2015, MIG.

[22]  Christopher J. Bowen.  Grammar of the Edit , 1993 .

[23]  Jose-Ernesto Gomez-Balderas,et al.  Tracking a Ground Moving Target with a Quadrotor Using Switching Control , 2012, Journal of Intelligent & Robotic Systems.

[24]  Patrick Olivier,et al.  Camera Control in Computer Graphics , 2006, Eurographics.

[25]  Vijay Kumar,et al.  Cooperative Grasping and Transport Using Multiple Quadrotors , 2010, DARS.

[26]  Marc Christie,et al.  Intuitive and efficient camera control with the toric space , 2015, ACM Trans. Graph..

[27]  David Salesin,et al.  The virtual cinematographer: a paradigm for automatic real-time camera control and directing , 1996, SIGGRAPH.

[28]  Nicholas Roy,et al.  Towards A Swarm of Agile Micro Quadrotors , 2013 .

[29]  Marc Pollefeys,et al.  PIXHAWK: A system for autonomous flight using onboard computer vision , 2011, 2011 IEEE International Conference on Robotics and Automation.

[30]  Charles Richter,et al.  Polynomial Trajectory Planning for Aggressive Quadrotor Flight in Dense Indoor Environments , 2016, ISRR.

[31]  Roy Thompson,et al.  Grammar of the Shot , 1998 .