The Sky Is Not the Limit: A Visual Performance Model for Cyber-Physical Co-Design in Autonomous Machines

We introduce the “Formula-1” (F-1) roofline model to understand the role of computing in aerial autonomous machines. The model provides insights by exploiting the fundamental relationships between various components in an aerial robot, such as sensor framerate, compute performance, and body dynamics (physics). F-1 serves as a tool that can aid computer and cyber-physical system architects to understand the optimal design (or selection) of various components in the development of autonomous machines.

[1]  Sergey Levine,et al.  (CAD)$^2$RL: Real Single-Image Flight without a Single Real Image , 2016, Robotics: Science and Systems.

[2]  Mark D. Hill,et al.  Gables: A Roofline Model for Mobile SoCs , 2019, 2019 IEEE International Symposium on High Performance Computer Architecture (HPCA).

[3]  Carlos R. del-Blanco,et al.  DroNet: Learning to Fly by Driving , 2018, IEEE Robotics and Automation Letters.

[4]  Samuel Williams,et al.  Roofline: an insightful visual performance model for multicore architectures , 2009, CACM.

[5]  Guido C. H. E. de Croon,et al.  Autonomous drone race: A computationally efficient vision-based navigation and control strategy , 2018, Robotics Auton. Syst..

[6]  Vijay Kumar,et al.  High speed navigation for quadrotors with limited onboard sensing , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[7]  Giuseppe Loianno,et al.  Special Issue on High‐Speed Vision‐Based Autonomous Navigation of UAVs , 2018, J. Field Robotics.

[8]  Vijay Kumar,et al.  Experiments in Fast, Autonomous, GPS-Denied Quadrotor Flight , 2018, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[9]  Nikolai Smolyanskiy,et al.  Toward low-flying autonomous MAV trail navigation using deep neural networks for environmental awareness , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[10]  Jeffrey Barkstrom,et al.  What is a Raspberry Pi? , 2019, Introduction to the Raspberry Pi.

[11]  Azer Bestavros,et al.  Neuroflight: Next Generation Flight Control Firmware , 2019, ArXiv.