MLAE2: Metareasoning for Latency-Aware Energy-Efficient Autonomous Nano-Drones

Safety, low-cost, small size, and Artificial Intelli-gence (AI) capabilities of drones have led to the proliferation of autonomous tiny Unmanned Aerial Vehicles (UAVs) in many applications which are dangerous, unknown, or time-consuming for humans. Deep Neural Networks (DNNs) have enabled au-tonomous navigation while using captured data by drone sensors as input to the model. Due to the extreme complexity of DNNs, cloud-based approaches have been highly addressed in which a drone is connected to the cloud and sends the data to the cloud, and takes the result. On the other hand, emerging tiny machine learning models and edge computing brings significant improvement in energy efficiency and latency with respect to cloud-based approaches. However, there is a trade-off in these two implementations for model accuracy, latency, and energy efficiency. For instance, applying tiny machine learning models leads to lower latency but it sacrifices model accuracy in comparison to cloud-based computing. To address these challenges, we consider multiple models and introduce a new approach named MLAE2 which applies Metareasoning approach for Latency-Aware Energy-Efficient autonomous drones. Metareasoning mon-itors parameters such as latency and energy consumption for different algorithms and chooses the appropriate algorithm due to the environmental situation changes. To Evaluate our approach we extract the power consumption and latency for both cloud-based computing and edge computing while deploying multiple models on a tiny drone named Crazyflie. The experimental results show that MLAE2 successfully meets the latency constraint while maximizing model accuracy and improving energy efficiency.

[1]  T. Mohsenin,et al.  E2EdgeAI: Energy-Efficient Edge Computing for Deployment of Vision-Based DNNs on Autonomous Tiny Drones , 2022, 2022 IEEE/ACM 7th Symposium on Edge Computing (SEC).

[2]  Nicholas R. Waytowich,et al.  Efficient Language-Guided Reinforcement Learning for Resource-Constrained Autonomous Systems , 2022, IEEE Micro.

[3]  Nicholas R. Waytowich,et al.  Towards an Interpretable Hierarchical Agent Framework using Semantic Goals , 2022, ArXiv.

[4]  L. Benini,et al.  WideVision: A Low-Power, Multi-Protocol Wireless Vision Platform for Distributed Surveillance , 2022, 2022 18th International Conference on Wireless and Mobile Computing, Networking and Communications (WiMob).

[5]  Madhusanka Liyanage,et al.  A Survey on the Convergence of Edge Computing and AI for UAVs: Opportunities and Challenges , 2022, IEEE Internet of Things Journal.

[6]  J. Herrmann,et al.  Metareasoning Approaches for Thermal Management During Image Processing , 2022, Volume 7: 46th Mechanisms and Robotics Conference (MR).

[7]  Nicholas R. Waytowich,et al.  An Optimization Framework for Efficient Vision-Based Autonomous Drone Navigation , 2022, 2022 IEEE 4th International Conference on Artificial Intelligence Circuits and Systems (AICAS).

[8]  Justine P. Caylor,et al.  Metareasoning for multi-criteria decision making using complex information sources , 2022, Defense + Commercial Sensing.

[9]  Tinoosh Mohsenin,et al.  QS-NAS: Optimally Quantized Scaled Architecture Search to Enable Efficient On-Device Micro-AI , 2021, IEEE Journal on Emerging and Selected Topics in Circuits and Systems.

[10]  Wilfred Gomes,et al.  MC-CIM: Compute-in-Memory With Monte-Carlo Dropouts for Bayesian Edge Intelligence , 2021, IEEE Transactions on Circuits and Systems I: Regular Papers.

[11]  Tim Oates,et al.  Automatic Goal Generation using Dynamical Distance Learning , 2021, ArXiv.

[12]  Tim Oates,et al.  Interactive Hierarchical Guidance using Language , 2021, ArXiv.

[13]  F. Faupel,et al.  Epileptic Seizure Detection on an Ultra-Low-Power Embedded RISC-V Processor Using a Convolutional Neural Network , 2021, Biosensors.

[14]  Xingxing Xiong,et al.  A Survey of Recent Advances in Edge-Computing-Powered Artificial Intelligence of Things , 2021, IEEE Internet of Things Journal.

[15]  Guido C. H. E. de Croon,et al.  Tiny Robot Learning (tinyRL) for Source Seeking on a Nano Quadcopter , 2021, 2021 IEEE International Conference on Robotics and Automation (ICRA).

[16]  Gouhei Tanaka,et al.  2021 Roadmap on Neuromorphic Computing and Engineering , 2021, ArXiv.

[17]  Siva Satyendra Sahoo,et al.  Reliability-Aware Resource Management in Multi-/Many-Core Systems: A Perspective Paper , 2021, Journal of Low Power Electronics and Applications.

[18]  Tinoosh Mohsenin,et al.  Neural Networks for Pulmonary Disease Diagnosis using Auditory and Demographic Information , 2020, ArXiv.

[19]  Michael Otte,et al.  Metareasoning Structures, Problems, and Modes for Multiagent Systems: A Survey , 2020, IEEE Access.

[20]  W. David Hairston,et al.  A Low-Power LSTM Processor for Multi-Channel Brain EEG Artifact Detection , 2020, 2020 21st International Symposium on Quality Electronic Design (ISQED).

[21]  Luca Benini,et al.  A 64-mW DNN-Based Visual Navigation Engine for Autonomous Nano-Drones , 2018, IEEE Internet of Things Journal.

[22]  Nezam Rohbani,et al.  A Low-Overhead Integrated Aging and SEU Sensor , 2018, IEEE Transactions on Device and Materials Reliability.

[23]  Suyog Gupta,et al.  To prune, or not to prune: exploring the efficacy of pruning for model compression , 2017, ICLR.

[24]  Rakefet Ackerman,et al.  Meta-Reasoning: Monitoring and Control of Thinking and Reasoning , 2017, Trends in Cognitive Sciences.

[25]  Bo Chen,et al.  MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications , 2017, ArXiv.

[26]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[27]  Anita Raja,et al.  Metareasoning - Thinking about Thinking , 2011, Metareasoning.

[28]  Nicholas R. Waytowich,et al.  Toward Real-World Implementation of Deep Reinforcement Learning for Vision-Based Autonomous Drone Navigation with Mission , 2022 .

[29]  S. Zilberstein,et al.  Using Metareasoning to Maintain and Restore Safety for Reliably Autonomy , 2021 .

[30]  Michael W. Otte,et al.  Communication-Aware Multi-Agent Metareasoning for Decentralized Task Allocation , 2021, IEEE Access.

[31]  Tim Oates,et al.  Guiding Safe Reinforcement Learning Policies Using Structured Language Constraints , 2020, SafeAI@AAAI.