Computation and Communication Co-Design for Real-Time Monitoring and Control in Multi-Agent Systems

We investigate the problem of co-designing computation and communication in a multi-agent system (e.g., a sensor network or a multi-robot team). We consider the realistic setting where each agent acquires sensor data and is capable of local processing before sending updates to a base station, which is in charge of making decisions or monitoring phenomena of interest in real time. Longer processing at an agent leads to more informative updates but also larger delays, giving rise to a delay-accuracy trade-off in choosing the right amount of local processing at each agent. We assume that the available communication resources are limited due to interference, bandwidth, and power constraints. Thus, a scheduling policy needs to be designed to suitably share the communication channel among the agents. To that end, we develop a general formulation to jointly optimize the local processing at the agents and the scheduling of transmissions. Our novel formulation leverages the notion of Age of Information to quantify the freshness of data and capture the delays caused by computation and communication. We develop efficient resource allocation algorithms using the Whittle index approach and demonstrate our proposed algorithms in two practical applications: multi-agent occupancy grid mapping in time-varying environments, and ride sharing in autonomous vehicle networks. Our experiments show that the proposed codesign approach leads to a substantial performance improvement (18 – 82% in our tests).

[1]  Quoc V. Le,et al.  Searching for MobileNetV3 , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[2]  Alexei Makarenko,et al.  Information based adaptive robotic exploration , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[3]  Eytan Modiano,et al.  Scheduling Policies for Minimizing Age of Information in Broadcast Wireless Networks , 2018, IEEE/ACM Transactions on Networking.

[4]  Anthony Ephremides,et al.  On the Optimality of the Whittle’s Index Policy for Minimizing the Age of Information , 2020, IEEE Transactions on Wireless Communications.

[5]  Wolfram Burgard,et al.  Occupancy Grid Models for Robot Mapping in Changing Environments , 2012, AAAI.

[6]  Vangelis Angelakis,et al.  Age of Information: A New Concept, Metric, and Tool , 2018, Found. Trends Netw..

[7]  Yin Sun,et al.  Sampling for Remote Estimation through Queues: Age of Information and Beyond , 2019, 2019 International Symposium on Modeling and Optimization in Mobile, Ad Hoc, and Wireless Networks (WiOPT).

[8]  Jari Saarinen,et al.  Independent Markov chain occupancy grid maps for representation of dynamic environment , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[9]  Roy D. Yates,et al.  Real-time status: How often should one update? , 2012, 2012 Proceedings IEEE INFOCOM.

[10]  Eytan Modiano,et al.  A Whittle Index Approach to Minimizing Functions of Age of Information , 2019, 2019 57th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[11]  Mark Sandler,et al.  MobileNetV2: Inverted Residuals and Linear Bottlenecks , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[12]  Vaneet Aggarwal,et al.  DeepPool: Distributed Model-Free Algorithm for Ride-Sharing Using Deep Reinforcement Learning , 2019, IEEE Transactions on Intelligent Transportation Systems.

[13]  Ruggero Carli,et al.  Distributed Kalman filtering based on consensus strategies , 2008, IEEE Journal on Selected Areas in Communications.

[14]  Karl Henrik Johansson,et al.  Performance Characterization Using AoI in a Single-loop Networked Control System , 2019, IEEE INFOCOM 2019 - IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS).

[15]  Stephen P. Boyd,et al.  A scheme for robust distributed sensor fusion based on average consensus , 2005, IPSN 2005. Fourth International Symposium on Information Processing in Sensor Networks, 2005..

[16]  Vijay Kumar,et al.  Autonomous robotic exploration using occupancy grid maps and graph SLAM based on Shannon and Rényi Entropy , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[17]  Eytan Modiano,et al.  Age of Information: A New Metric for Information Freshness , 2019, Age of Information.

[18]  Xin Wang,et al.  Clipper: A Low-Latency Online Prediction Serving System , 2016, NSDI.

[19]  R. Weber,et al.  On an index policy for restless bandits , 1990, Journal of Applied Probability.

[20]  R. Olfati-Saber,et al.  Consensus Filters for Sensor Networks and Distributed Sensor Fusion , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[21]  Ali Farhadi,et al.  YOLOv3: An Incremental Improvement , 2018, ArXiv.

[22]  Tony Givargis,et al.  Priority Neuron: A Resource-Aware Neural Network for Cyber-Physical Systems , 2018, IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems.

[23]  Antonio LaTorre,et al.  A distributed VNS algorithm for optimizing dial-a-ride problems in large-scale scenarios , 2015 .

[24]  Marco Pavone,et al.  Network offloading policies for cloud robotics: a learning-based approach , 2019, Autonomous Robots.

[25]  Xiaowen Chu,et al.  Autonomous-Vehicle Public Transportation System: Scheduling and Admission Control , 2015, IEEE Transactions on Intelligent Transportation Systems.

[26]  Elif Uysal-Biyikoglu,et al.  Optimal Sampling and Remote Estimation of the Wiener Process over a Channel with Random Delay , 2017, ArXiv.

[27]  Eytan Modiano,et al.  Optimizing Information Freshness in Wireless Networks Under General Interference Constraints , 2018, IEEE/ACM Transactions on Networking.

[28]  Roy D. Yates,et al.  Update or wait: How to keep your data fresh , 2016, IEEE INFOCOM 2016 - The 35th Annual IEEE International Conference on Computer Communications.

[29]  L. Schenato,et al.  Computation-Communication Trade-Offs and Sensor Selection in Real-Time Estimation for Processing Networks , 2019, IEEE Transactions on Network Science and Engineering.

[30]  P. Whittle Restless Bandits: Activity Allocation in a Changing World , 1988 .

[31]  Wolfgang Kellerer,et al.  AoI-Penalty Minimization for Networked Control Systems with Packet Loss , 2019, IEEE INFOCOM 2019 - IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS).