Beyond Robustness: A Taxonomy of Approaches towards Resilient Multi-Robot Systems

Robustness is key to engineering, automation, and science as a whole. However, the property of robustness is often underpinned by costly requirements such as over-provisioning, known uncertainty and predictive models, and known adversaries. These conditions are idealistic, and often not satisfiable. Resilience on the other hand is the capability to endure unexpected disruptions, to recover swiftly from negative events, and bounce back to normality. In this survey article, we analyze how resilience is achieved in networks of agents and multirobot systems that are able to overcome adversity by leveraging system-wide complementarity, diversity, and redundancy—often involving a reconfiguration of robotic capabilities to provide some key ability that was not present in the system a priori. As society increasingly depends on connected automated systems to provide key infrastructure services (e.g., logistics, transport, and precision agriculture), providing the means to achieving resilient multi-robot systems is paramount. By enumerating the consequences of a system that is not resilient (fragile), we argue that resilience must become a central engineering design consideration. Towards this goal, the community needs to gain clarity on how it is defined, measured, and maintained. We address these questions across foundational robotics domains, spanning perception, control, planning, and learning. One of our key contributions is a formal taxonomy of approaches, which also helps us discuss the defining factors and stressors for a resilient system. Finally, this survey article gives insight as to how resilience may be achieved. Importantly, we highlight open problems that remain to be tackled in order to reap the benefits of resilient robotic systems.

[1]  Nassim Nicholas Taleb,et al.  The Black Swan: The Impact of the Highly Improbable , 2007 .

[2]  Nicola Basilico,et al.  Extending Algorithms for Mobile Robot Patrolling in the Presence of Adversaries to More Realistic Settings , 2009, 2009 IEEE/WIC/ACM International Joint Conference on Web Intelligence and Intelligent Agent Technology.

[3]  Peter Stone,et al.  Recent advances in leveraging human guidance for sequential decision-making tasks , 2021, Autonomous Agents and Multi-Agent Systems.

[4]  Siddharth Mayya,et al.  A Resilient and Energy-Aware Task Allocation Framework for Heterogeneous Multirobot Systems , 2021, IEEE Transactions on Robotics.

[5]  Munther A. Dahleh,et al.  Scheduling Continuous-Time Kalman Filters , 2011, IEEE Transactions on Automatic Control.

[6]  Brian M. Sadler,et al.  Scalable Perception-Action-Communication Loops With Convolutional and Graph Neural Networks , 2021, IEEE Transactions on Signal and Information Processing over Networks.

[7]  Hod Lipson,et al.  On the Difficulty of Co-Optimizing Morphology and Control in Evolved Virtual Creatures , 2016, ALIFE.

[8]  Frederik Mallmann-Trenn,et al.  Crowd Vetting: Rejecting Adversaries via Collaboration With Application to Multirobot Flocking , 2020, IEEE Transactions on Robotics.

[9]  George J. Pappas,et al.  Resilient Monotone Sequential Maximization , 2018, 2018 IEEE Conference on Decision and Control (CDC).

[10]  Yijun He,et al.  A Fleet of Miniature Cars for Experiments in Cooperative Driving , 2019, 2019 International Conference on Robotics and Automation (ICRA).

[11]  Richard M. Murray,et al.  On a stochastic sensor selection algorithm with applications in sensor scheduling and sensor coverage , 2006, Autom..

[12]  A. Boucot,et al.  The complexity and stability of ecosystems , 1985, Nature.

[13]  Vijay Kumar,et al.  The grand challenges of Science Robotics , 2018, Science Robotics.

[14]  Davide Scaramuzza,et al.  Air-ground localization and map augmentation using monocular dense reconstruction , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[15]  Zhe Liu,et al.  Message-Aware Graph Attention Networks for Large-Scale Multi-Robot Path Planning , 2021, IEEE Robotics and Automation Letters.

[16]  Roman Barták,et al.  Robust Multi-Agent Path Finding and Executing , 2020, J. Artif. Intell. Res..

[17]  Michael J. Black,et al.  On the unification of line processes, outlier rejection, and robust statistics with applications in early vision , 1996, International Journal of Computer Vision.

[18]  Pratap Tokekar,et al.  Distributed Resilient Submodular Action Selection in Adversarial Environments , 2021, IEEE Robotics and Automation Letters.

[19]  Jonathan T. Barron,et al.  A General and Adaptive Robust Loss Function , 2017, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[20]  Sebastian Thrun,et al.  Multi-robot SLAM with Sparse Extended Information Filers , 2003, ISRR.

[21]  F. Hampel A General Qualitative Definition of Robustness , 1971 .

[22]  Jonathan P. How,et al.  Talk Resource-Efficiently to Me: Optimal Communication Planning for Distributed Loop Closure Detection , 2017, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[23]  Vijay Kumar,et al.  Time scales and stability in networked multi-robot systems , 2011, 2011 IEEE International Conference on Robotics and Automation.

[24]  Peter Stone,et al.  Agents teaching agents: a survey on inter-agent transfer learning , 2019, Autonomous Agents and Multi-Agent Systems.

[25]  Vijay Kumar,et al.  Robust Control for Mobility and Wireless Communication in Cyber–Physical Systems With Application to Robot Teams , 2012, Proceedings of the IEEE.

[26]  Fathi E. Abd El-Samie,et al.  A survey on online learning for visual tracking , 2020, The Visual Computer.

[27]  Risk-Aware Submodular Optimization for Multi-objective Travelling Salesperson Problem , 2020, ArXiv.

[28]  Changjoo Nam,et al.  Analyzing the Sensitivity of the Optimal Assignment in Probabilistic Multi-Robot Task Allocation , 2017, IEEE Robotics and Automation Letters.

[29]  Sameera S. Ponda,et al.  Distributed chance-constrained task allocation for autonomous multi-agent teams , 2012, 2012 American Control Conference (ACC).

[30]  Yi Wu,et al.  Multi-Agent Actor-Critic for Mixed Cooperative-Competitive Environments , 2017, NIPS.

[31]  Francisco Ramos,et al.  Ontology based design, control and programming of modular robots , 2018, Integr. Comput. Aided Eng..

[32]  Woosik Lee,et al.  Visual-Inertial-Wheel Odometry with Online Calibration , 2020, 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[33]  Jonathan P. How,et al.  Cooperative Distributed Robust Trajectory Optimization Using Receding Horizon MILP , 2011, IEEE Transactions on Control Systems Technology.

[34]  Amanda Prorok,et al.  Redundant Robot Assignment on Graphs with Uncertain Edge Costs , 2018, DARS.

[35]  Robustness , 2020, The Science of Quantitative Information Flow.

[36]  S. Sariel-Talay,et al.  Multiple Traveling Robot Problem: A Solution Based on Dynamic Task Selection and Robust Execution , 2009, IEEE/ASME Transactions on Mechatronics.

[37]  George J. Pappas,et al.  Resilient monotone submodular function maximization , 2017, 2017 IEEE 56th Annual Conference on Decision and Control (CDC).

[38]  B. Moor,et al.  Mixed integer programming for multi-vehicle path planning , 2001, 2001 European Control Conference (ECC).

[39]  J. F. Boudet,et al.  From collections of independent, mindless robots to flexible, mobile, and directional superstructures , 2021, Science Robotics.

[40]  Hannes Hartenstein,et al.  Inter-vehicle communication: Quo vadis , 2014, IEEE Communications Magazine.

[41]  Luca Carlone,et al.  Robot Co-design: Beyond the Monotone Case , 2019, 2019 International Conference on Robotics and Automation (ICRA).

[42]  John Enright,et al.  Optimization and Coordinated Autonomy in Mobile Fulfillment Systems , 2011, Automated Action Planning for Autonomous Mobile Robots.

[43]  Ekram Hossain,et al.  Federated Learning in Unreliable and Resource-Constrained Cellular Wireless Networks , 2020, IEEE Transactions on Communications.

[44]  André Crosnier,et al.  Collaborative manufacturing with physical human–robot interaction , 2016 .

[45]  Daniela Rus,et al.  Integrated Codesign of Printable Robots , 2015 .

[46]  Alice E. Smith,et al.  Efficiently Solving the Redundancy Allocation Problem Using Tabu Search , 2003 .

[47]  Wolfram Burgard,et al.  Robust map optimization using dynamic covariance scaling , 2013, 2013 IEEE International Conference on Robotics and Automation.

[48]  Jean-Jacques E. Slotine,et al.  The Robust Control of Robot Manipulators , 1985 .

[49]  John J. Leonard,et al.  Past, Present, and Future of Simultaneous Localization and Mapping: Toward the Robust-Perception Age , 2016, IEEE Transactions on Robotics.

[50]  John Doyle,et al.  Rules of engagement , 2007, Nature.

[51]  Heng Yang,et al.  Graduated Non-Convexity for Robust Spatial Perception: From Non-Minimal Solvers to Global Outlier Rejection , 2020, IEEE Robotics and Automation Letters.

[52]  Gary Hewer,et al.  An Efficient Algorithm for Optimal Trajectory Generation for Heterogeneous Multi-Agent Systems in Non-Convex Environments , 2018, IEEE Robotics and Automation Letters.

[53]  Jorge Cortes,et al.  Coordinated Control of Multi-Robot Systems: A Survey , 2017 .

[54]  Jorge Cortés,et al.  Time-invariant versus time-varying actuator scheduling in complex networks , 2017, 2017 American Control Conference (ACC).

[55]  Vijay Kumar,et al.  Design Guarantees for Resilient Robot Formations on Lattices , 2019, IEEE Robotics and Automation Letters.

[56]  Vijay Kumar,et al.  Robust Control of Mobility and Communications in Autonomous Robot Teams , 2013, IEEE Access.

[57]  Stephanie Gil,et al.  Switching Topology for Resilient Consensus using Wi-Fi Signals , 2019, 2019 International Conference on Robotics and Automation (ICRA).

[58]  Gaurav S. Sukhatme,et al.  Resilience by Reconfiguration: Exploiting Heterogeneity in Robot Teams , 2019, 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[59]  S. Zucker,et al.  Toward Efficient Trajectory Planning: The Path-Velocity Decomposition , 1986 .

[60]  Thomas A. Henzinger,et al.  Outside the Box: Abstraction-Based Monitoring of Neural Networks , 2019, ECAI.

[61]  Wolfram Burgard,et al.  Finding and Optimizing Solvable Priority Schemes for Decoupled Path Planning Techniques for Teams of Mobile Robots , 2002, PuK.

[62]  John Lygeros,et al.  On Submodularity and Controllability in Complex Dynamical Networks , 2014, IEEE Transactions on Control of Network Systems.

[63]  James Usevitch,et al.  Resilient Leader-Follower Consensus to Arbitrary Reference Values , 2018, 2018 Annual American Control Conference (ACC).

[64]  Shreyas Sundaram,et al.  Distributed Function Calculation via Linear Iterative Strategies in the Presence of Malicious Agents , 2011, IEEE Transactions on Automatic Control.

[65]  Vijay Kumar,et al.  The Impact of Diversity on Optimal Control Policies for Heterogeneous Robot Swarms , 2017, IEEE Transactions on Robotics.

[66]  Jingchuan Wang,et al.  A prioritized planning algorithm of trajectory coordination based on time windows for multiple AGVs with delay disturbance , 2019, Assembly Automation.

[67]  Luca Carlone,et al.  Online Monitoring for Neural Network Based Monocular Pedestrian Pose Estimation , 2020, 2020 IEEE 23rd International Conference on Intelligent Transportation Systems (ITSC).

[68]  Guy Theraulaz,et al.  Swarm Robotics: Past, Present, and Future , 2021, Proc. IEEE.

[69]  Mansour Eslami,et al.  Robust adaptive controller designs for robot manipulator systems , 1987, IEEE J. Robotics Autom..

[70]  Niko Sünderhauf,et al.  Switchable constraints vs. max-mixture models vs. RRR - A comparison of three approaches to robust pose graph SLAM , 2013, 2013 IEEE International Conference on Robotics and Automation.

[71]  Wenhao Wu,et al.  Multi-Agent Reinforcement Learning Based Frame Sampling for Effective Untrimmed Video Recognition , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[72]  Jordan B. Pollack,et al.  TITLE : Generative Representations for the Automated Design of Modular Physical Robots , 2003 .

[73]  Titus Cieslewski,et al.  Efficient Decentralized Visual Place Recognition Using a Distributed Inverted Index , 2017, IEEE Robotics and Automation Letters.

[74]  Siddharth Mayya,et al.  Adaptive Task Allocation for Heterogeneous Multi-Robot Teams with Evolving and Unknown Robot Capabilities , 2020, 2020 IEEE International Conference on Robotics and Automation (ICRA).

[75]  C. S. Holling Engineering Resilience versus Ecological Resilience , 1996 .

[76]  Mingxi Cheng,et al.  A General Trust Framework for Multi-Agent Systems , 2021, AAMAS.

[77]  Jonathan P. How,et al.  Deep Decentralized Multi-task Multi-Agent Reinforcement Learning under Partial Observability , 2017, ICML.

[78]  Stephen P. Boyd,et al.  Sensor Selection via Convex Optimization , 2009, IEEE Transactions on Signal Processing.

[79]  Titus Cieslewski,et al.  Efficient decentralized visual place recognition from full-image descriptors , 2017, 2017 International Symposium on Multi-Robot and Multi-Agent Systems (MRS).

[80]  Jonathan P. How,et al.  Near-Optimal Budgeted Data Exchange for Distributed Loop Closure Detection , 2018, Robotics: Science and Systems.

[81]  Robert E. Skelton,et al.  Integrating Information Architecture and Control or Estimation Design , 2008 .

[82]  Henrik Sandberg,et al.  SDP-based joint sensor and controller design for information-regularized optimal LQG control , 2015, 2015 54th IEEE Conference on Decision and Control (CDC).

[83]  Fernando Nobre,et al.  Multi-Sensor SLAM with Online Self-Calibration and Change Detection , 2016, ISER.

[84]  Giuseppe Carlo Calafiore,et al.  Multi-agent localization from noisy relative pose measurements , 2011, 2011 IEEE International Conference on Robotics and Automation.

[85]  Neville Hogan,et al.  Robust control of dynamically interacting systems , 1988 .

[86]  Manuela M. Veloso,et al.  Towards collaborative and adversarial learning: a case study in robotic soccer , 1998, Int. J. Hum. Comput. Stud..

[87]  Roman Barták,et al.  Robust Multi-Agent Path Finding , 2018, SOCS.

[88]  Mauro Birattari,et al.  Swarm SLAM: Challenges and Perspectives , 2021, Frontiers in Robotics and AI.

[89]  Paul A. Beardsley,et al.  Reciprocal collision avoidance for multiple car-like robots , 2012, 2012 IEEE International Conference on Robotics and Automation.

[90]  Vijay Kumar,et al.  Graph Policy Gradients for Large Scale Robot Control , 2019, CoRL.

[91]  David M. Bossens,et al.  Rapidly adapting robot swarms with Swarm Map-based Bayesian Optimisation , 2020, 2021 IEEE International Conference on Robotics and Automation (ICRA).

[92]  Roland Siegwart,et al.  Unified temporal and spatial calibration for multi-sensor systems , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[93]  Andreas Krause,et al.  Online distributed sensor selection , 2010, IPSN '10.

[94]  Aleksander Madry,et al.  Towards Deep Learning Models Resistant to Adversarial Attacks , 2017, ICLR.

[95]  Stephen L. Smith,et al.  Submodularity and greedy algorithms in sensor scheduling for linear dynamical systems , 2015, Autom..

[96]  Vijay Kumar,et al.  Triangular Networks for Resilient Formations , 2016, DARS.

[97]  N. Kobayashi,et al.  Adam Smith and the‘invisible hand’ , 1996 .

[98]  Niklaus Kohler,et al.  Resilience in the built environment , 2014 .

[99]  Amanda Prorok Graph Neural Networks for Learning Robot Team Coordination , 2018, ArXiv.

[100]  Pratap Tokekar,et al.  Risk-Aware Planning and Assignment for Ground Vehicles using Uncertain Perception from Aerial Vehicles , 2020, ArXiv.

[101]  Gaurav S. Sukhatme,et al.  Resilient Monitoring in Heterogeneous Multi-Robot Systems Through Network Reconfiguration , 2020, IEEE Transactions on Robotics.

[102]  Pratap Tokekar,et al.  Robust Multiple-Path Orienteering Problem: Securing Against Adversarial Attacks , 2020, Robotics: Science and Systems.

[103]  Sekhar Tatikonda,et al.  Control under communication constraints , 2004, IEEE Transactions on Automatic Control.

[104]  J. Hespanha,et al.  Estimation on graphs from relative measurements , 2007, IEEE Control Systems.

[105]  Roni Stern,et al.  Probabilistic Robust Multi-Agent Path Finding , 2020, SOCS.

[106]  Jan Faigl,et al.  Asynchronous decentralized prioritized planning for coordination in multi-robot system , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[107]  Pratap Tokekar,et al.  Improved Resilient Coverage Maximization with Multiple Robots , 2020, ArXiv.

[108]  Jonathan P. How,et al.  LION: Lidar-Inertial Observability-Aware Navigator for Vision-Denied Environments , 2021, ISER.

[109]  Vijay Kumar,et al.  Realization of $r$ -Robust Formations in the Plane Using Control Barrier Functions , 2020, IEEE Control Systems Letters.

[110]  Amanda Prorok,et al.  The Emergence of Adversarial Communication in Multi-Agent Reinforcement Learning , 2020, ArXiv.

[111]  STT-CBS: A Conflict-Based Search Algorithm for Multi-Agent Path Finding with Stochastic Travel Times , 2020, ArXiv.

[112]  N. Chakraborty,et al.  Algorithm for Multi-Robot Chance-Constrained Generalized Assignment Problem with Stochastic Resource Consumption , 2020, 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[113]  Shreyas Sundaram,et al.  Resilient Asymptotic Consensus in Robust Networks , 2013, IEEE Journal on Selected Areas in Communications.

[114]  Andrew Zisserman,et al.  Video Google: a text retrieval approach to object matching in videos , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[115]  H. Simon,et al.  Administrative Behavior: A Study of Decision-Making Processes in Administrative Organization. , 1959 .

[116]  Andreas Kamagaew,et al.  Concept of Cellular Transport Systems in facility logistics , 2011, The 5th International Conference on Automation, Robotics and Applications.

[117]  Gaurav S. Sukhatme,et al.  Multiple Mobile Robot Systems , 2016, Springer Handbook of Robotics, 2nd Ed..

[118]  Niko Sünderhauf,et al.  Did You Miss the Sign? A False Negative Alarm System for Traffic Sign Detectors , 2019, 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[119]  Aleksander Madry,et al.  Robustness May Be at Odds with Accuracy , 2018, ICLR.

[120]  Venkatraman Renganathan,et al.  Spoof resilient coordination for distributed multi-robot systems , 2017, 2017 International Symposium on Multi-Robot and Multi-Agent Systems (MRS).

[121]  Howie Choset,et al.  Path Planning for Multiple Agents under Uncertainty , 2017, ICAPS.

[122]  Frank Dellaert,et al.  Distributed mapping with privacy and communication constraints: Lightweight algorithms and object-based models , 2017, Int. J. Robotics Res..

[123]  Thomas A. Henzinger,et al.  Adversarial Training is Not Ready for Robot Learning , 2021, 2021 IEEE International Conference on Robotics and Automation (ICRA).

[124]  Mark H. Overmars,et al.  Prioritized motion planning for multiple robots , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[125]  Vijay Kumar,et al.  A Macroscopic Privacy Model for Heterogeneous Robot Swarms , 2016, ANTS Conference.

[126]  J. How,et al.  Chance Constrained RRT for Probabilistic Robustness to Environmental Uncertainty , 2010 .

[127]  Roni Stern,et al.  Multi-Agent Pathfinding: Definitions, Variants, and Benchmarks , 2019, SOCS.

[128]  Sven Koenig,et al.  Lifelong Multi-Agent Path Finding for Online Pickup and Delivery Tasks , 2017, AAMAS.

[129]  Guang Wang,et al.  Data-Driven Distributionally Robust Electric Vehicle Balancing for Mobility-on-Demand Systems under Demand and Supply Uncertainties , 2020, 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[130]  Cyrill Stachniss,et al.  Adaptive Robust Kernels for Non-Linear Least Squares Problems , 2020, IEEE Robotics and Automation Letters.

[131]  Ozan K. Tonguz,et al.  Self-organized traffic control , 2010, VANET '10.

[132]  Alcherio Martinoli,et al.  Adaptive Risk-Based Replanning For Human-Aware Multi-Robot Task Allocation With Local Perception , 2019, IEEE Robotics and Automation Letters.

[133]  Luca Carlone,et al.  3D Dynamic Scene Graphs: Actionable Spatial Perception with Places, Objects, and Humans , 2020, RSS 2020.

[134]  Gaurav S. Sukhatme,et al.  Resilience in Multirobot Multitarget Tracking With Unknown Number of Targets Through Reconfiguration , 2020, IEEE Transactions on Control of Network Systems.

[135]  Yoke Peng Leong,et al.  Hard Limits and Performance Tradeoffs in a Class of Antithetic Integral Feedback Networks. , 2019, Cell systems.

[136]  Eduardo Montijano,et al.  Visual data association in narrow-bandwidth networks , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[137]  Vijay Kumar,et al.  Formations for Resilient Robot Teams , 2017, IEEE Robotics and Automation Letters.

[138]  Titus Cieslewski,et al.  Data-Efficient Decentralized Visual SLAM , 2017, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[139]  S. Sastry,et al.  Adaptive Control: Stability, Convergence and Robustness , 1989 .

[140]  Magnus Egerstedt,et al.  Energy-Constrained Coordination of Multi-Robot Teams , 2017, IEEE Transactions on Control Systems Technology.

[141]  Eric Heiden,et al.  LAMP: Large-Scale Autonomous Mapping and Positioning for Exploration of Perceptually-Degraded Subterranean Environments , 2020, 2020 IEEE International Conference on Robotics and Automation (ICRA).

[142]  Luca Carlone,et al.  Visual-Inertial Odometry on Chip: An Algorithm-and-Hardware Co-design Approach , 2017, Robotics: Science and Systems.

[143]  Swarun Kumar,et al.  Guaranteeing spoof-resilient multi-robot networks , 2015, Autonomous Robots.

[144]  Michail G. Lagoudakis,et al.  Multi-robot routing under limited communication range , 2008, 2008 IEEE International Conference on Robotics and Automation.

[145]  Hugh F. Durrant-Whyte,et al.  Decentralised cooperative localisation for heterogeneous teams of mobile robots , 2011, 2011 IEEE International Conference on Robotics and Automation.

[146]  Harold W. Kuhn,et al.  The Hungarian method for the assignment problem , 1955, 50 Years of Integer Programming.

[147]  J. Burdick,et al.  Safe Multi-Agent Interaction through Robust Control Barrier Functions with Learned Uncertainties , 2020, 2020 59th IEEE Conference on Decision and Control (CDC).

[148]  Li Wang,et al.  Control Barrier Certificates for Safe Swarm Behavior , 2015, ADHS.

[149]  Stergios I. Roumeliotis,et al.  Distributed Multi-Robot Localization , 2000, DARS.

[150]  Roni Stern,et al.  Research Challenges and Opportunities in Multi-Agent Path Finding and Multi-Agent Pickup and Delivery Problems , 2020, AAMAS.

[151]  Maryam Kamgarpour,et al.  Performance guarantees for greedy maximization of non-submodular set functions in systems and control , 2017, ArXiv.

[152]  Isay Katsman,et al.  Generative Adversarial Perturbations , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[153]  Sebastian Thrun,et al.  Online self-calibration for mobile robots , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[154]  John Doyle,et al.  Complexity and robustness , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[155]  Tyler Summers,et al.  Performance bounds for optimal feedback control in networks , 2017, 2018 Annual American Control Conference (ACC).

[156]  A Formal Approach to the Co-Design of Embodied Intelligence , 2020, ArXiv.

[157]  S. Low,et al.  The "robust yet fragile" nature of the Internet. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[158]  Yingli Tian,et al.  Self-Supervised Visual Feature Learning With Deep Neural Networks: A Survey , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[159]  Magnus Egerstedt,et al.  Robot ecology: Constraint-based control design for long duration autonomy , 2018, Annu. Rev. Control..

[160]  James Usevitch,et al.  Finite-Time Resilient Formation Control with Bounded Inputs , 2018, 2018 IEEE Conference on Decision and Control (CDC).

[161]  Vadim Indelman,et al.  Distributed Consistent Multi-Robot Semantic Localization and Mapping , 2020, IEEE Robotics and Automation Letters.

[162]  Tao Sun,et al.  Robust Multi-Agent Reinforcement Learning with Model Uncertainty , 2020, NeurIPS.

[163]  Tat-Jun Chin,et al.  Robust Fitting in Computer Vision: Easy or Hard? , 2018, ECCV.

[164]  Javier Alonso-Mora,et al.  Predictive routing for autonomous mobility-on-demand systems with ride-sharing , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[165]  Vijay Kumar,et al.  Dense r-robust formations on lattices , 2020, 2020 IEEE International Conference on Robotics and Automation (ICRA).

[166]  Jeff S. Shamma,et al.  LP‐Based Multi‐Vehicle Path Planning with Adversaries , 2007 .

[167]  Brian C. Williams,et al.  Privacy-Preserving Algorithm for Decoupling of Multi-Agent Plans with Uncertainty , 2021, ICAPS.

[168]  Jordan B. Pollack,et al.  Automatic design and manufacture of robotic lifeforms , 2000, Nature.

[169]  John Stuart Hall,et al.  Resilience: A new definition of health for people and communities. , 2010 .

[170]  Igor Linkov,et al.  Resilience and efficiency in transportation networks , 2017, Science Advances.

[171]  George J. Pappas,et al.  LQG Control and Sensing Co-Design , 2018, IEEE Transactions on Automatic Control.

[172]  Marios M. Polycarpou,et al.  Cooperative Control of Distributed Multi-Agent Systems , 2001 .

[173]  Jonathan P. How,et al.  Decoupled multiagent path planning via incremental sequential convex programming , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[174]  L. Carlone,et al.  DOOR-SLAM: Distributed, Online, and Outlier Resilient SLAM for Robotic Teams , 2019, IEEE Robotics and Automation Letters.

[175]  Ryan M. Eustice,et al.  Pairwise Consistent Measurement Set Maximization for Robust Multi-Robot Map Merging , 2018, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[176]  Vijay Kumar,et al.  Learning Decentralized Controllers for Robot Swarms with Graph Neural Networks , 2019, CoRL.

[177]  Jack W. Baker,et al.  On the assessment of robustness , 2008 .

[178]  Nathan Michael,et al.  Multi-robot pose graph localization and data association from unknown initial relative poses via expectation maximization , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[179]  Anton Andreychuk,et al.  Prioritized Multi-agent Path Finding for Differential Drive Robots , 2019, 2019 European Conference on Mobile Robots (ECMR).

[180]  Christian Bettstetter,et al.  Drone delivery systems: job assignment and dimensioning , 2018, Auton. Robots.

[181]  Giovanni Beltrame,et al.  Towards Collaborative Simultaneous Localization and Mapping: a Survey of the Current Research Landscape , 2021, ArXiv.

[182]  Javier Yu,et al.  A Survey of Distributed Optimization Methods for Multi-Robot Systems , 2021, ArXiv.

[183]  Heng Yang,et al.  Outlier-Robust Estimation: Hardness, Minimally Tuned Algorithms, and Applications , 2020, IEEE Transactions on Robotics.

[184]  Dylan A. Shell,et al.  Optimal Market-based Multi-Robot Task Allocation via Strategic Pricing , 2013, Robotics: Science and Systems.

[185]  Vijay Kumar,et al.  Resilient consensus for time-varying networks of dynamic agents , 2017, 2017 American Control Conference (ACC).

[186]  Basilio Bona,et al.  Simultaneous Localization and Mapping Using Rao-Blackwellized Particle Filters in Multi Robot Systems , 2011, J. Intell. Robotic Syst..

[187]  Peter Stone,et al.  Towards Safe Motion Planning in Human Workspaces: A Robust Multi-agent Approach , 2021, 2021 IEEE International Conference on Robotics and Automation (ICRA).

[188]  Weiping Wang,et al.  Stochastic Hierarchical Multimodal Hub Location Problem for Cargo Delivery Systems: Formulation and Algorithm , 2020, IEEE Access.

[189]  Wolfgang Hönig,et al.  Persistent and Robust Execution of MAPF Schedules in Warehouses , 2019, IEEE Robotics and Automation Letters.

[190]  Yen-Cheng Liu,et al.  When2com: Multi-Agent Perception via Communication Graph Grouping , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[191]  George J. Pappas,et al.  Sensor placement for optimal Kalman filtering: Fundamental limits, submodularity, and algorithms , 2015, 2016 American Control Conference (ACC).

[192]  Pratap Tokekar,et al.  An Approximation Algorithm for Distributed Resilient Submodular Maximization: Extended Abstract , 2019, 2019 International Symposium on Multi-Robot and Multi-Agent Systems (MRS).

[193]  B. Faverjon,et al.  Probabilistic Roadmaps for Path Planning in High-Dimensional Con(cid:12)guration Spaces , 1996 .

[194]  Maria Teresa Lazaro,et al.  Multi-robot SLAM using condensed measurements , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[195]  Andrea Censi,et al.  Uncertainty in Monotone Codesign Problems , 2017, IEEE Robotics and Automation Letters.

[196]  Amanda Prorok,et al.  Gaussian Process Based Message Filtering for Robust Multi-Agent Cooperation in the Presence of Adversarial Communication , 2020, ArXiv.

[197]  Nathan Michael,et al.  Distributed real-time cooperative localization and mapping using an uncertainty-aware expectation maximization approach , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[198]  Zhe Liu,et al.  Mobile Robot Path Planning in Dynamic Environments Through Globally Guided Reinforcement Learning , 2020, IEEE Robotics and Automation Letters.

[199]  Xiaolei Ma,et al.  Vehicle Routing Problem , 2013 .

[200]  Andrea Censi,et al.  A Mathematical Theory of Co-Design , 2015, ArXiv.

[201]  Luca Carlone,et al.  Neural Trees for Learning on Graphs , 2021, NeurIPS.

[202]  Yuan Wang,et al.  Resilient Consensus Through Event-Based Communication , 2018, IEEE Transactions on Control of Network Systems.

[203]  Changjoo Nam,et al.  When to do your own thing: Analysis of cost uncertainties in multi-robot task allocation at run-time , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[204]  Noboru Noguchi,et al.  Robot Farming System Using Multiple Robot Tractors in Japan Agriculture , 2011 .

[205]  Antonio Bicchi,et al.  Consensus Computation in Unreliable Networks: A System Theoretic Approach , 2010, IEEE Transactions on Automatic Control.

[206]  C. Guaragnella,et al.  LOCUS: A Multi-Sensor Lidar-Centric Solution for High-Precision Odometry and 3D Mapping in Real-Time , 2020, IEEE Robotics and Automation Letters.

[207]  Stergios I. Roumeliotis,et al.  A communication-bandwidth-aware hybrid estimation framework for multi-robot cooperative localization , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[208]  Siddharth Mayya,et al.  Resilient Task Allocation in Heterogeneous Multi-Robot Systems , 2020, IEEE Robotics and Automation Letters.

[209]  Remy Wehbe,et al.  Probabilistic Resilience of Dynamic Multi-Robot Systems , 2021, IEEE Robotics and Automation Letters.

[210]  Chrystopher L. Nehaniv,et al.  Teaching robots by moulding behavior and scaffolding the environment , 2006, HRI '06.

[211]  Dirk Van Oudheusden,et al.  The orienteering problem: A survey , 2011, Eur. J. Oper. Res..

[212]  Jorge Cortés,et al.  Scheduling of control nodes for improved network controllability , 2016, 2016 IEEE 55th Conference on Decision and Control (CDC).

[213]  Vijay Kumar,et al.  Fair Robust Assignment Using Redundancy , 2021, IEEE Robotics and Automation Letters.

[214]  James Usevitch,et al.  Adversarial Resilience for Sampled-Data Systems using Control Barrier Function Methods , 2021, 2021 American Control Conference (ACC).

[215]  Sven Koenig,et al.  Lifelong Path Planning with Kinematic Constraints for Multi-Agent Pickup and Delivery , 2018, AAAI.

[216]  Reza M. Parizi,et al.  Federated Learning: A Survey on Enabling Technologies, Protocols, and Applications , 2020, IEEE Access.

[217]  Kazuya Yoshida,et al.  Collaborative mapping of an earthquake‐damaged building via ground and aerial robots , 2012, J. Field Robotics.

[218]  Andrew Howard,et al.  Multi-robot mapping using manifold representations , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[219]  Lynne E. Parker,et al.  ALLIANCE: an architecture for fault tolerant multirobot cooperation , 1998, IEEE Trans. Robotics Autom..

[220]  Hod Lipson,et al.  Scalable co-optimization of morphology and control in embodied machines , 2017, Journal of The Royal Society Interface.

[221]  Martin Takác,et al.  Multi-Agent Image Classification via Reinforcement Learning , 2019, 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[222]  Emilio Frazzoli,et al.  On-demand high-capacity ride-sharing via dynamic trip-vehicle assignment , 2017, Proceedings of the National Academy of Sciences.

[223]  Silvio Savarese,et al.  3D Scene Graph: A Structure for Unified Semantics, 3D Space, and Camera , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[224]  Wolfgang Hönig,et al.  Robust Trajectory Execution for Multi-robot Teams Using Distributed Real-time Replanning , 2018, DARS.

[225]  Peter Richtárik,et al.  Federated Learning: Strategies for Improving Communication Efficiency , 2016, ArXiv.

[226]  Francisco J. Samaniego,et al.  Abraham Wald's Work on Aircraft Survivability , 1984 .

[227]  George J. Pappas,et al.  Resilient Active Information Gathering with Mobile Robots , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[228]  Sonia Chernova,et al.  Desperate Times Call for Desperate Measures: Towards Risk-Adaptive Task Allocation , 2021, 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[229]  Heng Yang,et al.  One Ring to Rule Them All: Certifiably Robust Geometric Perception with Outliers , 2020, NeurIPS.

[230]  Jan Faigl,et al.  Online planning for multi-robot active perception with self-organising maps , 2018, Auton. Robots.

[231]  Weiping Li,et al.  Applied Nonlinear Control , 1991 .

[232]  Sean L. Bowman,et al.  Probabilistic data association for semantic SLAM , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[233]  Alcherio Martinoli,et al.  Distributed Particle Swarm Optimization using Optimal Computing Budget Allocation for multi-robot learning , 2015, 2015 IEEE Congress on Evolutionary Computation (CEC).

[234]  S. Pimm The complexity and stability of ecosystems , 1984, Nature.

[235]  Pratap Tokekar,et al.  Risk-Aware Submodular Optimization for Multi-Robot Coordination , 2020, ArXiv.

[236]  Collaborative Semantic Perception and Relative Localization Based on Map Matching , 2020, 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[237]  Peter C. Cheeseman,et al.  Estimating uncertain spatial relationships in robotics , 1986, Proceedings. 1987 IEEE International Conference on Robotics and Automation.

[238]  Aaron D. Ames,et al.  Guaranteed Obstacle Avoidance for Multi-Robot Operations With Limited Actuation: A Control Barrier Function Approach , 2021, IEEE Control Systems Letters.

[239]  Jonathan P. How,et al.  Distributed Robust Receding Horizon Control for Multivehicle Guidance , 2007, IEEE Transactions on Control Systems Technology.

[240]  Melvyn Sim,et al.  The Price of Robustness , 2004, Oper. Res..

[241]  Frank Dellaert,et al.  DDF-SAM 2.0: Consistent distributed smoothing and mapping , 2013, 2013 IEEE International Conference on Robotics and Automation.

[242]  Seth Hutchinson,et al.  Fault-Tolerant Rendezvous of Multirobot Systems , 2017, IEEE Transactions on Robotics.

[243]  Jonathan P. How,et al.  Kimera-Multi: Robust, Distributed, Dense Metric-Semantic SLAM for Multi-Robot Systems , 2021, IEEE Transactions on Robotics.

[244]  Frank Dellaert,et al.  Factor Graphs for Robot Perception , 2017, Found. Trends Robotics.

[245]  Bruno Sinopoli,et al.  Foundations of Control and Estimation Over Lossy Networks , 2007, Proceedings of the IEEE.

[246]  Pratap Tokekar,et al.  Multi-robot Coordination and Planning in Uncertain and Adversarial Environments , 2021, Current Robotics Reports.

[247]  Luca Carlone,et al.  Hierarchical Representations and Explicit Memory: Learning Effective Navigation Policies on 3D Scene Graphs using Graph Neural Networks , 2021, ArXiv.

[248]  Nikos A. Vlassis,et al.  Optimal and Approximate Q-value Functions for Decentralized POMDPs , 2008, J. Artif. Intell. Res..

[249]  Luca Carlone,et al.  Attention and anticipation in fast visual-inertial navigation , 2016, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[250]  Kevin Gimpel,et al.  A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networks , 2016, ICLR.

[251]  Fernando Gama,et al.  Graph Neural Networks for Decentralized Multi-Robot Path Planning , 2019, ArXiv.

[252]  Filippos Christianos,et al.  Dealing with Non-Stationarity in Multi-Agent Deep Reinforcement Learning , 2019, ArXiv.

[253]  Giovanni Beltrame,et al.  An Adversarial Approach to Private Flocking in Mobile Robot Teams , 2020, IEEE Robotics and Automation Letters.

[254]  Vijay Kumar,et al.  Resilient Flocking for Mobile Robot Teams , 2017, IEEE Robotics and Automation Letters.

[255]  Julie A. Shah,et al.  Fast Scheduling of Multi-Robot Teams with Temporospatial Constraints , 2013, Robotics: Science and Systems.

[256]  R. E. Taylor,et al.  Optimal Redundancy for Reliability in Series Systems , 1969, Oper. Res..

[257]  Joris IJsselmuiden,et al.  Monitoring and mapping with robot swarms for agricultural applications , 2017, 2017 14th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).

[258]  Alec Koppel,et al.  Asynchronous and Parallel Distributed Pose Graph Optimization , 2020, IEEE Robotics and Automation Letters.

[259]  Hiroaki Kitano,et al.  Biological robustness , 2008, Nature Reviews Genetics.

[260]  George J. Pappas,et al.  Resilient Active Information Acquisition with Teams of Robots , 2021, ArXiv.

[261]  N. Biggs THE TRAVELING SALESMAN PROBLEM A Guided Tour of Combinatorial Optimization , 1986 .

[262]  Jonathan P. How,et al.  Decentralized path planning for multi-agent teams with complex constraints , 2012, Autonomous Robots.

[263]  Luca Carlone,et al.  Monitoring and Diagnosability of Perception Systems , 2020, 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[264]  Amanda Prorok,et al.  ModGNN: Expert Policy Approximation in Multi-Agent Systems with a Modular Graph Neural Network Architecture , 2021, 2021 IEEE International Conference on Robotics and Automation (ICRA).

[265]  Luke Fletcher,et al.  Multiple relative pose graphs for robust cooperative mapping , 2010, 2010 IEEE International Conference on Robotics and Automation.

[266]  T. Bektaş The multiple traveling salesman problem: an overview of formulations and solution procedures , 2006 .

[267]  S. Leibler,et al.  Robustness in simple biochemical networks , 1997, Nature.

[268]  Marco Pavone,et al.  The Team Surviving Orienteers Problem: Routing Robots in Uncertain Environments with Survival Constraints , 2017, 2017 First IEEE International Conference on Robotic Computing (IRC).

[269]  Amanda Prorok,et al.  Robust Assignment Using Redundant Robots on Transport Networks With Uncertain Travel Time , 2020, IEEE Transactions on Automation Science and Engineering.

[270]  Jonas Nygårds,et al.  C-SAM: Multi-Robot SLAM using square root information smoothing , 2008, 2008 IEEE International Conference on Robotics and Automation.

[271]  Jonathan P. How,et al.  Block-Coordinate Descent on the Riemannian Staircase for Certifiably Correct Distributed Rotation and Pose Synchronization , 2019, ArXiv.

[272]  Vijay Kumar,et al.  Privacy-preserving vehicle assignment for mobility-on-demand systems , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[273]  Bernhard Nebel,et al.  Decentralized collision avoidance, deadlock detection, and deadlock resolution for multiple mobile robots , 2001, Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180).

[274]  J. Mendel Lessons in Estimation Theory for Signal Processing, Communications, and Control , 1995 .

[275]  Eric Brachmann,et al.  DSAC — Differentiable RANSAC for Camera Localization , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[276]  A. Herzog,et al.  Resilience and mental health. , 2007, Connecticut medicine.