A Survey on Multi-Robot Coordination in Electromagnetic Adversarial Environment: Challenges and Techniques

Wireless communications and networking are playing an important role in coordination and cooperation of multi-robot systems (MRS). However, it is challenging to keep a reliable and stable wireless connection in practical applications. Especially, robots acting in electromagnetic adversarial (EA) environments may encounter more serious situations including scarce spectrum, active interference, adversarial competition, etc. In this survey, we firstly analyze the challenges faced by MRS in EA environments, and provide a categorization according to the “sense-decide-act” robot control procedure. Secondly, enabling techniques for each challenge are introduced. Finally, typical robotics software architectures are introduced, as frameworks for efficient arrangement of the above mentioned enabling techniques.

[1]  Vijay Kumar,et al.  The grand challenges of Science Robotics , 2018, Science Robotics.

[2]  Li Tian,et al.  An accelerated algorithm for ray tracing simulation based on high-performance computation , 2016, 2016 11th International Symposium on Antennas, Propagation and EM Theory (ISAPE).

[3]  Nathan Michael,et al.  Distributed real-time cooperative localization and mapping using an uncertainty-aware expectation maximization approach , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[4]  Jiannong Cao,et al.  Minimizing Movement for Target Coverage and Network Connectivity in Mobile Sensor Networks , 2015, IEEE Transactions on Parallel and Distributed Systems.

[5]  Zhengqing Yun,et al.  Ray Tracing for Radio Propagation Modeling: Principles and Applications , 2015, IEEE Access.

[6]  Rui Zhang,et al.  Wireless communications with unmanned aerial vehicles: opportunities and challenges , 2016, IEEE Communications Magazine.

[7]  Yi Wu,et al.  Multi-Agent Actor-Critic for Mixed Cooperative-Competitive Environments , 2017, NIPS.

[8]  Zhi Yan,et al.  3DOF Pedestrian Trajectory Prediction Learned from Long-Term Autonomous Mobile Robot Deployment Data , 2017, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[9]  Yuhua Tang,et al.  Communication-Motion Planning for Wireless Relay-Assisted Multi-Robot System , 2016, IEEE Wireless Communications Letters.

[10]  Giorgio Metta,et al.  YARP: Yet Another Robot Platform , 2006 .

[11]  Christian Wolf,et al.  Interactive example-based terrain authoring with conditional generative adversarial networks , 2017, ACM Trans. Graph..

[12]  Rui Zhang,et al.  Throughput Maximization for Mobile Relaying Systems , 2016, 2016 IEEE Globecom Workshops (GC Wkshps).

[13]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[14]  Giovanni De Magistris,et al.  MaestROB: A Robotics Framework for Integrated Orchestration of Low-Level Control and High-Level Reasoning , 2018, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[15]  Han-Lim Choi,et al.  Distributed Planning Strategies to Ensure Network Connectivity for Dynamic Heterogeneous Teams , 2012, IEEE Journal on Selected Areas in Communications.

[16]  Vijay Kumar,et al.  Concurrent Control of Mobility and Communication in Multirobot Systems , 2017, IEEE Transactions on Robotics.

[17]  Lav Gupta,et al.  Survey of Important Issues in UAV Communication Networks , 2016, IEEE Communications Surveys & Tutorials.

[18]  Lydia E. Kavraki,et al.  The Open Motion Planning Library , 2012, IEEE Robotics & Automation Magazine.

[19]  Angel X. Chang,et al.  Deep convolutional priors for indoor scene synthesis , 2018, ACM Trans. Graph..

[20]  David L. Rhodes,et al.  GPU-accelerated ray tracing for electromagnetic propagation analysis , 2010, 2010 IEEE International Conference on Wireless Information Technology and Systems.

[21]  Ron Alterovitz,et al.  Motion Planning Templates: A Motion Planning Framework for Robots with Low-power CPUs , 2019, 2019 International Conference on Robotics and Automation (ICRA).

[22]  Andreas Birk,et al.  Multi-robot exploration under the constraints of wireless networking , 2007 .

[23]  Shimon Whiteson,et al.  Learning to Communicate with Deep Multi-Agent Reinforcement Learning , 2016, NIPS.

[24]  Jürgen Schmidhuber,et al.  World Models , 2018, ArXiv.

[25]  Michael M. Zavlanos,et al.  Temporal Logic Task Planning and Intermittent Connectivity Control of Mobile Robot Networks , 2017, IEEE Transactions on Automatic Control.

[26]  Maobin Lu Rendezvous with connectivity preservation of mobile agents subject to uniform time-delays , 2018, Autom..

[27]  Mohamed F. Younis,et al.  Coverage-Aware Connectivity Restoration in Mobile Sensor Networks , 2009, 2009 IEEE International Conference on Communications.

[28]  Jennifer C. Hou,et al.  Maintaining Sensing Coverage and Connectivity in Large Sensor Networks , 2005, Ad Hoc Sens. Wirel. Networks.

[29]  Philip Sallis,et al.  Wireless Sensor Networks - Insights and Innovations , 2017 .

[30]  Björn W. Schuller,et al.  Unsupervised Learning of Representations from Audio with Deep Recurrent Neural Networks , 2018 .

[31]  Yasamin Mostofi,et al.  Communication-Aware Motion Planning in Mobile Networks , 2011, IEEE Transactions on Automatic Control.

[32]  Dieter Fox,et al.  SE3-nets: Learning rigid body motion using deep neural networks , 2016, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[33]  James M. Rehg,et al.  Best Response Model Predictive Control for Agile Interactions Between Autonomous Ground Vehicles , 2018, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[34]  Kostas E. Psannis,et al.  Cognitive Radio Network and Network Service Chaining toward 5G: Challenges and Requirements , 2017, IEEE Communications Magazine.

[35]  Kristin Ytterstad Pettersen,et al.  OpenMRH: A modular robotic hand generator plugin for OpenRAVE , 2015, 2015 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[36]  Tom Schaul,et al.  StarCraft II: A New Challenge for Reinforcement Learning , 2017, ArXiv.

[37]  Patrizia Scandurra,et al.  Component-based robotic engineering (Part I) [Tutorial] , 2009, IEEE Robotics & Automation Magazine.

[38]  Guoliang Xing,et al.  Mobile Relay Configuration in Data-Intensive Wireless Sensor Networks , 2009, IEEE Transactions on Mobile Computing.

[39]  Nicholas Roy,et al.  Air-Combat Strategy Using Approximate Dynamic Programming , 2008 .

[40]  A. S. Mohan,et al.  Segmented-Locally-One-Dimensional-FDTD Method for EM Propagation Inside Large Complex Tunnel Environments , 2012, IEEE Transactions on Magnetics.

[41]  Linda Doyle,et al.  Iris: an architecture for cognitive radio networking testbeds , 2010, IEEE Communications Magazine.

[42]  Azamat Shakhimardanov,et al.  Component-Based Robotic Engineering (Part II) , 2010, IEEE Robotics & Automation Magazine.

[43]  Gabriela Nicolescu,et al.  From Swarms to Stars: Task Coverage in Robot Swarms with Connectivity Constraints , 2018, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[44]  Mykel J. Kochenderfer,et al.  Cooperative Multi-agent Control Using Deep Reinforcement Learning , 2017, AAMAS Workshops.

[45]  Yanxiao Zhao,et al.  Joint energy-and-bandwidth spectrum sensing with GNU radio and USRP , 2015, SIAP.

[46]  Sangjun Lee,et al.  Finding the optimal location and allocation of relay robots for building a rapid end-to-end wireless communication , 2016, Ad Hoc Networks.

[47]  Herman Bruyninckx,et al.  Open robot control software: the OROCOS project , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[48]  Velmani Ramasamy Mobile Wireless Sensor Networks: An Overview , 2017 .

[49]  Leonardo Bobadilla,et al.  Establishing line-of-sight communication via autonomous relay vehicles , 2016, MILCOM 2016 - 2016 IEEE Military Communications Conference.

[50]  T. Ulversoy,et al.  Software Defined Radio: Challenges and Opportunities , 2010, IEEE Communications Surveys & Tutorials.

[51]  Karl Henrik Johansson,et al.  Using robot mobility to exploit multipath fading , 2009, IEEE Wireless Communications.

[52]  Roderich Groß,et al.  Re-Establishing Communication in Teams of Mobile Robots , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[53]  Reza Olfati-Saber,et al.  Consensus and Cooperation in Networked Multi-Agent Systems , 2007, Proceedings of the IEEE.

[54]  Julian de Hoog,et al.  Using rendezvous to overcome communication limitations in multirobot exploration , 2011, 2011 IEEE International Conference on Systems, Man, and Cybernetics.

[55]  Vijay Kumar,et al.  Robust Control for Mobility and Wireless Communication in Cyber–Physical Systems With Application to Robot Teams , 2012, Proceedings of the IEEE.

[56]  Yasamin Mostofi,et al.  To Go or Not to Go: On Energy-Aware and Communication-Aware Robotic Operation , 2014, IEEE Transactions on Control of Network Systems.

[57]  Petter Ögren,et al.  How Behavior Trees Modularize Hybrid Control Systems and Generalize Sequential Behavior Compositions, the Subsumption Architecture, and Decision Trees , 2017, IEEE Transactions on Robotics.

[58]  Luis Montano,et al.  Fast and scalable multi-robot deployment planning under connectivity constraints , 2019, 2019 IEEE International Conference on Autonomous Robot Systems and Competitions (ICARSC).

[59]  Yu-Chee Tseng,et al.  Efficient Placement and Dispatch of Sensors in a Wireless Sensor Network , 2008, IEEE Transactions on Mobile Computing.

[60]  Magnus Egerstedt,et al.  Distributed Coordination Control of Multiagent Systems While Preserving Connectedness , 2007, IEEE Transactions on Robotics.

[61]  George J. Pappas,et al.  Potential Fields for Maintaining Connectivity of Mobile Networks , 2007, IEEE Transactions on Robotics.

[62]  Eric W. Frew,et al.  Optimizing Cascaded Chains of Unmanned Aircraft Acting as Communication Relays , 2012, IEEE Journal on Selected Areas in Communications.

[63]  Kang G. Shin,et al.  Mobile Autonomous Router System for Dynamic (Re)formation of Wireless Relay Networks , 2013, IEEE Transactions on Mobile Computing.

[64]  B. Gates A robot in every home. , 2007, Scientific American.

[65]  Miodrag Potkonjak,et al.  Coverage problems in wireless ad-hoc sensor networks , 2001, Proceedings IEEE INFOCOM 2001. Conference on Computer Communications. Twentieth Annual Joint Conference of the IEEE Computer and Communications Society (Cat. No.01CH37213).

[66]  Hyondong Oh,et al.  Prediction of air-to-ground communication strength for relay UAV trajectory planner in urban environments , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[67]  Morgan Quigley,et al.  ROS: an open-source Robot Operating System , 2009, ICRA 2009.

[68]  Jiuchuan Jiang,et al.  Efficient decision-making for multiagent target searching and occupancy in an unknown environment , 2019, Robotics Auton. Syst..

[69]  Vijay Kumar,et al.  Robust Control of Mobility and Communications in Autonomous Robot Teams , 2013, IEEE Access.

[70]  Dan Keun Sung,et al.  Energy-efficient maneuvering and communication of a single UAV-based relay , 2014, IEEE Transactions on Aerospace and Electronic Systems.

[71]  Magnus Egerstedt,et al.  Graph-theoretic connectivity control of mobile robot networks , 2011, Proceedings of the IEEE.

[72]  Henrik I. Christensen,et al.  Rorg: Service Robot Software Management with Linux Containers , 2019, 2019 International Conference on Robotics and Automation (ICRA).

[73]  Hyondong Oh,et al.  A Hybrid Approach of Learning and Model-Based Channel Prediction for Communication Relay UAVs in Dynamic Urban Environments , 2019, IEEE Robotics and Automation Letters.

[74]  Mehrzad Malmirchegini,et al.  On the Spatial Predictability of Communication Channels , 2012, IEEE Transactions on Wireless Communications.

[75]  Florentin Smarandache,et al.  Simulation environment for mobile robots testing using ROS and Gazebo , 2016, 2016 20th International Conference on System Theory, Control and Computing (ICSTCC).

[76]  Leonardo Bobadilla,et al.  Stochastic Multi-Robot Patrolling with Limited Visibility , 2020, J. Intell. Robotic Syst..

[77]  Geoffrey A. Hollinger,et al.  Efficient Multi-robot Search for a Moving Target , 2009, Int. J. Robotics Res..

[78]  Christian Wietfeld,et al.  Role-Based Connectivity Management with Realistic Air-to-Ground Channels for Cooperative UAVs , 2012, IEEE Journal on Selected Areas in Communications.

[79]  Michael Milford,et al.  Deep learning features at scale for visual place recognition , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[80]  Cynthia F. Kurtz,et al.  The new dynamics of strategy: sense-making in a complex and complicated world , 2003, IEEE Engineering Management Review.

[81]  Fawzi Nashashibi,et al.  Real time trajectory prediction for collision risk estimation between vehicles , 2009, 2009 IEEE 5th International Conference on Intelligent Computer Communication and Processing.

[82]  Rodney A. Brooks,et al.  A Robust Layered Control Syste For A Mobile Robot , 2022 .

[83]  K. J. Ray Liu,et al.  Advances in cognitive radio networks: A survey , 2011, IEEE Journal of Selected Topics in Signal Processing.

[84]  Sahar Trigui,et al.  Integration of Global Path Planners in ROS , 2018 .

[85]  Katia P. Sycara,et al.  Decentralized coordinated motion for a large team of robots preserving connectivity and avoiding collisions , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[86]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[87]  Vincent Duchaine,et al.  Grasp stability assessment through unsupervised feature learning of tactile images , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[88]  Anne-Marie Kermarrec,et al.  Connectivity-Guaranteed and Obstacle-Adaptive Deployment Schemes for Mobile Sensor Networks , 2008, IEEE Transactions on Mobile Computing.

[89]  Ming Zhou,et al.  Mean Field Multi-Agent Reinforcement Learning , 2018, ICML.

[90]  David K. McAllister,et al.  OptiX: a general purpose ray tracing engine , 2010, ACM Trans. Graph..

[91]  Yasamin Mostofi,et al.  Robotic Router Formation in Realistic Communication Environments , 2012, IEEE Transactions on Robotics.

[92]  Leonardo Bobadilla,et al.  Multi-vehicle patrolling with limited visibility and communication constraints , 2017, MILCOM 2017 - 2017 IEEE Military Communications Conference (MILCOM).

[93]  Lorenzo Sabattini,et al.  A Comparison Between Decentralized Local and Global Methods for Connectivity Maintenance of Multi-Robot Networks , 2019, IEEE Robotics and Automation Letters.

[94]  Xiaoyan Zhu,et al.  Learning to Collaborate: Multi-Scenario Ranking via Multi-Agent Reinforcement Learning , 2018, WWW.

[95]  Lizhong Zheng,et al.  Diversity and multiplexing: a fundamental tradeoff in multiple-antenna channels , 2003, IEEE Trans. Inf. Theory.

[96]  Geoffrey A. Hollinger,et al.  Multirobot Coordination With Periodic Connectivity: Theory and Experiments , 2012, IEEE Transactions on Robotics.

[97]  Yuhua Tang,et al.  Collaborative Communication in Multi-robot Surveillance Based on Indoor Radio Mapping , 2016, CollaborateCom.

[98]  Yasamin Mostofi,et al.  Path Planning for Networked Robotic Surveillance , 2012, IEEE Transactions on Signal Processing.

[99]  Kensuke Harada,et al.  Online robot introspection via wrench-based action grammars , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[100]  Alagan Anpalagan,et al.  Anti-Jamming Communications Using Spectrum Waterfall: A Deep Reinforcement Learning Approach , 2017, IEEE Communications Letters.

[101]  Michael M. Zavlanos,et al.  Distributed Intermittent Communication Control of Mobile Robot Networks Under Time-Critical Dynamic Tasks , 2018, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[102]  Matt W. Mutka,et al.  Steiner traveler: Relay deployment for remote sensing in heterogeneous multi-robot exploration , 2012, 2012 IEEE International Conference on Robotics and Automation.

[103]  Bing Chen,et al.  Full Spectrum Sharing in Cognitive Radio Networks Toward 5G: A Survey , 2018, IEEE Access.

[104]  Vincent J. Kovarik,et al.  Software Defined Radio: The Software Communications Architecture , 2007 .

[105]  Geoffrey A. Hollinger,et al.  Multi-UAV exploration with limited communication and battery , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[106]  Oliver Brock,et al.  Interactive Perception: Leveraging Action in Perception and Perception in Action , 2016, IEEE Transactions on Robotics.

[107]  Marc Peter Deisenroth,et al.  Deep Reinforcement Learning: A Brief Survey , 2017, IEEE Signal Processing Magazine.

[108]  K. Dautenhahn,et al.  Imitation in Animals and Artifacts , 2002 .

[109]  Michael C. Hout,et al.  Multidimensional Scaling , 2003, Encyclopedic Dictionary of Archaeology.

[110]  Jonathan P. How,et al.  Deep Decentralized Multi-task Multi-Agent Reinforcement Learning under Partial Observability , 2017, ICML.

[111]  Xuejun Yang,et al.  Energy-efficient joint communication-motion planning for relay-assisted wireless robot surveillance , 2017, IEEE INFOCOM 2017 - IEEE Conference on Computer Communications.

[112]  Kaigui Bian,et al.  UAV Relaying: Power Allocation and Trajectory Optimization Using Decode-and-Forward Protocol , 2018, 2018 IEEE International Conference on Communications Workshops (ICC Workshops).

[113]  Martin Haardt,et al.  Smart antenna technologies for future wireless systems: trends and challenges , 2004, IEEE Communications Magazine.

[114]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[115]  Lorenzo Sabattini,et al.  Robust Area Coverage with Connectivity Maintenance , 2019, 2019 International Conference on Robotics and Automation (ICRA).

[116]  Bo Ai,et al.  The Design and Applications of High-Performance Ray-Tracing Simulation Platform for 5G and Beyond Wireless Communications: A Tutorial , 2019, IEEE Communications Surveys & Tutorials.

[117]  Omar J. Faqir,et al.  Energy-efficient communication in mobile aerial relay-assisted networks using predictive control , 2018 .

[118]  Xuejun Yang,et al.  micROS: a morphable, intelligent and collective robot operating system , 2016, Robotics and biomimetics.

[119]  James J. Kuffner,et al.  OpenRAVE: A Planning Architecture for Autonomous Robotics , 2008 .

[120]  Geoffrey Ye Li,et al.  Cognitive radio networking and communications: an overview , 2011, IEEE Transactions on Vehicular Technology.