Interoperable multi-agent framework for unmanned aerial/ground vehicles: towards robot autonomy

Multi-agent architectures for autonomous robots are generally mission and platform oriented. Autonomous robots are commonly employed in patrolling, surveillance, search and rescue and human-hazardous missions. Irrespective of the differences in unmanned aerial and ground robots, the algorithms for obstacle detection and avoidance, path planning and path-tracking can be generalized. Service-oriented interoperable framework for robot autonomy (SOIFRA) proposed in this paper is an interoperable multi-agent framework  focusing on generalizing platform-independent algorithms for unmanned aerial and ground vehicles. As obstacle detection and avoidance are standard requirements for autonomous robot operation, platform-independent collision avoidance algorithms are incorporated into SOIFRA. SOIFRA is behaviour based and is interoperable across unmanned aerial and ground vehicles. Obstacle detection and avoidance are performed utilizing computer vision-based algorithms, as these are generally platform independent. Obstacle detection is achieved utilizing Hough transform, Canny contour and Lucas–Kanade sparse optical flow algorithm. Collision avoidance performed utilizing optical flow-based and expansion of object-based time-to-contact demonstrates SOIFRA’s modularity. Experiments performed, utilizing TurtleBot, Clearpath Robotics Husky, AR Drone and Hector-quadrotor, establish SOIFRA’s interoperability across several robotic platforms.

[1]  Jessie Y C Chen,et al.  UAV-guided navigation for ground robot tele-operation in a military reconnaissance environment , 2010, Ergonomics.

[2]  Gaurav S. Sukhatme,et al.  Autonomous deployment and repair of a sensor network using an unmanned aerial vehicle , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[3]  John M. Dolan,et al.  Safe and Efficient Robotic Space Exploration with Tele-Supervised Autonomous Robots , 2006, AAAI Spring Symposium: To Boldly Go Where No Human-Robot Team Has Gone Before.

[4]  Aníbal Ollero,et al.  Journal of Intelligent & Robotic Systems manuscript No. (will be inserted by the editor) Experimental Results in Multi-UAV Coordination for Disaster Management and Civil Security Applications , 2022 .

[5]  Ching-Heng Ku,et al.  Obstacle avoidance for autonomous land vehicle navigation in indoor environments by quadratic classifier , 1999, IEEE Trans. Syst. Man Cybern. Part B.

[6]  Kenji Suzuki,et al.  TDM: A software framework for elegant and rapid development of autonomous behaviors for humanoid robots , 2011, 2011 11th IEEE-RAS International Conference on Humanoid Robots.

[7]  Tara A. Estlin,et al.  CLARAty and challenges of developing interoperable robotic software , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[8]  M. Pechoucek,et al.  Agent-Based Multi-Layer Collision Avoidance to Unmanned Aerial Vehicles , 2007, 2007 International Conference on Integration of Knowledge Intensive Multi-Agent Systems.

[9]  Oussama Khatib,et al.  Real-Time Obstacle Avoidance for Manipulators and Mobile Robots , 1986 .

[10]  Bianca Mariela Innocenti Badano.  A multi-agent architecture with distributed coordination for an autonomous robot , 2008 .

[11]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[12]  G. D. Croon.  Monocular distance estimation with optical flow maneuvers and efference copies: a stability-based strategy , 2016 .

[13]  Kevin Gurney,et al.  Bio-Inspired Visual Navigation for a Quadcopter using Optic Flow , 2016 .

[14]  Giulio Sandini,et al.  Dynamic stereo in visual navigation , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[15]  Amaury Nègre,et al.  Time To Contact for Obstacle Avoidance , 2009, ECMR.

[16]  Fariborz Saghafi,et al.  Optical flow‐based obstacle avoidance of a fixed‐wing MAV , 2011 .

[17]  Michael H Dickinson,et al.  The influence of visual landscape on the free flight behavior of the fruit fly Drosophila melanogaster. , 2002, The Journal of experimental biology.

[18]  Chris Murphy,et al.  Deep sea underwater robotic exploration in the ice-covered Arctic ocean with AUVs , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[19]  Alan Liu,et al.  A Flexible Architecture for Navigation Control of a Mobile Robot , 2007, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[20]  Paul Y. Oh,et al.  Optic-Flow-Based Collision Avoidance , 2008, IEEE Robotics & Automation Magazine.

[21]  Jiming Liu,et al.  Multiagent Robotic Systems , 2001 .

[22]  Chia-Hsuan Yeh,et al.  Social Networks and Asset Price Dynamics , 2015, IEEE Transactions on Evolutionary Computation.

[23]  Wolfram Burgard,et al.  The dynamic window approach to collision avoidance , 1997, IEEE Robotics Autom. Mag..

[24]  Hyacinth S. Nwana,et al.  Software agents: an overview , 1996, The Knowledge Engineering Review.

[25]  Karl Tuyls,et al.  Multi-robot collision avoidance with localization uncertainty , 2012, AAMAS.

[26]  Dipti Srinivasan,et al.  Impact of the Length of Optical Flow Vectors in Estimating Time-to-Contact an Obstacle , 2015 .

[27]  Victor R. Lesser,et al.  Cooperative Multiagent Systems: A Personal View of the State of the Art , 1999, IEEE Trans. Knowl. Data Eng..

[28]  Iwan Ulrich,et al.  VFH/sup */: local obstacle avoidance with look-ahead verification , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[29]  Jean-Arcady Meyer,et al.  A contribution to vision-based autonomous helicopter flight in urban environments , 2005, Robotics Auton. Syst..

[30]  N. Andrew Browning,et al.  A Neural Circuit for Robust Time-to-Contact Estimation Based on Primate MST , 2012, Neural Computation.

[31]  Jean-Yves Tigli,et al.  Use of multi agent systems for mobile robotics control , 1994, Proceedings of IEEE International Conference on Systems, Man and Cybernetics.

[32]  Fredrik Heintz,et al.  HDRC3 - A Distributed Hybrid Deliberative/Reactive Architecture for Unmanned Aircraft Systems , 2014 .

[33]  Roland Siegwart,et al.  MAV navigation through indoor corridors using optical flow , 2010, 2010 IEEE International Conference on Robotics and Automation.

[34]  Qingfu Zhang,et al.  Stable Matching-Based Selection in Evolutionary Multiobjective Optimization , 2014, IEEE Transactions on Evolutionary Computation.

[35]  Luis Jiménez,et al.  A Multi-agent Architecture for Multi-robot Surveillance , 2009, ICCCI.

[36]  Dario Floreano,et al.  Genetic Team Composition and Level of Selection in the Evolution of Cooperation , 2009, IEEE Transactions on Evolutionary Computation.

[37]  S.X. Yang,et al.  An efficient dynamic system for real-time robot-path planning , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[38]  A. Tamminga,et al.  Hyperspatial Remote Sensing of Channel Reach Morphology and Hydraulic Fish Habitat Using an Unmanned Aerial Vehicle (UAV): A First Assessment in the Context of River Research and Management , 2015 .

[39]  Xiao Peng,et al.  Fuzzy behavior-based control of mobile robots , 2004, IEEE Transactions on Fuzzy Systems.

[40]  Carlos C. Insaurralde,et al.  Capability-oriented robot architecture for maritime autonomy , 2015, Robotics Auton. Syst..

[41]  Shingo Mabu,et al.  A Novel Graph-Based Estimation of the Distribution Algorithm and its Extension Using Reinforcement Learning , 2014, IEEE Transactions on Evolutionary Computation.

[42]  Jianwei Zhang,et al.  A multi-robot platform for mobile robots — A novel evaluation and development approach with multi-agent technology , 2012, 2012 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems (MFI).