An agent architecture for autonomous UAV flight control in object classification and recognition missions

One of the major challenges in designing an autonomous agent system is to achieve the objective of recreating human-like cognition by exploiting the growing pragmatic architectures that act intelligently and intuitively in vital fields. Consequently, this research addresses the general problem of designing an agent-based autonomous flight control (AFC) architecture of a UAV to facilitate autonomous routing/navigation in uncharted and unascertained environments of organized foyer surroundings. The specific problem of this research is the indoor environment because of the perplexing characteristics of the required flight mechanics. We design the AFC agent architecture to consist of data acquisition, perception, localization, mapping, control, and planning modules. The AFC agent performs search and survey missions that entail commanding the UAV while performing object classifications and recognition tasks. The agent implements several image handling algorithms to detect and identify objects from their colors and shapes. It captures the video images acquired from a solitary onboard, front-facing camera which are handled off-board on a computer. We conduct tests on the AFC agent, and the results show that the agent successfully controls the UAV in three performed test cases and a total of nine implemented missions. The AFC agent detects and identifies all the assigned objects with a recall score of 1.00, a precision score of 0.9563, an accuracy score of 0.9573, an F1 score of 0.9776, an efficiency score of 0.5239, a detection total time score of 225.5 s, and an identification total time of 275 s and outperforms a human operator.

[1]  Aida Mustapha,et al.  Modelling an Adjustable Autonomous Multi-agent Internet of Things System for Elderly Smart Home , 2019, AHFE.

[2]  Corrado Santoro,et al.  An integrated framework for the realistic simulation of multi-UAV applications , 2019, Comput. Electr. Eng..

[3]  Azhana Ahmad,et al.  An autonomy viability assessment matrix for agent-based autonomous systems , 2015, 2015 International Symposium on Agents, Multi-Agent Systems and Robotics (ISAMSR).

[4]  Aida Mustapha,et al.  Formulating layered adjustable autonomy for unmanned aerial vehicles , 2017, Int. J. Intell. Comput. Cybern..

[5]  David Garlan,et al.  DARTSim: An Exemplar for Evaluation and Comparison of Self-Adaptation Approaches for Smart Cyber-Physical Systems , 2019, 2019 IEEE/ACM 14th International Symposium on Software Engineering for Adaptive and Self-Managing Systems (SEAMS).

[6]  Peter I. Corke,et al.  Vertical Infrastructure Inspection Using a Quadcopter and Shared Autonomy Control , 2012, FSR.

[7]  K. R. Guruprasad,et al.  A realistic simulation platform for multi-quadcopter search using downward facing cameras , 2019, Comput. Electr. Eng..

[8]  Azhana Ahmad,et al.  A Dynamically Adjustable Autonomic Agent Framework , 2013, WorldCIST.

[9]  V. R. Jisha,et al.  Path Planning of an Autonomous Quadcopter Based Delivery System , 2018, 2018 International Conference on Emerging Trends and Innovations In Engineering And Technological Research (ICETIETR).

[10]  Salama A. Mostafa,et al.  Norm-Based Behavior Regulating Technique for Multi-Agent in Complex Adaptive Systems , 2019, IEEE Access.

[11]  Moamin A. Mahmoud,et al.  How New Individuals Behave in a Heterogeneous Community: A Computational Approach to Norm Assimilation Using Agent-Based Systems , 2020, Journal of Systems Science and Complexity.

[12]  Bernard J. Baars,et al.  Conceptual Commitments of the LIDA Model of Cognition , 2013, J. Artif. Gen. Intell..

[13]  Aida Mustapha,et al.  Adjustable autonomy: a systematic literature review , 2017, Artificial Intelligence Review.

[14]  Azhana Ahmad,et al.  Formulating Dynamic Agents' Operational State via Situation Awareness Assessment , 2014, ISI.

[15]  Aaron Martinez,et al.  Learning ROS for Robotics Programming , 2013 .

[16]  Kanad Ghose,et al.  High-speed vision-based autonomous indoor navigation of a quadcopter , 2015, 2015 International Conference on Unmanned Aircraft Systems (ICUAS).

[17]  Aida Mustapha,et al.  A Real-Time Autonomous Flight Navigation Trajectory Assessment for Unmanned Aerial Vehicles , 2018, 2018 International Symposium on Agent, Multi-Agent Systems and Robotics (ISAMSR).

[18]  Tarek Elderini,et al.  UAV Autonomous Localization Using Macro-Features Matching with a CAD Model , 2020, Sensors.

[19]  Azhana Ahmad,et al.  A Flexible Human-Agent Interaction model for supervised autonomous systems , 2016, 2016 2nd International Symposium on Agent, Multi-Agent Systems and Robotics (ISAMSR).

[20]  Luis Miguel Bergasa,et al.  A Multi-Sensorial Simultaneous Localization and Mapping (SLAM) System for Low-Cost Micro Aerial Vehicles in GPS-Denied Environments , 2017, Sensors.

[21]  William D. Smart,et al.  Programming Robots with ROS: A Practical Introduction to the Robot Operating System , 2015 .

[22]  Xiangke Wang,et al.  ROS-based UAV control using hand gesture recognition , 2017, 2017 29th Chinese Control And Decision Conference (CCDC).

[23]  Wei Meng,et al.  Ultra-Wideband-Based Localization for Quadcopter Navigation , 2016, Unmanned Syst..

[24]  Abdulla Al-Kaff,et al.  ROS-Based Approach for Unmanned Vehicles in Civil Applications , 2019 .