Automatic profile generation for UAV operators using a simulation-based training environment

Unmanned aerial vehicles (UAVs) are becoming a hot topic in the last few years for several research areas, such as aeronautics or computer science. Big companies such as Airbus or Amazon aim to incorporate this technology to their current systems to improve the quality of their services while reducing the human costs. However, current UAV technology requires a strong human supervisory control and this supposes an important potential risk. Therefore, it is critical to keep track of the pilot behavior to be able to determine whether he is ready or not to operate with this technology. To deal with this problem, we have developed a methodology based on different performance metrics to automatically evaluate planning and monitoring skills of new users trained in a multi-UAV simulation environment. This methodology, based on unsupervised learning and fuzzy logic, can automatically generate a profile of future operators and use it to assess their skills.

[1]  Siegfried Gottwald,et al.  Fuzzy Sets and Fuzzy Logic , 1993 .

[2]  Guy N. Brock,et al.  clValid , an R package for cluster validation , 2008 .

[3]  Víctor Rodríguez-Fernández,et al.  Design and development of a lightweight multi-UAV simulator , 2015, 2015 IEEE 2nd International Conference on Cybernetics (CYBCONF).

[4]  Ali S. Hadi,et al.  Finding Groups in Data: An Introduction to Chster Analysis , 1991 .

[5]  Timothy W. McLain,et al.  Multiple UAV cooperative search under collision avoidance and limited range communication constraints , 2003, 42nd IEEE International Conference on Decision and Control (IEEE Cat. No.03CH37475).

[6]  Michael Kuperberg,et al.  Markov Models , 2019, Earthquake Statistical Analysis through Multi-state Modeling.

[7]  David Camacho,et al.  Analyzing Planning and Monitoring Skills of Users in a Multi-UAV Simulation Environment , 2015, CAEPIA.

[8]  R Andy McKinley,et al.  Operator selection for unmanned aerial systems: comparing video game players and pilots. , 2011, Aviation, space, and environmental medicine.

[9]  S. C. Johnson.  Hierarchical clustering schemes , 1967, Psychometrika.

[10]  David Camacho,et al.  A multi-UAV mission planning videogame-based framework for player analysis , 2015, 2015 IEEE Congress on Evolutionary Computation (CEC).

[11]  Ira Assent,et al.  External evaluation measures for subspace clustering , 2011, CIKM '11.

[12]  Ujjwal Maulik,et al.  Performance Evaluation of Some Clustering Algorithms and Validity Indices , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Madan M. Gupta,et al.  Fuzzy Sets, Fuzzy Logic, and Fuzzy Systems , 2003 .

[14]  Adam N. Stulberg,et al.  Managing the Unmanned Revolution in the U.S. Air Force , 2007 .

[15]  Farid Kendoul,et al.  Survey of advances in guidance, navigation, and control of unmanned rotorcraft systems , 2012, J. Field Robotics.

[16]  Rui Xu,et al.  Survey of clustering algorithms , 2005, IEEE Transactions on Neural Networks.

[17]  Michael A. Goodrich,et al.  Human-Robot Interaction: A Survey , 2008, Found. Trends Hum. Comput. Interact..

[18]  Nicholas Roy,et al.  Supervised vs. Unsupervised Learning for Operator State Modeling in Unmanned Vehicle Settings , 2011, J. Aerosp. Comput. Inf. Commun..

[19]  Hui Xiong,et al.  Understanding of Internal Clustering Validation Measures , 2010, 2010 IEEE International Conference on Data Mining.

[20]  Eduardo Salas,et al.  Enhancing Unmanned Aerial System Training: A Taxonomy of Knowledge, Skills, Attitudes, and Methods , 2009 .

[21]  Christopher D. Wickens,et al.  Unmanned Aerial Vehicle Flight Control: False Alarms versus Misses , 2004 .

[22]  Guoqiang Peter Zhang,et al.  Neural networks for classification: a survey , 2000, IEEE Trans. Syst. Man Cybern. Part C.

[23]  Jean Scholtz,et al.  Awareness in human-robot interactions , 2003, SMC'03 Conference Proceedings. 2003 IEEE International Conference on Systems, Man and Cybernetics. Conference Theme - System Security and Assurance (Cat. No.03CH37483).

[24]  Peter J. Rousseeuw,et al.  Clustering by means of medoids , 1987 .

[25]  Daniel T. Larose,et al.  Discovering Knowledge in Data: An Introduction to Data Mining , 2005 .

[26]  Ronald R. Yager,et al.  Essentials of fuzzy modeling and control , 1994 .

[27]  Hans-Peter Kriegel,et al.  A Density-Based Algorithm for Discovering Clusters in Large Spatial Databases with Noise , 1996, KDD.

[28]  George J. Klir,et al.  Fuzzy Sets, Fuzzy Logic, and Fuzzy Systems - Selected Papers by Lotfi A Zadeh , 1996, Advances in Fuzzy Systems - Applications and Theory.

[29]  Julio Gonzalo,et al.  A comparison of extrinsic clustering evaluation metrics based on formal constraints , 2009, Information Retrieval.

[30]  J. A. Hartigan,et al.  A k-means clustering algorithm , 1979 .

[31]  Dimitar P. Filev,et al.  Fuzzy SETS AND FUZZY LOGIC , 1996 .

[32]  P. Rousseeuw.  Silhouettes: a graphical aid to the interpretation and validation of cluster analysis , 1987 .

[33]  S. Eddy.  Hidden Markov models. , 1996, Current opinion in structural biology.