Natural Language Processing in the Control of Unmanned Aerial Vehicles

This paper addresses the opportunities and challenges involved in applying natural language processing techniques to the control of unmanned aerial vehicles (UAVs). The problem of controlling an unmanned aircraft via natural language inputs is formulated as a feedback control problem. Two implementations of such systems are described. The phraseology of the existing air traffic control language is used as a base command set, and knowledge of air traffic control and airport operations, combined with existing natural language processing techniques, is used to achieve a higher recognition success rate than a traditional natural language processor designed for a more general domain of discourse would. This is the first known attempt at formalizing air traffic control phraseology for use in an unmanned system, and the first known flight of a vehicle controlled by natural language inputs. Outstanding problems and possible directions for future research are described.

[1]  Candace L. Sidner,et al.  Attention, Intentions, and the Structure of Discourse , 1986, CL.

[2]  Randal W. Beard,et al.  Semi-autonomous human-UAV interfaces for fixed-wing mini-UAVs , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[3]  James F. Allen,et al.  A Plan Recognition Model for Subdialogues in Conversations , 1987, Cogn. Sci..

[4]  Robert S. Bolia,et al.  An Evaluation of Speech Controls for AWACS Weapons Directors , 2004 .

[5]  Jay Earley,et al.  An efficient context-free parsing algorithm , 1970, Commun. ACM.

[6]  Eric Atwell,et al.  Dialogues in air traffic control , 1996 .

[7]  Rebecca J. Passonneau,et al.  Intention-Based Segmentation: Human Reliability and Correlation with Linguistic Cues , 1993, ACL.

[8]  Chrim Scivyer,et al.  THE DEVELOPMENT AND IMPLEMENTATION , 2022 .

[9]  Jerry R. Hobbs.  Coherence and Coreference , 1979, Cogn. Sci..

[10]  Barbara J. Grosz,et al.  The representation and use of focus in dialogue understanding. , 1977 .

[11]  Jonathan P. How,et al.  Implementation of a Manned Vehicle - UAV Mission System , 2004 .

[12]  Yves Schabes,et al.  Parsing with Finite-State Transducers , 1997 .

[13]  James F. Allen,et al.  A Plan Recognition Model for Subdialogues in Conversations , 1987, Cogn. Sci..

[14]  Noam Chomsky,et al.  On Certain Formal Properties of Grammars , 1959, Inf. Control..

[15]  James H. Martin,et al.  Speech and language processing: an introduction to natural language processing, computational linguistics, and speech recognition, 2nd Edition , 2000, Prentice Hall series in artificial intelligence.

[16]  Krzysztof Kuchcinski,et al.  The WITAS Unmanned Aerial Vehicle Project , 2000, ECAI.

[17]  Geoffrey K. Pullum,et al.  Natural languages and context-free languages , 1982 .

[18]  Stuart M. Shieber,et al.  Evidence against the context-freeness of natural language , 1985 .