A speech interface for air traffic control terminals

Abstract Several issues concerning the current use of speech interfaces are discussed and the design and development of a speech interface that enables air traffic controllers to command and control their terminals by voice is presented. A special emphasis is made in the comparison between laboratory experiments and field experiments in which a set of ergonomics-related effects are detected that cannot be observed in the controlled laboratory experiments. The paper presents both objective and subjective performance obtained in field evaluation of the system with student controllers at an air traffic control (ATC) training facility. The system exhibits high word recognition test rates (0.4% error in Spanish and 1.5% in English) and low command error (6% error in Spanish and 10.6% error in English in the field tests). Subjective impression has also been positive, encouraging future development and integration phases in the Spanish ATC terminals designed by Aeropuertos Espanoles y Navegacion Aerea (AENA).

[1]  Javier Macías Guarasa,et al.  Automatic Understanding of ATC Speech: Study of Prospectives and Field Experiments for Several Controller Positions , 2011, IEEE Transactions on Aerospace and Electronic Systems.

[2]  Alex Acero,et al.  Spoken Language Processing , 2001 .

[3]  Carol A. Manning,et al.  The Relationship Between Air Traffic Control Communication Events and Measures of Controller Taskload and Workload , 2002 .

[4]  Robert I. Damper,et al.  Speech versus keying in command and control: effect of concurrent tasking , 1996, Int. J. Hum. Comput. Stud..

[5]  Bryan L. Pellom,et al.  The analysis and design of architecture systems for speech recognition on modern handheld-computing devices , 2003, First IEEE/ACM/IFIP International Conference on Hardware/ Software Codesign and Systems Synthesis (IEEE Cat. No.03TH8721).

[6]  David Maxwell Chickering,et al.  Improving command and control speech recognition on mobile devices: using predictive user models for language modeling , 2006, User Modeling and User-Adapted Interaction.

[7]  Helmuth F. Orthner,et al.  Application of Speech Recognition Data Entry Enhancements in an Electronic Patient Care Report (ePCR) , 2006, AMIA.

[8]  Mark J. F. Gales,et al.  Mean and variance adaptation within the MLLR framework , 1996, Comput. Speech Lang..

[9]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[10]  P. Woodland,et al.  Flexible speaker adaptation using maximum likelihood linear regression , 1995 .

[11]  Eugene L. Duke,et al.  Turning PINOCCHIO Into A Real Boy: Satisfying A Turing Test For UA Operating In The NAS , 2007 .

[12]  Chin-Hui Lee,et al.  Maximum a posteriori estimation for multivariate Gaussian mixture observations of Markov chains , 1994, IEEE Trans. Speech Audio Process..

[13]  Hiroshi Matsumoto,et al.  Evaluation of mel-LPC cepstrum in a large vocabulary continuous speech recognition , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[14]  Jan Uhlír,et al.  Analysis and Optimization of Telephone Speech Command Recognition System Performance in Noisy Environment , 2004 .

[15]  H H Koester,et al.  User Performance With Speech Recognition: A Literature Review , 2001, Assistive technology : the official journal of RESNA.

[16]  J.M. Pardo,et al.  Automatic Understanding of ATC Speech , 2006, IEEE Aerospace and Electronic Systems Magazine.

[17]  A. Lechner,et al.  Voice recognition-software solutions realtime ATC workstations , 2001, 20th DASC. 20th Digital Avionics Systems Conference (Cat. No.01CH37219).

[18]  Paul Dalsgaard,et al.  Automatic speech recognition over error-prone wireless networks , 2005, Speech Commun..

[19]  J. Kessens,et al.  Non-native Pronunciation Modeling in a Command & Control Recognition Task : A Comparison between Acoustic and Lexical Modeling , 2006 .

[20]  Michael A. Grasso.  The long-term adoption of speech recognition in medical applications , 2003, 16th IEEE Symposium Computer-Based Medical Systems, 2003. Proceedings..

[21]  Steve Young,et al.  The HTK book , 1995 .