Performance Evaluation of Speech Recognition Systems as a Next-Generation Pilot-Vehicle Interface Technology

During the flight trials known as Gulfstream-V Synthetic Vision Systems Integrated Technology Evaluation (GV-SITE), a Speech Recognition System (SRS) was used by the evaluation pilots. The SRS system was intended to be an intuitive interface for display control (rather than knobs, buttons, etc.). This paper describes the performance of the current "state of the art" Speech Recognition System (SRS). The commercially available technology was evaluated as an application for possible inclusion in commercial aircraft flight decks as a crew-to-vehicle interface. Specifically, the technology is to be used as an interface from aircrew to the onboard displays, controls, and flight management tasks. A flight test of a SRS as well as a laboratory test was conducted.

[1]  Christopher D. Wickens,et al.  The implications of data-link for representing pilot request information on 2D and 3D air traffic control displays , 1996 .

[2]  Jan Noyes,et al.  A Comparison of Speech Input and Touch Screen for Executing Checklists in an Avionics Application , 2007 .

[3]  A. Lechner,et al.  Voice recognition: software solutions in real-time ATC workstations , 2002 .

[4]  John H. L. Hansen,et al.  Analysis and compensation of speech under stress and noise for environmental robustness in speech recognition , 1996, Speech Commun..

[5]  R. John Hansman,et al.  Identification of Important "Party Line" Information Elements and the Implications for Situational Awareness in the Datalink Environment , 1992 .

[6]  Karol Kerns.  DATA-LINK COMMUNICATION BETWEEN CONTROLLERS AND PILOTS: A REVIEW AND SYNTHESIS OF THE SIMULATION LITERATURE. , 1991 .

[7]  George P. Boucek,et al.  Air Transport Crew Tasking in an ATC Data Link Environment , 1987 .

[8]  Edwin Hutchins,et al.  Culture and Flight Deck Operations , 2002 .

[9]  K. Abbott,et al.  The interfaces between flightcrews and modern flight deck systems , 1996 .

[10]  Victor Riley.  Developing a Pilot-Centered Autoflight Interface , 2000 .

[11]  Anthony D. Andre,et al.  CONVEYING MESSAGE CRITICALITY VIA DATALINK , 2003 .

[12]  Trevor Nash.  Eurofighter typhoon — A record of continuing achievements , 1999 .

[13]  J. M. Rankin,et al.  Controller interface for controller-pilot data link communications , 1997, 16th DASC. AIAA/IEEE Digital Avionics Systems Conference. Reflections to the Future. Proceedings.

[14]  Alison McGann,et al.  Data link air traffic control and flight deck environments: Experiment in flight crew performance , 1993 .

[15]  Amy R. Pritchett,et al.  VARIATIONS IN "PARTY LINE" INFORMATION IMPORTANCE BETWEEN PILOTS OF DIFFERENCE CHARACTERISTICS , 1995 .

[16]  Tom G. Reynolds,et al.  Improving Surveillance of Clearances in Future Air Traffic Control Systems , 2004 .

[17]  R. A. Faerber,et al.  Usability evaluation of speech synthesis and recognition for improving the human interface to next generation data link communication systems , 2000, 19th DASC. 19th Digital Avionics Systems Conference. Proceedings (Cat. No.00CH37126).

[18]  Sima'anKhalil,et al.  Wired for Speech: How Voice Activates and Advances the Human-Computer Relationship , 2006 .

[19]  O. V. Prinzo.  An Analysis of Approach Control/Pilot Voice Communications. , 1996 .

[20]  Barbara G. Kanki,et al.  An Evaluation of the Taxiway Navigation and Situation Awareness (T-NASA) System in High-Fidelity Simulation , 1998 .

[21]  Zhang Hua,et al.  Speech recognition interface design for in-vehicle system , 2010, AutomotiveUI.

[22]  Joseph Soeters,et al.  Culture and Flight Safety in Military Aviation , 2000 .

[23]  Heath A. Ruff,et al.  Manual Versus Speech Input for Unmanned Aerial Vehicle Control Station Operations , 2003 .

[24]  Robert K. Osgood,et al.  JSF integrated helmet audio-visual system technology demonstration results , 1997, Defense, Security, and Sensing.

[25]  William H. Corwin,et al.  Considerations for the Retrofit of Data Link , 1990 .

[26]  Rnhw van Gent.  HUMAN FACTORS ISSUES WITH AIRBORNE DATA LINK: TOWARDS INCREASED CREW ACCEPTANCE FOR BOTH EN-ROUTE AND TERMINAL FLIGHT OPERATIONS , 1995 .

[27]  Kim M Cardosi.  An Analysis of En Route Controller-Pilot Voice Communications , 1993 .

[28]  Allan J. South.  Some characteristics of speech produced under high G-force and pressure breathing , 1999, 1999 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings. ICASSP99 (Cat. No.99CH36258).

[29]  David A. Ferrucci,et al.  Introduction to "This is Watson" , 2012, IBM J. Res. Dev..

[30]  Charles E. Knox,et al.  Flight tests with a data link used for air traffic control information exchange , 1991 .

[31]  Randall E. Bailey,et al.  Flight testing an integrated synthetic vision system , 2005, SPIE Defense + Commercial Sensing.