Multimodal navigation display

In this paper we discuss the opportunities of multimodal interaction for multimodal flight planning in a navigation display and introduce key design principles of multimodal interaction (MMI) via keyboard, cursor-control device, touch gestures and voice. We present results of human factors evaluation of multimodal flight planning conducted on an interactive prototype and outline the possibilities of multimodal interaction for other functions in the flightdeck.

[1]  Dimitrios Tzovaras.  Multimodal user interfaces : from signals to interaction , 2008 .

[2]  Alexandros Potamianos,et al.  Human-Computer Interfaces to Multimedia Content a Review , 2008, Multimodal Processing and Interaction.

[3]  Richard A. Bolt,et al.  “Put-that-there”: Voice and gesture at the graphics interface , 1980, SIGGRAPH '80.

[4]  G. A. Miller.  THE PSYCHOLOGICAL REVIEW THE MAGICAL NUMBER SEVEN, PLUS OR MINUS TWO: SOME LIMITS ON OUR CAPACITY FOR PROCESSING INFORMATION 1 , 1956 .

[5]  Sharon L. Oviatt,et al.  Ten myths of multimodal interaction , 1999, Commun. ACM.

[6]  M. Alibali,et al.  The function of gesture in learning to count: more than keeping track * , 1999 .

[7]  Christopher D. Wickens,et al.  Multiple resources and performance prediction , 2002 .

[8]  M. Alibali,et al.  Gesture and the process of speech production: We think, therefore we gesture , 2000 .

[9]  Robert B. Miller,et al.  Response time in man-computer conversational transactions , 1899, AFIPS Fall Joint Computing Conference.

[10]  Susan M. Wagner,et al.  Explaining Math: Gesturing Lightens the Load , 2001, Psychological science.

[11]  Petros Maragos,et al.  Cross-Modal Integration for Performance Improving in Multimedia: A Review , 2008, Multimodal Processing and Interaction.

[12]  R. Krauss,et al.  PSYCHOLOGICAL SCIENCE Research Article GESTURE, SPEECH, AND LEXICAL ACCESS: The Role of Lexical Movements in Speech Production , 2022 .

[13]  Thies Pfeiffer,et al.  Understanding multimodal deixis with gaze and gesture in conversational interfaces , 2011 .

[14]  Samir Chatterjee,et al.  All-optical networks , 1999, Commun. ACM.