Multimodal Interface Technologies for UAV Ground Control Stations

This paper examines different technologies that can be applied in the design and development of a ground control station for Unmanned Aerial Vehicles (UAVs) equipped with multimodal interfaces. Multimodal technologies employ multiple sensory channels/modalities for information transmission as well as for system control. Examples of these technologies could be haptic feedback, head tracking, auditory information (3D audio), voice control, tactile displays, etc. The applicability and benefits of those technologies is analyzed for a task consisting in the acknowledgement of alerts in an UAV ground control station composed by three screens and managed by a single operator. For this purpose, several experiments were conducted with a group of individuals using different combinations of modal conditions (visual, aural and tactile).

[1]  Frank Biocca,et al.  Visual Touch in Virtual Environments: An Exploratory Study of Presence, Multimodal Interfaces, and Cross-Modal Sensory Illusions , 2001, Presence: Teleoperators & Virtual Environments.

[2]  P. MatthewAylett.  Proceedings of the 7th European Conference on Speech Communication and Technology , 2001 .

[3]  Glenn F. Wilson,et al.  Real-Time Assessment of Mental Workload Using Psychophysiological Measures and Artificial Neural Networks , 2003, Hum. Factors.

[4]  Shinichiro Omachi,et al.  Asymmetric Gaussian and Its Application to Pattern Recognition , 2002, SSPR/SPR.

[5]  Vladimir Pavlovic,et al.  Toward multimodal human-computer interface , 1998, Proc. IEEE.

[6]  J. Sweller.  Visualisation and Instructional Design , 2002 .

[7]  Fabio Roli,et al.  Proceedings of the 2006 joint IAPR international conference on Structural, Syntactic, and Statistical Pattern Recognition , 2002 .

[8]  Stanley Peters,et al.  The WITAS multi-modal dialogue system I , 2001, INTERSPEECH.

[9]  Paul Taylor,et al.  Festival Speech Synthesis System , 1998 .

[10]  Karl F. Van Orden,et al.  Augmenting Task-Centered Design with Operator State Assessment Technologies , 2007, HCI.

[11]  Correlation between Expected Workload and EEG Indices of Cognitive Workload and Task Engagement , 2006 .

[12]  Ying Zhu,et al.  Measuring Effective Data Visualization , 2007, ISVC.

[13]  R. R. Patterson,et al.  Guidelines for auditory warning systems on civil aircraft , 1982 .

[14]  Nadya Belov,et al.  Distribution Statement " a " (approved for Public Release, Distribution Unlimited) Comparison of Real-time Classification Methods , 2022 .

[15]  Nicholas A J Lieven,et al.  Auditory Alert Characteristics: A Survey of Pilot Views , 2005 .