Field Assessment of Multimodal Communication for Dismounted Human-Robot Teams

A field assessment of multimodal communication (MMC) was conducted as part of a program integration demonstration to support and enable bi-directional communication between a dismounted Soldier and a robot teammate. In particular, the assessment was focused on utilizing auditory and visual/gesture based communications. The task involved commanding a robot using semantically-based MMC. Initial participant data indicates a positive experience with the multimodal interface (MMI) prototype. The results of the experiment inform recommendations for multimodal designers regarding perceived usability and functionality of the currently implemented MMI.

[1]  Polona Vilar.  Usability Engineering: Process, Products and Examples , 2010, J. Assoc. Inf. Sci. Technol..

[2]  Jakob Nielsen,et al.  Chapter 4 – The Usability Engineering Lifecycle , 1993 .

[3]  Jon Bornstein.  Robotics Collaborative Technology Alliance , 2008 .

[4]  Jakob Nielsen,et al.  Usability engineering , 1997, The Computer Science and Engineering Handbook.

[5]  Christopher D. Wickens,et al.  Multiple Resources and Mental Workload , 2008, Hum. Factors.

[6]  Daniel J. Barber,et al.  Toward a Tactile Language for Human–Robot Interaction , 2015, Hum. Factors.

[7]  Daniel Barber,et al.  Achieving the Vision of Effective Soldier-Robot Teaming: Recent Work in Multimodal Communication , 2015, HRI.

[8]  Brian Shackel,et al.  Ergonomics in design for usability , 1986 .

[9]  Nicu Sebe,et al.  Multimodal Human Computer Interaction: A Survey , 2005, ICCV-HCI.

[10]  J B Long,et al.  People and computers: designing for usability , 1986 .

[11]  Ken Eason,et al.  Towards the experimental study of usability , 1984 .

[12]  Sharon Oviatt,et al.  Multimodal interactive maps: designing for human performance , 1997 .

[13]  Sharon L. Oviatt,et al.  Multimodal Interfaces: A Survey of Principles, Models and Frameworks , 2009, Human Machine Interaction.

[14]  Alexander H. Waibel,et al.  Multimodal interfaces , 1996, Artificial Intelligence Review.

[15]  Robert Dean.  Common world model for unmanned systems , 2013, Defense, Security, and Sensing.

[16]  Lauren Reinerman-Jones,et al.  Visual and tactile interfaces for bi-directional human robot communication , 2013, Defense, Security, and Sensing.

[17]  Matthew R. Walter,et al.  Efficient Natural Language Interfaces for Assistive Robots , 2014, IROS 2014.