Vocal human-robot interaction inspired by Battle management language

A prototype conversational interface has been developed to facilitate spoken interaction between humans and robots. The focus is on end-users such as security officers including military personnel who would conduct missions with robot partners in close proximity. The focal group is familiar with Battle Management Language, a variation of natural language that is restricted to avoid ambiguity. This language is chosen, given its familiarity, to inspire natural spoken interaction with robots and to avoid the greater challenge of full natural language processing. To achieve this, an open-source framework for building applications with conversational interfaces, Dorset, was interfaced to a research mobile robot enabling spoken voice commands and responses. The completed prototype successfully demonstrated feasibility and potential for advancing interaction with robots from current head-down, hands-on approaches toward a more natural head-up, hands-off paradigm suitable for humans and robots working in close proximity to one another.

[1]  Ulrich Schade,et al.  Interacting with Multi-Robot Systems Using BML , 2013 .

[2]  T. Remmersmann,et al.  Commanding Multi-Robot Systems with Robot Operating System using Battle Management Language , 2012, 2012 Military Communications and Information Systems Conference (MCC).

[3]  Jonathan Harris,et al.  Speech and gesture interfaces for squad-level human-robot teaming , 2014, Defense + Security Symposium.

[4]  Sotiris Makris,et al.  Human–robot interaction review and challenges on task planning and programming , 2016, Int. J. Comput. Integr. Manuf..

[5]  J. Mark Pullen,et al.  Extensible Battle Management Language as a Transformation Enabler , 2004, Simul..

[6]  S. Mitra,et al.  Gesture Recognition: A Survey , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[7]  J. Bradshaw,et al.  Coordinated Operations in Mixed Teams of Humans and Robots , .

[8]  Jean Scholtz,et al.  Concepts of operations for robot-assisted emergency response and implications for human-robot interaction , 2007 .

[9]  K. Heffner,et al.  Using BML for Command & Control of Autonomous Unmanned Air Systems , 2011 .

[10]  Michael A. Goodrich,et al.  Human-Robot Interaction: A Survey , 2008, Found. Trends Hum. Comput. Interact..

[11]  Ryan J. Murphy,et al.  Nested marsupial robotic system for search and sampling in increasingly constrained environments , 2016, 2016 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[12]  James R. Glass,et al.  Spoken command of large mobile robots in outdoor environments , 2010, 2010 IEEE Spoken Language Technology Workshop.

[13]  Paolo Dario,et al.  A Survey of Glove-Based Systems and Their Applications , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[14]  Christopher M. Schlick,et al.  Interactive multi-robot command and control with quasi-natural command language , 2014, 2014 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[15]  Alexander D. Walker,et al.  Utilizing Glove-Based Gestures and a Tactile Vest Display for Covert Communications and Robot Control , 2014 .

[16]  William S. Murphy,et al.  Determination of a Position in Three Dimensions using Trilateration and Approximate Dis- tances , 1995 .

[17]  Haitham Hasan,et al.  RETRACTED ARTICLE: Human–computer interaction using vision-based hand gesture recognition systems: a survey , 2013, Neural Computing and Applications.

[18]  Michael R. Hieb,et al.  Command and Control Lexical Grammar (C2LG) Specification , 2010 .

[19]  Bernardo Wagner,et al.  Realization of an Autonomous Team of Unmanned Ground and Aerial Vehicles , 2012, ICIRA.

[20]  Curtis Blais Application of Coalition Battle Management Language (C-BML) and C-BML services to Live, Virtual, and Constructive (LVC) simulation environments , 2011, Proceedings of the 2011 Winter Simulation Conference (WSC).

[21]  John Woods,et al.  Survey on Chatbot Design Techniques in Speech Conversation Systems , 2015 .

[22]  Roland Siegwart,et al.  Designing, developing, and deploying systems to support human–robot teams in disaster response , 2014, Adv. Robotics.