Information transfer within human robot teams: Multimodal attention management in human-robot interaction

Human-robot teams can incorporate advanced technology such as distributed mobile sensor networks, integrated communications, visualization technology, and other means to acquire and assess information. These factors can greatly affect mission effectiveness, safety, and survivability, by providing critical information and suggesting courses of action. However, information overload can result. Tactical situation awareness (SA) can be improved if human-robot communications are prioritized according to importance and appropriateness for single or multi-sensory display. In this paradigm, the tasks of the human and robot are somewhat independent or autonomous, but complimentary. Handling the amount, frequency and transfer of information, from the robot to the user requires a careful systems approach, an understanding of the mission context, and multisensory information processing issues. This report highlights attention management issues identified during task reengagement and offers guidelines relevant to tactile cues within multisensory bidirectional human robot communications.

[1]  Thomas K. Ferris,et al.  Using Informative Peripheral Visual and Tactile Cues to Support Task and Interruption Management , 2009, Hum. Factors.

[2]  Natasha Merat,et al.  Transition to manual: driver behaviour when resuming control from a highly automated vehicle , 2014 .

[3]  Christian B. Carstens,et al.  Speech-Based Robotic Control for Dismounted Soldiers: Evaluation of Visual Display Options , 2014 .

[4]  Neville A. Stanton,et al.  Effects of adaptive cruise control and highly automated driving on workload and situation awareness: A review of the empirical evidence , 2014 .

[5]  Robert R. Hoffman,et al.  The Psychology of Expertise: Cognitive Research and Empirical AI , 2011 .

[6]  Michael J. Barnes,et al.  Gesture-Based Controls for Robots: Overview and Implications for Use by Soldiers , 2016 .

[7]  Mica R. Endsley,et al.  Toward a Theory of Situation Awareness in Dynamic Systems , 1995, Hum. Factors.

[8]  R N KRAUS Disorientation in flight. An evaluation of the etiological factors. , 1959, Aerospace medicine.

[9]  Linda R. Elliott,et al.  Soldier-Based Assessment of a Dual-Row Tactor Display during Simultaneous Navigational and Robot-Monitoring Tasks , 2015 .

[10]  Linda R. Elliott,et al.  Salience of Tactile Cues: An Examination of Tactor Actuator and Tactile Cue Characteristics , 2015 .

[11]  C. Wickens,et al.  Applied Attention Theory , 2007 .

[12]  Gary Klein,et al.  Working Minds: A Practitioner's Guide to Cognitive Task Analysis , 2006 .

[13]  Alexander D. Walker,et al.  Utilizing Glove-Based Gestures and a Tactile Vest Display for Covert Communications and Robot Control , 2014 .