Augmenting Robot Behaviors Using Physiological Measures

In recent years, advancements in Unmanned Systems have allowed Human Robot Interaction (HRI) to transition from direct remote control to autonomous systems capable of self-navigation. However, these new technologies do not yet support true mixed-initiative solider-robot teaming where soldiers work with another agent as if it were another human being. In order to achieve this goal, researchers must explore new types of multimodal and natural communication strategies and methods to provide robots improved understanding of their human counterparts' thought process. Physiological sensors are continuously becoming more portable and affordable leading to the possibility of providing new insight of team member state to a robot team member. However, steps need to be taken to improve how affective and cognitive states are measured and how these new metrics can be used to augment the decision making process for a robot team member. This paper describes current state of the art and next steps needed for accurate profile creation for improved human robot team performance.

[1]  Curry Guinn,et al.  Mixed-initiative interaction , 1999 .

[2]  Tony Johnson,et al.  Soldier Machine Interface for Vehicle Formations: Interface Design and an Approach Evaluation and Experimentation , 2009 .

[3]  Nilanjan Sarkar,et al.  Anxiety detecting robotic system – towards implicit human-robot collaboration , 2004, Robotica.

[4]  D. Damos.  Multiple-task performance , 2020 .

[5]  Nilanjan Sarkar,et al.  Online stress detection using psychophysiological signals for implicit human-robot cooperation , 2002, Robotica.

[6]  Harold R. Booher,et al.  Manprint: An Approach to Systems Integration , 1990 .

[7]  Joel S. Warm,et al.  Cerebral Hemodynamics and Vigilance Performance , 2009 .

[8]  Nilanjan Sarkar,et al.  Operator Engagement Detection and Robot Behavior Adaptation in Human-Robot Interaction , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[9]  G. Krueger.  Sustained work, fatigue, sleep loss and performance: A review of the issues , 1989 .

[10]  Raja Parasuraman,et al.  Event-related brain potentials and human factors research. , 1990 .

[11]  M. Bradley,et al.  The pupil as a measure of emotional arousal and autonomic activation. , 2008, Psychophysiology.

[12]  Christopher D. Wickens,et al.  Multiple resources and performance prediction , 2002 .

[13]  Christopher D. Wickens,et al.  Workload Assessment and Prediction , 1990 .

[14]  Michela Terenzi,et al.  ASTEF: A simple tool for examining fixations , 2008, Behavior research methods.

[15]  Marti A. Hearst.  Trends & Controversies: Mixed-initiative interaction , 1999, IEEE Intell. Syst..

[16]  Linda R. Elliott,et al.  Empowering followers in virtual teams: Guiding principles from theory and practice , 2008, Comput. Hum. Behav..

[17]  P. J. Clark,et al.  Distance to Nearest Neighbor as a Measure of Spatial Relationships in Populations , 1954 .

[18]  M Terenzi,et al.  Cognitive Aspects and Behavioral Effects of Transitions Between Levels of Automation , 2007 .

[19]  Florian Jentsch,et al.  Human-Robot Interactions in Future Military Operations , 2010 .