Validating human-robot interaction schemes in multitasking environments

The ability of robots to autonomously perform tasks is increasing. More autonomy in robots means that the human managing the robot may have available free time. It is desirable to use this free time productively, and a current trend is to use this available free time to manage multiple robots. We present the notion of neglect tolerance as a means for determining how robot autonomy and interface design determine how free time can be used to support multitasking, in general, and multirobot teams, in particular. We use neglect tolerance to 1) identify the maximum number of robots that can be managed; 2) identify feasible configurations of multirobot teams; and 3) predict performance of multirobot teams under certain independence assumptions. We present a measurement methodology, based on a secondary task paradigm, for obtaining neglect tolerance values that allow a human to balance workload with robot performance.

[1]  Geb W. Thomas,et al.  An operator interface for a robot-mounted, 3D camera system: Project Pioneer , 1999, Proceedings IEEE Virtual Reality (Cat. No. 99CB36316).

[2]  Michael A. Goodrich,et al.  Designing human-centered automation: trade-offs in collision avoidance system design , 2000, IEEE Trans. Intell. Transp. Syst..

[3]  Dean A. Pomerleau,et al.  RALPH: rapidly adapting lateral position handler , 1995, Proceedings of the Intelligent Vehicles '95. Symposium.

[4]  Mica R. Endsley,et al.  Design and Evaluation for Situation Awareness Enhancement , 1988 .

[5]  Gordon Cheng,et al.  Supervised autonomy: a paradigm for teleoperating mobile robots , 1997, Proceedings of the 1997 IEEE/RSJ International Conference on Intelligent Robot and Systems. Innovative Robotics for Real-World Applications. IROS '97.

[6]  Michael A. Goodrich,et al.  Ecological displays for robot interaction: a new perspective , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[7]  Thomas B. Sheridan,et al.  Telerobotics, Automation, and Human Supervisory Control , 2003 .

[8]  Robin R. Murphy,et al.  Moonlight in Miami : A Field Study of Human-Robot Interaction in the Context of an Urban Search and Rescue Disaster Response Training Exercise , 2003 .

[9]  I. Koch.  The role of external cues for endogenous advance reconfiguration in task switching , 2003, Psychonomic bulletin & review.

[10]  Alan C. Schultz,et al.  Goal tracking in a natural language interface: towards achieving adjustable autonomy , 1999, Proceedings 1999 IEEE International Symposium on Computational Intelligence in Robotics and Automation. CIRA'99 (Cat. No.99EX375).

[11]  E. M. Altmann,et al.  Task Interruption: Resumption Lag and the Role of Cues , 2004 .

[12]  Ronald C. Arkin,et al.  Multiagent Teleautonomous Behavioral Control , 1997 .

[13]  Terrence Fong,et al.  A Safeguarded Teleoperation Controller , 2001 .

[14]  David D. Woods,et al.  Envisioning human-robot coordination in future operations , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[15]  Jean Scholtz,et al.  Human-Robot Interactions: Creating Synergistic Cyber Forces , 2002 .

[16]  Robin R. Murphy,et al.  Human-robot interactions during the robot-assisted urban search and rescue response at the World Trade Center , 2003, IEEE Trans. Syst. Man Cybern. Part B.

[17]  Spyros G. Tzafestas.  Research on autonomous robotic wheelchairs in Europe [Guest Editorial] , 2001, IEEE Robotics Autom. Mag..

[18]  Pradeep K. Khosla,et al.  A multi-agent system for programming robots by human demonstration , 2001, Integr. Comput. Aided Eng..

[19]  R.C. Arkin,et al.  Reactive control as a substrate for telerobotic systems , 1991, IEEE Aerospace and Electronic Systems Magazine.

[20]  Dan R. Olsen,et al.  Metrics for human driving of multiple robots , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[21]  David Kortenkamp,et al.  Adjustable Autonomy for Human-Centered Autonomous Systems on Mars , 1998 .

[22]  T. Rofer,et al.  Ensuring safe obstacle avoidance in a shared-control system , 1999, 1999 7th IEEE International Conference on Emerging Technologies and Factory Automation. Proceedings ETFA '99 (Cat. No.99TH8467).

[23]  Charles E. Thorpe,et al.  Collaborative control: a robot-centric model for vehicle teleoperation , 2001 .

[24]  Sebastian Thrun,et al.  Towards A Framework for Human-Robot Interaction , 2004 .

[25]  Cynthia Breazeal,et al.  A Motivational System for Regulating Human-Robot Interaction , 1998, AAAI/IAAI.

[26]  H. Pashler.  The Psychology of Attention , 1997 .

[27]  G. Michel,et al.  Restricting the Field of View: Perceptual and Performance Effects , 1990, Perceptual and motor skills.

[28]  J. G. Hollands,et al.  Engineering Psychology and Human Performance , 1984 .

[29]  Tucker R. Balch,et al.  Behavior-based formation control for multirobot teams , 1998, IEEE Trans. Robotics Autom..

[30]  A. Kramer,et al.  Changes in executive control across the life span: examination of task-switching performance. , 2001, Developmental psychology.

[31]  Dan R. Olsen,et al.  Fan-out: measuring human control of multiple robots , 2004, CHI.

[32]  Mary L. Cummings,et al.  Developing Operator Capacity Estimates for Supervisory Control of Autonomous Vehicles , 2007, Hum. Factors.

[33]  Terrence Fong,et al.  Advanced Interfaces for Vehicle Teleoperation: Collaborative Control, Sensor Fusion Displays, and Remote Driving Tools , 2001, Auton. Robots.

[34]  Douglas W. Gage,et al.  Command Control for Many-Robot Systems , 1992 .

[35]  Erwin R. Boer,et al.  Development of a steering entropy method for evaluating driver workload , 1999 .

[36]  Michael A. Goodrich,et al.  Task Switching and Multi-Robot Teams , 2005 .

[37]  David Kortenkamp,et al.  Recognizing and Interpreting Gestures on a Mobile Robot , 1996, AAAI/IAAI, Vol. 2.

[38]  Terrence Fong,et al.  Sensor Fusion Based User Interface for Vehicle Teleoperation , 1999 .

[39]  Thomas B. Sheridan,et al.  Telerobotics , 1989, Autom..

[40]  Fabio Gagliardi Cozman,et al.  Safeguarded Teleoperation for Lunar Rovers: From Human Factors to Field Trials , 1999 .

[41]  Michael A. Goodrich,et al.  A model of human brake initiation behavior with implications for ACC design , 1999, Proceedings 199 IEEE/IEEJ/JSAI International Conference on Intelligent Transportation Systems (Cat. No.99TH8383).

[42]  Ronald C. Arkin,et al.  An Behavior-based Robotics , 1998 .

[43]  Terrence Fong,et al.  A Personal User Interface for Collaborative Human-Robot Exploration , 2001 .

[44]  Holly A. Yanco,et al.  "Where am I?" Acquiring situation awareness using a remote robot platform , 2004, 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583).

[45]  Terrence Fong,et al.  Vehicle Teleoperation Interfaces , 2001, Auton. Robots.

[46]  Craig R. Carignan,et al.  Advanced Operator Interface Design for Complex Space Telerobots , 2001, Auton. Robots.

[47]  Richard A. Volz,et al.  Teleautonomous systems: projecting and coordinating intelligent action at a distance , 1990, IEEE Trans. Robotics Autom..

[48]  Donald D. Dudenhoeffer,et al.  Command And Control Architectures For Autonomous Micro-Robotic Forces , 2001 .

[49]  Gordon Cheng,et al.  Supervised Autonomy: A Framework for Human-Robot Systems Development , 2001, Auton. Robots.

[50]  Robin R. Murphy,et al.  Cooperative Assistance for Remote Robot Supervision , 1996, Presence: Teleoperators & Virtual Environments.

[51]  Dan R. Olsen,et al.  Metrics for Evaluating Human-Robot Interactions , 2003 .

[52]  C. Wickens.  Engineering psychology and human performance, 2nd ed. , 1992 .

[53]  Lynne E. Parker,et al.  ALLIANCE: an architecture for fault tolerant, cooperative control of heterogeneous mobile robots , 1994, Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS'94).

[54]  Jean Scholtz,et al.  Beyond Usability Evaluation: Analysis of Human-Robot Interaction at a Major Robotics Competition , 2004, Hum. Comput. Interact..

[55]  Ronald C. Arkin,et al.  Integration of reactive and telerobotic control in multi-agent robotic systems , 1994 .

[56]  Pradeep K. Khosla,et al.  Tactile gestures for human/robot interaction , 1995, Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots.

[57]  Michael A. Goodrich,et al.  Towards predicting robot team performance , 2003, SMC'03 Conference Proceedings. 2003 IEEE International Conference on Systems, Man and Cybernetics. Conference Theme - System Security and Assurance (Cat. No.03CH37483).

[58]  Alex Pentland,et al.  Learning words from sights and sounds: a computational model , 2002, Cogn. Sci..

[59]  Shirley Dex,et al.  JR 旅客販売総合システム（マルス）における運用及び管理について , 1991 .