Agent-Human Coordination with Communication Costs Under Uncertainty

As agents' technology becomes increasing more prevalent, coordination in mixed agent-human environments becomes a key issue. Agent-human coordination is becoming even more important in real life situations, where uncertainty and incomplete information exists and communication is costly. While abundant research has focused on aspects of computerized teamwork, little attention has been given to the issues raised in teams that consist of both computerized agents and people. In this paper we focus on teamwork between an agent and a human counterpart and present a novel agent designed to interact proficiently with people. In extensive simulations we matched our agent with people and compared it with another state-of-the-art agent. Our results demonstrate the significant improvement in coordination when our agent is involved.

[1]  Sarit Kraus,et al.  Using Focal Point Learning to Improve Tactic Coordination in Human-Machine Interactions , 2007, IJCAI.

[2]  James K. Sebenius,et al.  Thinking Coalitionally: Party Arithmetic, Process Opportunism, and Strategic Sequencing , 1992 .

[3]  Leslie Pack Kaelbling,et al.  Learning Policies for Partially Observable Environments: Scaling Up , 1997, ICML.

[4]  Stephanie Rosenthal,et al.  An effective personal mobile robot agent through symbiotic human-robot interaction , 2010, AAMAS.

[5]  David D. Woods,et al.  Envisioning human-robot coordination in future operations , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[6]  Arlette van Wissen,et al.  Human-agent teamwork in dynamic environments , 2012, Comput. Hum. Behav..

[7]  Panagiotis G. Ipeirotis,et al.  Running Experiments on Amazon Mechanical Turk , 2010, Judgment and Decision Making.

[8]  Cynthia Breazeal,et al.  Improved human-robot team performance using Chaski, A human-inspired plan execution system , 2011, 2011 6th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[9]  Manuela Veloso,et al.  What to Communicate? Execution-Time Decision in Multi-agent POMDPs , 2006, DARS.

[10]  Prashant Doshi,et al.  Monte Carlo Sampling Methods for Approximating Interactive POMDPs , 2014, J. Artif. Intell. Res..

[11]  François Charpillet,et al.  MAA*: A Heuristic Search Algorithm for Solving Decentralized POMDPs , 2005, UAI.

[12]  Jeffrey M. Bradshaw,et al.  Coordination in Human-Agent-Robot Teamwork , 2008, 2008 International Symposium on Collaborative Technologies and Systems.

[13]  Joelle Pineau,et al.  Point-based value iteration: An anytime algorithm for POMDPs , 2003, IJCAI.

[14]  Henry Hexmoor,et al.  Agent Autonomy , 2003, Multiagent Systems, Artificial Societies, and Simulated Organizations.

[15]  François Charpillet,et al.  Point-based Dynamic Programming for DEC-POMDPs , 2006, AAAI.

[16]  Shlomo Zilberstein,et al.  Memory-Bounded Dynamic Programming for DEC-POMDPs , 2007, IJCAI.

[17]  David Sarne,et al.  Estimating information value in collaborative multi-agent planning systems , 2007, AAMAS '07.

[18]  Shlomo Zilberstein,et al.  Bounded Policy Iteration for Decentralized POMDPs , 2005, IJCAI.

[19]  Kai Oliver Arras,et al.  Please do not disturb! Minimum interference coverage for social robots , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[20]  Andrea Lockerd Thomaz,et al.  Effects of nonverbal communication on efficiency and robustness in human-robot teamwork , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[21]  Neil Immerman,et al.  The Complexity of Decentralized Control of Markov Decision Processes , 2000, UAI.

[22]  A. Roth,et al.  Predicting How People Play Games: Reinforcement Learning in Experimental Games with Unique, Mixed Strategy Equilibria , 1998 .

[23]  Maarten Sierhuis,et al.  Adjustable Autonomy and Human-Agent Teamwork in Practice: An Interim Report on Space Applications , 2003 .

[24]  Ya'akov Gal,et al.  Modeling User Perception of Interaction Opportunities for Effective Teamwork , 2009, 2009 International Conference on Computational Science and Engineering.

[25]  Robin R. Murphy,et al.  Human-robot interactions during the robot-assisted urban search and rescue response at the World Trade Center , 2003, IEEE Trans. Syst. Man Cybern. Part B.

[26]  Illah R. Nourbakhsh,et al.  Planning for Human-Robot Interaction Using Time-State Aggregated POMDPs , 2008, AAAI.

[27]  Alessandro Saffiotti,et al.  Human-aware task planning: An application to mobile robots , 2010, TIST.

[28]  Alessandro Saffiotti,et al.  Human-aware planning for robots embedded in ambient ecologies , 2012, Pervasive Mob. Comput..

[29]  Sarit Kraus,et al.  Using focal point learning to improve human–machine tacit coordination , 2011, Autonomous Agents and Multi-Agent Systems.