Human-Robot Collaborative Multi-Agent Path Planning using Monte Carlo Tree Search and Social Reward Sources

The collaboration between humans and robots in an object search task requires the achievement of shared plans obtained from communicating and negotiating. In this work, we assume that the robot computes, as a first step, a multi-agent plan for both itself and the human. Then, both plans are submitted to human scrutiny, who either agrees or modifies it forcing the robot to adapt its own restrictions or preferences. This process is repeated along the search task as many times as required by the human. Our planner is based on a decentralized variant of Monte Carlo Tree Search (MCTS), with one robot and one human as agents. Moreover, our algorithm allows the robot and the human to optimize their own actions by maintaining a probability distribution over the plans in a joint-action space. The method allows an objective function definition over action sequences, it assumes intermittent communication, it is anytime and suitable for on-line replanning. To test it, we have developed a human-robot communication mobile phone interface. Validation is provided by real-life search experiments of a Parcheesi token in an urban space, including also an acceptability study.

[1]  Gonzalo Ferrer,et al.  Robot social-aware navigation framework to accompany people walking side-by-side , 2016, Autonomous Robots.

[2]  Alberto Sanfeliu,et al.  Aerial social force model: A new framework to accompany people using autonomous flying robots , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[3]  Peter Stone,et al.  Learning to Interpret Natural Language Commands through Human-Robot Dialog , 2015, IJCAI.

[4]  Beno Benhabib,et al.  Investigating Human-Robot Teams for Learning-Based Semi-autonomous Control in Urban Search and Rescue Environments , 2018, J. Intell. Robotic Syst..

[5]  Terrence Fong,et al.  Collaboration, Dialogue, Human-Robot Interaction , 2001, ISRR.

[6]  Yiannis Demiris,et al.  Collaborative Control for a Robotic Wheelchair: Evaluation of Performance, Attention, and Workload , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[7]  Timothy Patten,et al.  Dec-MCTS: Decentralized planning for multi-robot active perception , 2019, Int. J. Robotics Res..

[8]  Hermann J. Müller,et al.  Implications of Robot Actions for Human Perception. How Do We Represent Actions of the Observed Robots? , 2014, Int. J. Soc. Robotics.

[9]  Edoardo Battaglia,et al.  A Review of Intent Detection, Arbitration, and Communication Aspects of Shared Control for Physical Human-Robot Interaction , 2018 .

[10]  Dana Kulic,et al.  Measurement Instruments for the Anthropomorphism, Animacy, Likeability, Perceived Intelligence, and Perceived Safety of Robots , 2009, Int. J. Soc. Robotics.

[11]  Marcello Chiaberge,et al.  Multipurpose UAV for search and rescue operations in mountain avalanche events , 2017 .

[12]  Siddhartha S. Srinivasa,et al.  Eye-Hand Behavior in Human-Robot Shared Manipulation , 2018, 2018 13th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[13]  Lihui Wang,et al.  Gesture recognition for human-robot collaboration: A review , 2017, International Journal of Industrial Ergonomics.

[14]  B. Scassellati,et al.  Social eye gaze in human-robot interaction , 2017, J. Hum. Robot Interact..

[15]  Tina Mioch,et al.  Improving Adaptive Human-Robot Cooperation through Work Agreements , 2018, 2018 27th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN).

[16]  Cynthia Breazeal,et al.  Collaboration in Human-Robot Teams , 2004, AIAA 1st Intelligent Systems Technical Conference.

[17]  Chandimal Jayawardena,et al.  A navigation model for side-by-side robotic wheelchairs for optimizing social comfort in crossing situations , 2018, Robotics Auton. Syst..

[18]  Tomás Svoboda,et al.  TRADR Project: Long-Term Human-Robot Teaming for Robot Assisted Disaster Response , 2015, KI - Künstliche Intelligenz.

[19]  Alberto Sanfeliu,et al.  Human-robot Collaborative Navigation Search using Social Reward Sources , 2019, ROBOT.

[20]  Simon M. Lucas,et al.  A Survey of Monte Carlo Tree Search Methods , 2012, IEEE Transactions on Computational Intelligence and AI in Games.

[21]  Aurélie Clodic,et al.  Key Elements for Human-Robot Joint Action , 2017 .

[22]  Roland Siegwart,et al.  The SHERPA project: Smart collaboration between humans and ground-aerial robots for improving rescuing activities in alpine environments , 2012, 2012 IEEE International Symposium on Safety, Security, and Rescue Robotics (SSRR).