Human-Like Motion Planning Based on Game Theoretic Decision Making

Robot motion planners are increasingly being equipped with an intriguing property: human likeness. This property can enhance human–robot interactions and is essential for a convincing computer animation of humans. This paper presents a (multi-agent) motion planner for dynamic environments that generates human-like motion. The presented motion planner stands out against other motion planners by explicitly modeling human-like decision making and taking interdependencies between individuals into account, which is achieved by applying game theory. Non-cooperative games and the concept of a Nash equilibrium are used to formulate the decision process that describes human motion behavior while walking in a populated environment. We evaluate whether our approach generates human-like motions through two experiments: a video study showing simulated, moving pedestrians, wherein the participants are passive observers, and a collision avoidance study, wherein the participants interact within virtual reality with an agent that is controlled by different motion planners. The experiments are designed as variations of the Turing test, which determines whether participants can differentiate between human motions and artificially generated motions. The results of both studies coincide and show that the participants could not distinguish between human motion behavior and our artificial behavior based on game theory. In contrast, the participants could distinguish human motions from motions based on established planners, such as the reciprocal velocity obstacles or social forces.

[1]  T. Kanda,et al.  Social force model with explicit collision prediction , 2011 .

[2]  Henrik I. Christensen,et al.  Evaluation of Passing Distance for Social Robots , 2006, ROMAN 2006 - The 15th IEEE International Symposium on Robot and Human Interactive Communication.

[3]  Martin Buss,et al.  Increasing Helpfulness towards a Robot by Emotional Adaption to the User , 2013, International Journal of Social Robotics.

[4]  T. Başar,et al.  Dynamic Noncooperative Game Theory , 1982 .

[5]  G. Csibra,et al.  Goal attribution without agency cues: the perception of ‘pure reason’ in infancy , 1999, Cognition.

[6]  Denis Gillet,et al.  A hamilton-jacobi formulation for cooperative control of multi-agent systems , 2009, 2009 IEEE International Conference on Systems, Man and Cybernetics.

[7]  Kris M. Kitani,et al.  A Game-Theoretic Approach to Multi-Pedestrian Activity Forecasting , 2016, ArXiv.

[8]  Stephen Bitgood,et al.  Not Another Step! Economy of Movement and Pedestrian Choice Point Behavior in Shopping Malls , 2006 .

[9]  Alexandre M. Bayen,et al.  A time-dependent Hamilton-Jacobi formulation of reachable sets for continuous dynamic games , 2005, IEEE Transactions on Automatic Control.

[10]  Pete Trautman,et al.  Sparse interacting Gaussian processes: Efficiency and optimality theorems of autonomous crowd navigation , 2017, 2017 IEEE 56th Annual Conference on Decision and Control (CDC).

[11]  F. Heider,et al.  An experimental study of apparent behavior , 1944 .

[12]  Siddhartha S. Srinivasa,et al.  Mathematical Models of Adaptation in Human-Robot Collaboration , 2017, ArXiv.

[13]  R. Simmons,et al.  COMPANION: A Constraint-Optimizing Method for Person-Acceptable Navigation , 2009, RO-MAN 2009 - The 18th IEEE International Symposium on Robot and Human Interactive Communication.

[14]  Krzysztof Skrzypczyk,et al.  GAME THEORY BASED TASK PLANNING IN MULTI ROBOT SYSTEMS , 2004 .

[15]  Manfred Tscheligi,et al.  The Interactive Urban Robot: User-centered development and final field trial of a direction requesting robot , 2015, Paladyn J. Behav. Robotics.

[16]  Jonathan P. How,et al.  Decentralized non-communicating multiagent collision avoidance with deep reinforcement learning , 2016, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[17]  Rachid Alami,et al.  Human-aware robot navigation: A survey , 2013, Robotics Auton. Syst..

[18]  Siddhartha S. Srinivasa,et al.  Game-Theoretic Modeling of Human Adaptation in Human-Robot Collaboration , 2017, 2017 12th ACM/IEEE International Conference on Human-Robot Interaction (HRI.

[19]  Yoav Shoham,et al.  Essentials of Game Theory: A Concise Multidisciplinary Introduction , 2008, Essentials of Game Theory: A Concise Multidisciplinary Introduction.

[20]  C. Frith,et al.  Movement and Mind: A Functional Imaging Study of Perception and Interpretation of Complex Intentional Movement Patterns , 2000, NeuroImage.

[21]  Stéphane Donikian,et al.  Experiment-based modeling, simulation and validation of interactions between virtual walkers , 2009, SCA '09.

[22]  Susan R. Fussell,et al.  Anthropomorphic Interactions with a Robot and Robot–like Agent , 2008 .

[23]  Roland Siegwart,et al.  Smooth and efficient obstacle avoidance for a tour guide robot , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[24]  Martin Buss,et al.  Understanding Human Avoidance Behavior: Interaction-Aware Decision Making Based on Game Theory , 2016, Int. J. Soc. Robotics.

[25]  William Whittaker,et al.  Autonomous Driving in Traffic: Boss and the Urban Challenge , 2009, AI Mag..

[26]  Michelle Karg,et al.  Body Movements for Affective Expression: A Survey of Automatic Recognition and Generation , 2013, IEEE Transactions on Affective Computing.

[27]  Martin Buss,et al.  Cooperative Dynamic Manipulation of Unknown Flexible Objects , 2017, International Journal of Social Robotics.

[28]  J. Cacioppo,et al.  On seeing human: a three-factor theory of anthropomorphism. , 2007, Psychological review.

[29]  Martin Buss,et al.  IURO – Soziale Mensch-Roboter-Interaktion in den Straßen von München , 2015, Autom..

[30]  Ross A. Knepper,et al.  Socially competent navigation planning by deep learning of multi-agent path topologies , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[31]  Julien Pettré,et al.  Collision avoidance between two walkers: role-dependent strategies. , 2013, Gait & posture.

[32]  Dinesh Manocha,et al.  Reciprocal n-Body Collision Avoidance , 2011, ISRR.

[33]  Volodymyr Kuleshov,et al.  Inverse Game Theory: Learning Utilities in Succinct Games , 2015, WINE.

[34]  Atsuo Takanishi,et al.  Perception of emotion and emotional intensity in humanoid robots gait , 2013, 2013 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[35]  C. Bartneck,et al.  Perception of affect elicited by robot motion , 2010, HRI 2010.

[36]  Martin Buss,et al.  The Interactive Urban Robot IURO: Towards Robot Action in Human Environments , 2014, ISER.

[37]  Martin Buss,et al.  Interactive navigation of humans from a game theoretic perspective , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[38]  Dirk Helbing,et al.  Specification of the Social Force Pedestrian Model by Evolutionary Adjustment to Video Tracking Data , 2007, Adv. Complex Syst..

[39]  Vijay Kumar,et al.  Motion planning with uncertainty , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[40]  Anca D. Dragan,et al.  Planning for Autonomous Cars that Leverage Effects on Human Actions , 2016, Robotics: Science and Systems.

[41]  J. Cacioppo,et al.  Who Sees Human? , 2010, Perspectives on psychological science : a journal of the Association for Psychological Science.

[42]  Dirk Wollherr,et al.  A game-theoretic approach for adaptive action selection in close proximity human-robot-collaboration , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[43]  Christina L. Bloebaum,et al.  Modeling Decision and Game Theory Based Pedestrian Velocity Vector Decisions with Interacting Individuals , 2016 .

[44]  Atsushi Yamashita,et al.  Development of pedestrian behavior model taking account of intention , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[45]  Anca D. Dragan,et al.  Robot Planning with Mathematical Models of Human State and Action , 2017, ArXiv.

[46]  Ming Zhu,et al.  Human-inspired robot navigation in unknown dynamic environments , 2016 .

[47]  Takayuki Kanda,et al.  Towards a Socially Acceptable Collision Avoidance for a Mobile Robot Navigating Among Pedestrians Using a Pedestrian Model , 2014, International Journal of Social Robotics.

[48]  A. Rubinstein Modeling Bounded Rationality , 1998 .

[49]  D. Wolfe,et al.  Nonparametric Statistical Methods. , 1974 .

[50]  Jason P. Mitchell,et al.  Dissociable Medial Prefrontal Contributions to Judgments of Similar and Dissimilar Others , 2006, Neuron.

[51]  Takashi Minato,et al.  Construction and evaluation of a model of natural human motion based on motion diversity , 2008, 2008 3rd ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[52]  W. Banks,et al.  Animal-assisted therapy and loneliness in nursing homes: use of robotic versus living dogs. , 2008, Journal of the American Medical Directors Association.

[53]  Martin Buss,et al.  Socio-Contextual Constraints for Human Approach with a Mobile Robot , 2017, Int. J. Soc. Robotics.

[54]  Wolfram Burgard,et al.  Socially compliant mobile robot navigation via inverse reinforcement learning , 2016, Int. J. Robotics Res..

[55]  Anders Johansson,et al.  of a Microscopic Pedestrian Model by Evolutionary Adjustment to Video Tracking Data , 2008, 0810.4587.

[56]  Rachid Alami,et al.  Viewing Robot Navigation in Human Environment as a Cooperative Activity , 2017, ISRR.

[57]  S. LaValle,et al.  Randomized Kinodynamic Planning , 2001 .

[58]  Christian A. Gonzalez,et al.  Seeing Minds in Others – Can Agents with Robotic Appearance Have Human-Like Preferences? , 2016, PloS one.

[59]  Reza Monsefi,et al.  A novel algorithm for coalition formation in Multi-Agent Systems using cooperative game theory , 2010, 2010 18th Iranian Conference on Electrical Engineering.

[60]  C. Borror Nonparametric Statistical Methods, 2nd, Ed. , 2001 .

[61]  Carey K. Morewedge,et al.  Timescale bias in the attribution of mind. , 2007, Journal of personality and social psychology.

[62]  M. Mori THE UNCANNY VALLEY , 2020, The Monster Theory Reader.

[63]  Andreas Lawitzky,et al.  A Game-Theoretic Approach to Replanning-Aware Interactive Scene Prediction and Planning , 2016, IEEE Transactions on Vehicular Technology.

[64]  Douglas A. Wolfe,et al.  Nonparametric Statistical Methods , 1973 .

[65]  Emilio Frazzoli,et al.  Game theoretic controller synthesis for multi-robot motion planning Part I: Trajectory based algorithms , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[66]  Luc Van Gool,et al.  You'll never walk alone: Modeling social behavior for multi-target tracking , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[67]  Serge P. Hoogendoorn,et al.  Simulation of pedestrian flows by optimal control and differential games , 2003 .

[68]  Andreas Krause,et al.  Robot navigation in dense human crowds: Statistical models and experimental studies of human–robot cooperation , 2015, Int. J. Robotics Res..

[69]  Wolfram Burgard,et al.  Socially Inspired Motion Planning for Mobile Robots in Populated Environments , 2008 .

[70]  Karl F. MacDorman,et al.  The Uncanny Valley [From the Field] , 2012, IEEE Robotics Autom. Mag..

[71]  S. Shankar Sastry,et al.  Probabilistic pursuit-evasion games: theory, implementation, and experimental evaluation , 2002, IEEE Trans. Robotics Autom..

[72]  U. Frith,et al.  Do triangles play tricks? Attribution of mental states to animated shapes in normal and abnormal development , 2000 .

[73]  Milad Geravand,et al.  An Integrated Decision Making Approach for Adaptive Shared Control of Mobility Assistance Robots , 2016, International Journal of Social Robotics.

[74]  Christian Laugier,et al.  From Proxemics Theory to Socially-Aware Navigation: A Survey , 2014, International Journal of Social Robotics.

[75]  Safraz Rampersaud,et al.  Computing Nash Equilibria in Bimatrix Games: GPU-Based Parallel Support Enumeration , 2014, IEEE Trans. Parallel Distributed Syst..

[76]  Takayuki Kanda,et al.  Navigation for human-robot interaction tasks , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[77]  J. Nash NON-COOPERATIVE GAMES , 1951, Classics in Game Theory.

[78]  Ioannis Karamouzas,et al.  Exploiting Motion Capture to Enhance Avoidance Behaviour in Games , 2009, MIG.

[79]  José Hernández-Orallo,et al.  AI Evaluation: past, present and future , 2014, ArXiv.

[80]  Graham Romp Game Theory: Introduction and Applications , 1997 .

[81]  Daniel Grosu,et al.  Parallel Computation of Nash Equilibria in N-Player Games , 2009, 2009 International Conference on Computational Science and Engineering.

[82]  Marie-Therese Wolfram,et al.  On a mean field game approach modeling congestion and aversion in pedestrian crowds , 2011 .

[83]  Christian Dogbé,et al.  Modeling crowd dynamics by the mean-field limit approach , 2010, Math. Comput. Model..

[84]  Brian Scassellati,et al.  Effects of form and motion on judgments of social robots' animacy, likability, trustworthiness and unpleasantness , 2016, Int. J. Hum. Comput. Stud..

[85]  Ehud Sharlin,et al.  Exploring the affect of abstract motion in social human-robot interaction , 2011, 2011 RO-MAN.

[86]  Helbing,et al.  Social force model for pedestrian dynamics. , 1995, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[87]  Dirk Wollherr,et al.  Investigating similarity measures for locomotor trajectories based on the human perception of differences in motions , 2015, 2015 IEEE International Workshop on Advanced Robotics and its Social Impacts (ARSO).

[88]  Yuan Cheng,et al.  Modeling cooperative and competitive behaviors in emergency evacuation: A game-theoretical approach , 2011, Comput. Math. Appl..

[89]  Dinesh Manocha,et al.  DenseSense: interactive crowd simulation using density-dependent filters , 2014, SCA '14.

[90]  Volodymyr Kuleshov Inverse Game Theory , 2015 .

[91]  Steven M. LaValle,et al.  Game theory as a unifying structure for a variety of robot tasks , 1993, Proceedings of 8th IEEE International Symposium on Intelligent Control.

[92]  Martin Buss,et al.  Proactively Approaching Pedestrians with an Autonomous Mobile Robot in Urban Environments , 2012, ISER.

[93]  Susan C. Johnson Detecting agents. , 2003, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[94]  Aya Hagishima,et al.  Study of bottleneck effect at an emergency evacuation exit using cellular automata model, mean field approximation analysis, and game theory , 2010 .

[95]  A. Colman Cooperation, psychological game theory, and limitations of rationality in social interaction , 2003, Behavioral and Brain Sciences.

[96]  Dirk Wollherr,et al.  Measuring the Effectiveness of Readability for Mobile Robot Locomotion , 2016, Int. J. Soc. Robotics.

[97]  Yan Meng Multi-Robot Searching using Game-Theory Based Approach , 2008 .