Core Challenges of Social Robot Navigation: A Survey

CHRISTOFOROS MAVROGIANNIS, Paul G. Allen School of Computer Science & Engineering, University of Washington, USA FRANCESCA BALDINI, Honda Research Institute and California Institute of Technology, USA ALLAN WANG, Robotics Institute, Carnegie Mellon University, USA DAPENG ZHAO, Robotics Institute, Carnegie Mellon University, USA PETE TRAUTMAN, Honda Research Institute, USA AARON STEINFELD, Robotics Institute, Carnegie Mellon University, USA JEAN OH, Robotics Institute, Carnegie Mellon University, USA

[1]  Nicu Sebe,et al.  Analyzing Free-standing Conversational Groups: A Multimodal Approach , 2015, ACM Multimedia.

[2]  Siddhartha S. Srinivasa,et al.  Planning-based prediction for pedestrians , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[3]  Gregory C. Dachner,et al.  Local interactions underlying collective motion in human crowds , 2018, Proceedings of the Royal Society B: Biological Sciences.

[4]  Leslie A. Hayduk,et al.  Personal space: Understanding the simplex model , 1994 .

[5]  Stefania Bandini,et al.  Detection of Social Groups in Pedestrian Crowds Using Computer Vision , 2015, ACIVS.

[6]  Joon Hee Choi,et al.  DROGON: A Trajectory Prediction Model based on Intention-Conditioned Behavior Reasoning. , 2020 .

[7]  Wolfram Burgard,et al.  Monte Carlo localization for mobile robots , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[8]  Rachid Alami,et al.  A framework towards a socially aware Mobile Robot motion in Human-Centered dynamic environment , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[9]  Jonathan P. How,et al.  Motion Planning Among Dynamic, Decision-Making Agents with Deep Reinforcement Learning , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[10]  Anil M. Cheriyadat,et al.  Detecting Dominant Motions in Dense Crowds , 2008, IEEE Journal of Selected Topics in Signal Processing.

[11]  Thierry Fraichard,et al.  From Crowd Simulation to Robot Navigation in Crowds , 2020, IEEE Robotics and Automation Letters.

[12]  Alexandre Alahi,et al.  Crowd-Robot Interaction: Crowd-Aware Robot Navigation With Attention-Based Deep Reinforcement Learning , 2018, 2019 International Conference on Robotics and Automation (ICRA).

[13]  Reid Simmons,et al.  Expressive motion with x, y and theta: Laban Effort Features for mobile robots , 2014, The 23rd IEEE International Symposium on Robot and Human Interactive Communication.

[14]  Silvio Savarese,et al.  Social LSTM: Human Trajectory Prediction in Crowded Spaces , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Wolfram Burgard,et al.  Learning Motion Patterns of People for Compliant Robot Motion , 2005, Int. J. Robotics Res..

[16]  Darren Chan,et al.  Robot-Centric Perception of Human Groups , 2020 .

[17]  Piotr J. Gmytrasiewicz,et al.  Learning Others' Intentional Models in Multi-Agent Settings Using Interactive POMDPs , 2017, MAICS.

[18]  Raj Korpan,et al.  MengeROS: a Crowd Simulation Tool for Autonomous Robot Navigation , 2018, AAAI Fall Symposia.

[19]  Silvio Savarese,et al.  Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networks , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[20]  Ross A. Knepper,et al.  Multi-agent Trajectory Prediction and Generation with Topological Invariants Enforced by Hamiltonian Dynamics , 2018, WAFR.

[21]  E. Hall,et al.  The Hidden Dimension , 1970 .

[22]  Alexander Hauptmann,et al.  The Garden of Forking Paths: Towards Multi-Future Trajectory Prediction , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[23]  Maja J. Mataric,et al.  Perceptual Models of Human-Robot Proxemics , 2014, ISER.

[24]  Yoichi Sato,et al.  Social Group Discovery from Surveillance Videos: A Data-Driven Approach with Attention-Based Cues , 2013, BMVC.

[25]  Sebastian Junges,et al.  Model Checking for Safe Navigation Among Humans , 2018, QEST.

[26]  Ben J. A. Kröse,et al.  Detecting F-formations as dominant sets , 2011, ICMI '11.

[27]  Nanning Zheng,et al.  SR-LSTM: State Refinement for LSTM Towards Pedestrian Trajectory Prediction , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[28]  Huosheng Hu,et al.  A Bank of Unscented Kalman Filters for Multimodal Human Perception with Mobile Service Robots , 2010, Int. J. Soc. Robotics.

[29]  Jean Oh,et al.  Integrating Context into Artificial Intelligence: Research from the Robotics Collaborative Technology Alliance , 2019, AI Mag..

[30]  E. Goffman.  Behavior in public places : notes on the social organization of gatherings , 1964 .

[31]  W. H. Warren.  The dynamics of perception and action. , 2006, Psychological review.

[32]  Dinesh Manocha,et al.  SocioSense: Robot navigation amongst pedestrians with social and psychological constraints , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[33]  Steven M. LaValle,et al.  Randomized Kinodynamic Planning , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[34]  Illah R. Nourbakhsh,et al.  The mobot museum robot installations: a five year experiment , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[35]  Maja J. Mataric,et al.  A probabilistic framework for autonomous proxemic control in situated and mobile human-robot interaction , 2012, 2012 7th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[36]  Maja J. Mataric,et al.  People-aware navigation for goal-oriented behavior involving a human partner , 2011, 2011 IEEE International Conference on Development and Learning (ICDL).

[37]  Alberto Sanfeliu,et al.  Local optimization of cooperative robot movements for guiding and regrouping people in a guiding mission , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[38]  Anca D. Dragan,et al.  Efficient Iterative Linear-Quadratic Approximations for Nonlinear Multi-Player General-Sum Differential Games , 2019, 2020 IEEE International Conference on Robotics and Automation (ICRA).

[39]  Paolo Fiorini,et al.  Motion Planning in Dynamic Environments Using Velocity Obstacles , 1998, Int. J. Robotics Res..

[40]  Sebastian Thrun,et al.  Spontaneous, short-term interaction with mobile robots , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[41]  Uttaran Bhattacharya,et al.  Forecasting Trajectory and Behavior of Road-Agents Using Spectral Clustering in Graph-LSTMs , 2020, IEEE Robotics and Automation Letters.

[42]  J. Birman.  Braids, Links, and Mapping Class Groups. , 1975 .

[43]  Bradford J McFadyen,et al.  Characteristics of personal space during obstacle circumvention in physical and virtual environments. , 2008, Gait & posture.

[44]  Dirk Helbing.  A Fluid-Dynamic Model for the Movement of Pedestrians , 1992, Complex Syst..

[45]  Mark H. Overmars,et al.  A Predictive Collision Avoidance Model for Pedestrian Simulation , 2009, MIG.

[46]  Dinesh Manocha,et al.  Getting Robots Unfrozen and Unlost in Dense Pedestrian Crowds , 2018, IEEE Robotics and Automation Letters.

[47]  Siddhartha S. Srinivasa,et al.  Legibility and predictability of robot motion , 2013, 2013 8th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[48]  Bodo Rosenhahn,et al.  Everybody needs somebody: Modeling social and grouping behavior on a linear programming multiple people tracker , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[49]  Rachid Alami,et al.  An Adaptive and Proactive Human-Aware Robot Guide , 2015, ICSR.

[50]  Alberto Sanfeliu,et al.  Cooperative social robots to accompany groups of people , 2012, Int. J. Robotics Res..

[51]  Julien Diard,et al.  Proxemics models for human-aware navigation in robotics: Grounding interaction and personal space models in experimental data from psychology , 2014 .

[52]  Norihiro Hagita,et al.  Deciphering the Crowd: Modeling and Identification of Pedestrian Group Motion , 2013, Sensors.

[53]  Jonathan P. How,et al.  Decentralized non-communicating multiagent collision avoidance with deep reinforcement learning , 2016, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[54]  Takayuki Kanda,et al.  A Robot that Approaches Pedestrians , 2013, IEEE Transactions on Robotics.

[55]  Ting Zhu,et al.  VPBS: A Velocity-Perception-Based SFM Approach for Crowd Simulation , 2016, 2016 International Conference on Virtual Reality and Visualization (ICVRV).

[56]  Julie A. Shah,et al.  Human-robot co-navigation using anticipatory indicators of human walking motion , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[57]  Peter Trautman,et al.  Real Time Crowd Navigation from First Principles of Probability Theory , 2020, ICAPS.

[58]  Byung-Ju Yi,et al.  Control algorithms for a mobile robot tracking a human in front , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[59]  Péter Fankhauser,et al.  Modeling and Control of a Ballbot , 2010 .

[60]  Charles R. Rosenberg,et al.  Interaction With Mobile Robots in Public Places , 2000 .

[61]  Mykel J. Kochenderfer,et al.  A Taxonomy and Review of Algorithms for Modeling and Predicting Human Driver Behavior. , 2020 .

[62]  Dirk Wollherr,et al.  Human-Like Motion Planning Based on Game Theoretic Decision Making , 2018, Int. J. Soc. Robotics.

[63]  C. Allen.  Dimensions of Personality , 1947, Nature.

[64]  Nicoletta Noceti,et al.  Humans in groups: The importance of contextual information for understanding collective activities , 2014, Pattern Recognit..

[65]  G. Csibra,et al.  'Obsessed with goals': functions and mechanisms of teleological interpretation of actions in humans. , 2007, Acta psychologica.

[66]  Rachid Alami,et al.  A Human Aware Mobile Robot Motion Planner , 2007, IEEE Transactions on Robotics.

[67]  Vinícius Jurinic Cassol.  Crowdsim: a framework to estimate safety of egress performance in real life scenarios , 2016 .

[68]  Kai Oliver Arras,et al.  Socially-aware robot navigation: A learning approach , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[69]  Dirk Helbing,et al.  Self-Organizing Pedestrian Movement , 2001 .

[70]  Henrik I. Christensen,et al.  Evaluation of Passing Distance for Social Robots , 2006, ROMAN 2006 - The 15th IEEE International Symposium on Robot and Human Interactive Communication.

[71]  Sébastien Paris,et al.  Pedestrian Reactive Navigation for Crowd Simulation: a Predictive Approach , 2007, Comput. Graph. Forum.

[72]  A. Kendon.  Conducting Interaction: Patterns of Behavior in Focused Encounters , 1990 .

[73]  Alexandra Kirsch,et al.  Legible robot navigation in the proximity of moving humans , 2012, 2012 IEEE Workshop on Advanced Robotics and its Social Impacts (ARSO).

[74]  Mooi Choo Chuah,et al.  GRIP: Graph-based Interaction-aware Trajectory Prediction , 2019, 2019 IEEE Intelligent Transportation Systems Conference (ITSC).

[75]  Mark H. Overmars,et al.  Simulating and Evaluating the Local Behavior of Small Pedestrian Groups , 2012, IEEE Transactions on Visualization and Computer Graphics.

[76]  R. Simmons,et al.  COMPANION: A Constraint-Optimizing Method for Person-Acceptable Navigation , 2009, RO-MAN 2009 - The 18th IEEE International Symposium on Robot and Human Interactive Communication.

[77]  Takeshi Sakuma,et al.  Psychological model for animating crowded pedestrians , 2005, Comput. Animat. Virtual Worlds.

[78]  I. Dynnikov,et al.  On the complexity of braids , 2004, math/0403177.

[79]  Maya Cakmak,et al.  Characterizing the Design Space of Rendered Robot Faces , 2018, 2018 13th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[80]  Kai Oliver Arras,et al.  Inverse Reinforcement Learning algorithms and features for robot navigation in crowds: An experimental comparison , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[81]  Takashi Chikayama,et al.  Simulating the Collision Avoidance Behavior of Pedestrians , 2000 .

[82]  Han-Pang Huang,et al.  Robot Motion Planning in Dynamic Uncertain Environments , 2011, Adv. Robotics.

[83]  Dani Lischinski,et al.  Crowds by Example , 2007, Comput. Graph. Forum.

[84]  Jodi Forlizzi,et al.  All robots are not created equal: the design and perception of humanoid robot heads , 2002, DIS '02.

[85]  Ross A. Knepper,et al.  Multi-agent path topology in support of socially competent navigation planning , 2018, Int. J. Robotics Res..

[86]  Vittorio Murino,et al.  Online Bayesian Nonparametrics for Group Detection , 2012 .

[87]  Wolfram Burgard,et al.  A hybrid collision avoidance method for mobile robots , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[88]  Dinesh Manocha,et al.  Reciprocal Velocity Obstacles for real-time multi-agent navigation , 2008, 2008 IEEE International Conference on Robotics and Automation.

[89]  Jean Oh,et al.  Social Attention: Modeling Attention in Human Crowds , 2017, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[90]  Aaron Steinfeld,et al.  Performance of a low-cost, human-inspired perception approach for dense moving crowd navigation , 2016, 2016 25th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN).

[91]  Ross A. Knepper,et al.  Socially competent navigation planning by deep learning of multi-agent path topologies , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[92]  Daniel Thalmann,et al.  Crowd patches: populating large-scale virtual environments for real-time applications , 2009, I3D '09.

[93]  Sebastian Thrun,et al.  Online self-calibration for mobile robots , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[94]  Masayuki Nakajima,et al.  Personal Space Modeling for Human-Computer Interaction , 2009, ICEC.

[95]  Takayuki Kanda,et al.  Navigation for human-robot interaction tasks , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[96]  Li-Chen Fu,et al.  Human-Centered Robot Navigation—Towards a Harmoniously Human–Robot Coexisting Environment , 2011, IEEE Transactions on Robotics.

[97]  Aaron Steinfeld,et al.  Group Split and Merge Prediction With 3D Convolutional Networks , 2020, IEEE Robotics and Automation Letters.

[98]  Aaron Steinfeld,et al.  Follow The Robot: Modeling Coupled Human-Robot Dyads During Navigation , 2019, 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[99]  Philippe Bidaud,et al.  A framework for the design of person following behaviors for social mobile robots , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[100]  Emilio Frazzoli,et al.  Sampling-based algorithms for optimal motion planning , 2011, Int. J. Robotics Res..

[101]  François Michaud,et al.  Spartacus attending the 2005 AAAI conference , 2007, Auton. Robots.

[102]  Gonzalo Ferrer Mínguez,et al.  SOCIAL ROBOT NAVIGATION , 2013 .

[103]  Stewart Worrall,et al.  Socially Aware Crowd Navigation with Multimodal Pedestrian Trajectory Prediction for Autonomous Vehicles , 2020, 2020 IEEE 23rd International Conference on Intelligent Transportation Systems (ITSC).

[104]  Thomas Bak,et al.  Trajectory planning for robots in dynamic human environments , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[105]  Daniel Thalmann,et al.  Crowdbrush: interactive authoring of real-time crowd scenes , 2004, SCA '04.

[106]  Siddhartha S. Srinivasa,et al.  Integrating human observer inferences into robot motion planning , 2014, Auton. Robots.

[107]  Craig W. Reynolds.  Steering Behaviors For Autonomous Characters , 1999 .

[108]  Roger L. Hughes,et al.  A continuum theory for the flow of pedestrians , 2002 .

[109]  J. Reif,et al.  The Complexity of N-body Simulation , 1993, International Colloquium on Automata, Languages and Programming.

[110]  Dinesh Manocha,et al.  Smooth and collision-free navigation for multiple robots under differential-drive constraints , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[111]  Han-Pang Huang,et al.  A mobile robot that understands pedestrian spatial behaviors , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[112]  Ross A. Knepper,et al.  Effects of Distinct Robot Navigation Strategies on Human Behavior in a Crowded Environment , 2019, 2019 14th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[113]  Dirk Helbing,et al.  Simulating dynamical features of escape panic , 2000, Nature.

[114]  Joelle Pineau,et al.  Socially Adaptive Path Planning in Human Environments Using Inverse Reinforcement Learning , 2016, Int. J. Soc. Robotics.

[115]  Dinesh Manocha,et al.  Least-effort trajectories lead to emergent crowd behaviors. , 2012, Physical review. E, Statistical, nonlinear, and soft matter physics.

[116]  Dariu M. Gavrila,et al.  Human motion trajectory prediction: a survey , 2019, Int. J. Robotics Res..

[117]  Kurt Lewin,et al.  The Research Center for Group Dynamics at Massachusetts Institute of Technology. , 1945 .

[118]  John K Haas,et al.  A History of the Unity Game Engine , 2014 .

[119]  Guy Hoffman,et al.  Computational Human-Robot Interaction , 2016, Found. Trends Robotics.

[120]  Dinesh Manocha,et al.  Simulating heterogeneous crowd behaviors using personality trait theory , 2011, SCA '11.

[121]  Yoichi Sato,et al.  Future Person Localization in First-Person Videos , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[122]  Thierry Fraichard,et al.  A Short Paper about Motion Safety , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[123]  Jean Oh,et al.  Modeling cooperative navigation in dense human crowds , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[124]  Ross A. Knepper,et al.  Social Momentum: A Framework for Legible Navigation in Dynamic Multi-Agent Environments , 2018, 2018 13th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[125]  Wolfram Burgard,et al.  Socially Compliant Navigation Through Raw Depth Inputs with Generative Adversarial Imitation Learning , 2017, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[126]  Dinesh Manocha,et al.  The Hybrid Reciprocal Velocity Obstacle , 2011, IEEE Transactions on Robotics.

[127]  Joaquim B. Cavalcante Neto,et al.  Gradient‐based steering for vision‐based crowd simulation algorithms , 2017, Comput. Graph. Forum.

[128]  Wolfram Burgard,et al.  MINERVA: a second-generation museum tour-guide robot , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[129]  Jean Oh,et al.  A Generative Approach for Socially Compliant Navigation , 2020, 2020 IEEE International Conference on Robotics and Automation (ICRA).

[130]  Wolfram Burgard,et al.  Coastal navigation-mobile robot navigation with uncertainty in dynamic environments , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[131]  J. Pettré,et al.  A synthetic-vision based steering approach for crowd simulation , 2010, ACM Trans. Graph..

[132]  Christian Vollmer,et al.  Learning to navigate through crowded environments , 2010, 2010 IEEE International Conference on Robotics and Automation.

[133]  Brian Scassellati,et al.  The Oz of Wizard: Simulating the human for interaction research , 2009, 2009 4th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[134]  Morgan Quigley,et al.  ROS: an open-source Robot Operating System , 2009, ICRA 2009.

[135]  Ross A. Knepper,et al.  Pedestrian-inspired sampling-based multi-robot collision avoidance , 2012, 2012 IEEE RO-MAN: The 21st IEEE International Symposium on Robot and Human Interactive Communication.

[136]  Anthony Hoogs,et al.  Human-robot teamwork using activity recognition and human instruction , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[137]  Leslie A. Hayduk,et al.  The shape of personal space: An experimental investigation. , 1981 .

[138]  Jan Zwickel,et al.  I See What You Mean: How Attentional Selection Is Shaped by Ascribing Intentions to Others , 2012, PloS one.

[139]  Ming C. Lin,et al.  Aggregate dynamics for dense crowd simulation , 2009, ACM Trans. Graph..

[140]  Martial Hebert,et al.  Integrated Intelligence for Human-Robot Teams , 2016, ISER.

[141]  Wolfram Burgard,et al.  Socially compliant mobile robot navigation via inverse reinforcement learning , 2016, Int. J. Robotics Res..

[142]  Sandra Hirche,et al.  Synchronization in a goal-directed task: Human movement coordination with each other and robotic partners , 2011, 2011 RO-MAN.

[143]  Hideaki Kuzuoka,et al.  Reconfiguring spatial formation arrangement by robot body orientation , 2010, 2010 5th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[144]  Jonathan P. How,et al.  Socially aware motion planning with deep reinforcement learning , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[145]  Robert T. Collins,et al.  Vision-Based Analysis of Small Groups in Pedestrian Crowds , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[146]  Elena Torta,et al.  Design of Robust Robotic Proxemic Behaviour , 2011, ICSR.

[147]  Hao Jiang,et al.  Continuum crowd simulation in complex environments , 2010, Comput. Graph..

[148]  D. Helbing,et al.  Self-organizing pedestrian movement; Environment and Planning B , 2001 .

[149]  Christian Laugier,et al.  From Proxemics Theory to Socially-Aware Navigation: A Survey , 2014, International Journal of Social Robotics.

[150]  Ming-Ching Chang,et al.  Probabilistic group-level motion analysis and scenario recognition , 2011, 2011 International Conference on Computer Vision.

[151]  Luca Maria Gambardella,et al.  Human-friendly robot navigation in dynamic environments , 2013, 2013 IEEE International Conference on Robotics and Automation.

[152]  Siome Goldenstein,et al.  Crowd simulation: applying mobile grids to the social force model , 2012, The Visual Computer.

[153]  Helbing,et al.  Social force model for pedestrian dynamics. , 1995, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[154]  Mitchell A. Berger,et al.  Topological Invariants in Braid Theory , 2001 .

[155]  Emilio Frazzoli,et al.  Intention-Aware Motion Planning , 2013, WAFR.

[156]  Christoph Bartneck,et al.  Perception of affect elicited by robot motion , 2010, 2010 5th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[157]  Laurel D. Riek,et al.  Movement Coordination in Human–Robot Teams: A Dynamical Systems Approach , 2016, IEEE Transactions on Robotics.

[158]  Chris L. Baker,et al.  Action understanding as inverse planning , 2009, Cognition.

[159]  Andreas Krause,et al.  Unfreezing the robot: Navigation in dense, interacting crowds , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[160]  Rachid Alami,et al.  Viewing Robot Navigation in Human Environment as a Cooperative Activity , 2017, ISRR.

[161]  M. Tomizuka,et al.  EvolveGraph: Multi-Agent Trajectory Prediction with Dynamic Relational Reasoning , 2020, NeurIPS.

[162]  Richard T. Vaughan,et al.  The Player/Stage Project: Tools for Multi-Robot and Distributed Sensor Systems , 2003 .

[163]  Ruslan Salakhutdinov,et al.  Multiple Futures Prediction , 2019, NeurIPS.

[164]  Rachid Alami,et al.  Human-aware robot navigation: A survey , 2013, Robotics Auton. Syst..

[165]  Satoshi Kagami,et al.  A probabilistic model of human motion and navigation intent for mobile robot path planning , 2000, 2009 4th International Conference on Autonomous Robots and Agents.

[166]  Ken-ichiro Sugiyama,et al.  Perception of Pedestrian Avoidance Strategies of a Self-Balancing Mobile Robot , 2019, 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[167]  Scott E. Hudson,et al.  Social Group Interactions in a Role-Playing Game , 2015, HRI.

[168]  Dinesh Manocha,et al.  ClearPath: highly parallel collision avoidance for multi-agent simulation , 2009, SCA '09.

[169]  Greg Mori,et al.  Relational Graph Learning for Crowd Navigation , 2019, 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[170]  Martial Hebert,et al.  Activity Forecasting , 2012, ECCV.

[171]  Sergey Levine,et al.  PRECOG: PREdiction Conditioned on Goals in Visual Multi-Agent Settings , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[172]  Takayuki Kanda,et al.  Group attention control for communication robots with Wizard of OZ approach , 2007, 2007 2nd ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[173]  Sebastian Thrun,et al.  Perspectives on standardization in mobile robot programming: the Carnegie Mellon Navigation (CARMEN) Toolkit , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[174]  Roland Siegwart,et al.  Robox at Expo.02: A large-scale installation of personal robots , 2003, Robotics Auton. Syst..

[175]  Kai Oliver Arras,et al.  Multi-Hypothesis Social Grouping and Tracking for Mobile Robots , 2013, Robotics: Science and Systems.

[176]  Wolfram Burgard,et al.  Multi-model Hypothesis Group Tracking and Group Size Estimation , 2010, Int. J. Soc. Robotics.

[177]  Takayuki Kanda,et al.  Towards a Socially Acceptable Collision Avoidance for a Mobile Robot Navigating Among Pedestrians Using a Pedestrian Model , 2014, International Journal of Social Robotics.

[178]  Yoram Koren,et al.  Potential field methods and their inherent limitations for mobile robot navigation , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[179]  Ioannis Karamouzas,et al.  Universal power law governing pedestrian interactions. , 2014, Physical review letters.

[180]  Leila Takayama,et al.  Influences on proxemic behaviors in human-robot interaction , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[181]  Panos E. Trahanias,et al.  Probabilistic Autonomous Robot Navigation in Dynamic Environments with Human Motion Prediction , 2010, Int. J. Soc. Robotics.

[182]  Chonhyon Park,et al.  HI Robot: Human intention-aware robot planning for safe and efficient navigation in crowds , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[183]  Ninad Pradhan,et al.  Robot crowd navigation using predictive position fields in the potential function framework , 2011, Proceedings of the 2011 American Control Conference.

[184]  Pooyan Fazli,et al.  DeepMoTIon: Learning to Navigate Like Humans , 2018, 2019 28th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN).

[185]  Dinesh Manocha,et al.  Interactive navigation of multiple agents in crowded environments , 2008, I3D '08.

[186]  G. Kantor,et al.  Human-Robot Physical Interaction with dynamically stable mobile robots , 2009, 2009 4th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[187]  J. S. Wiggins,et al.  The five-factor model of personality : theoretical perspectives , 1996 .

[188]  Dapeng Zhao,et al.  Noticing Motion Patterns: A Temporal CNN With a Novel Convolution Operator for Human Trajectory Prediction , 2021, IEEE Robotics and Automation Letters.

[189]  Takayuki Kanda,et al.  How to approach humans?-strategies for social robots to initiate interaction , 2009, 2009 4th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[190]  Andrew Howard,et al.  Design and use paradigms for Gazebo, an open-source multi-robot simulator , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[191]  Dinesh Manocha,et al.  Directing Crowd Simulations Using Navigation Fields , 2011, IEEE Transactions on Visualization and Computer Graphics.

[192]  Rachid Alami,et al.  Rackham: An Interactive Robot-Guide , 2006, ROMAN 2006 - The 15th IEEE International Symposium on Robot and Human Interactive Communication.

[193]  Albert S. Huang,et al.  A Bayesian nonparametric approach to modeling motion patterns , 2011, Auton. Robots.

[194]  Patric Jensfelt,et al.  Human- and Situation-Aware People Following , 2007, RO-MAN 2007 - The 16th IEEE International Symposium on Robot and Human Interactive Communication.

[195]  Gregory D. Hager,et al.  Probabilistic data association methods in visual tracking of groups , 2004, CVPR 2004.

[196]  Wolfram Burgard,et al.  The Interactive Museum Tour-Guide Robot , 1998, AAAI/IAAI.

[197]  Reid G. Simmons,et al.  Natural person-following behavior for social robots , 2007, 2007 2nd ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[198]  Paul W. Goldberg,et al.  The complexity of computing a Nash equilibrium , 2006, STOC '06.

[199]  Benjamin Kuipers,et al.  Robot navigation with model predictive equilibrium point control , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[200]  Siddhartha S. Srinivasa,et al.  Multimodal Trajectory Prediction via Topological Invariance for Navigation at Uncontrolled Intersections , 2020, CoRL.

[201]  Antonios Gasteratos,et al.  Recent trends in social aware robot navigation: A survey , 2017, Robotics Auton. Syst..

[202]  Takayuki Kanda,et al.  May I help you? - Design of Human-like Polite Approaching Behavior- , 2015, 2015 10th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[203]  Andreas Krause,et al.  Robot navigation in dense human crowds: Statistical models and experimental studies of human–robot cooperation , 2015, Int. J. Robotics Res..

[204]  André Platzer,et al.  Formal verification of obstacle avoidance and navigation of ground robots , 2016, Int. J. Robotics Res..

[205]  B. Faverjon,et al.  Probabilistic Roadmaps for Path Planning in High-Dimensional Con(cid:12)guration Spaces , 1996 .

[206]  Wolfram Burgard,et al.  Multiple Hypothesis Tracking of Clusters of People , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[207]  Nathan Tsoi,et al.  SEAN-EP: A Platform for Collecting Human Feedback for Social Robot Navigation at Scale , 2020, ArXiv.

[208]  Irene Macaluso,et al.  The perception loop in CiceRobot, a museum guide robot , 2009, Neurocomputing.

[209]  Alexandra Kirsch,et al.  Influence of legibility on perceived safety in a virtual human-robot path crossing task , 2012, 2012 IEEE RO-MAN: The 21st IEEE International Symposium on Robot and Human Interactive Communication.

[210]  Dirk Wollherr,et al.  Measuring the Effectiveness of Readability for Mobile Robot Locomotion , 2016, Int. J. Soc. Robotics.

[211]  Francesco Setti,et al.  F-Formation Detection: Individuating Free-Standing Conversational Groups in Images , 2015, PloS one.

[212]  Vittorio Murino,et al.  Decentralized particle filter for joint individual-group tracking , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[213]  David Hsu,et al.  Intention-aware online POMDP planning for autonomous driving in a crowd , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[214]  Andrea Cavallaro,et al.  Detection and tracking of groups in crowd , 2013, 2013 10th IEEE International Conference on Advanced Video and Signal Based Surveillance.

[215]  Sergey Levine,et al.  Deep Imitative Models for Flexible Inference, Planning, and Control , 2018, ICLR.

[216]  Abduallah A. Mohamed,et al.  Social-STGCNN: A Social Spatio-Temporal Graph Convolutional Neural Network for Human Trajectory Prediction , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[217]  Rachid Alami,et al.  A step towards a sociable robot guide which monitors and adapts to the person's activities , 2009, 2009 International Conference on Advanced Robotics.

[218]  Adrien Treuille,et al.  Continuum crowds , 2006, SIGGRAPH 2006.

[219]  Shin'ichi Yuta,et al.  Crowding and guiding groups of humans by teams of mobile robots , 2005, IEEE Workshop on Advanced Robotics and its Social Impacts, 2005..

[220]  Bilge Mutlu,et al.  The influence of height in robot-mediated communication , 2013, 2013 8th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[221]  Takayuki Kanda,et al.  Escaping from Children’s Abuse of Social Robots , 2015, 2015 10th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[222]  Luc Van Gool,et al.  You'll never walk alone: Modeling social behavior for multi-target tracking , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[223]  Sebastian Thrun,et al.  Lifelong robot learning , 1993, Robotics Auton. Syst..

[224]  K. Dion.  Group cohesion: From "field of forces" to multidimensional construct. , 2000 .

[225]  Luc Van Gool,et al.  Improving Data Association by Joint Modeling of Pedestrian Trajectories and Groupings , 2010, ECCV.

[226]  Gwenn Englebienne,et al.  Dynamics of social positioning patterns in group-robot interactions , 2015, 2015 24th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN).

[227]  Jaroslaw Was,et al.  Social Distances Model of Pedestrian Dynamics , 2006, ACRI.

[228]  Laurel D. Riek,et al.  Coordination Dynamics in Multihuman Multirobot Teams , 2017, IEEE Robotics and Automation Letters.

[229]  Silvio Savarese,et al.  SoPhie: An Attentive GAN for Predicting Paths Compliant to Social and Physical Constraints , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[230]  John W. Sheppard,et al.  Inference Complexity in Continuous Time Bayesian Networks , 2014, UAI.

[231]  Siddhartha S. Srinivasa,et al.  Implicit Multiagent Coordination at Unsignalized Intersections via Multimodal Inference Enabled by Topological Braids , 2020 .

[232]  Juan Carlos Niebles,et al.  Peeking Into the Future: Predicting Future Person Activities and Locations in Videos , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[233]  Silvio Savarese,et al.  Discovering Groups of People in Images , 2014, ECCV.

[234]  Bruce A. Maxwell,et al.  Building robot systems to interact with people in real environments , 2007, Auton. Robots.

[235]  Bilge Mutlu,et al.  Communication of Intent in Assistive Free Flyers , 2014, 2014 9th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[236]  Dinesh Manocha,et al.  Reciprocal n-Body Collision Avoidance , 2011, ISRR.

[237]  Scott E. Hudson,et al.  Parallel detection of conversational groups of free-standing people and tracking of their lower-body orientation , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[238]  Stephen Tyree,et al.  Reinforcement Learning through Asynchronous Advantage Actor-Critic on a GPU , 2016, ICLR.

[239]  Oussama Khatib,et al.  Real-Time Obstacle Avoidance for Manipulators and Mobile Robots , 1985, Autonomous Robot Vehicles.

[240]  Bir Bhanu,et al.  Tracking People by Evolving Social Groups: An Approach with Social Network Perspective , 2015, 2015 IEEE Winter Conference on Applications of Computer Vision.

[241]  Wolfram Burgard,et al.  Probabilistic Algorithms and the Interactive Museum Tour-Guide Robot Minerva , 2000, Int. J. Robotics Res..

[242]  Gregory F. Cooper,et al.  The Computational Complexity of Probabilistic Inference Using Bayesian Belief Networks , 1990, Artif. Intell..

[243]  Trung Dung Ngo,et al.  Toward Socially Aware Robot Navigation in Dynamic and Crowded Environments: A Proactive Social Motion Model , 2017, IEEE Transactions on Automation Science and Engineering.

[244]  David C. Hogg,et al.  Who knows who - Inverting the Social Force Model for finding groups , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[245]  Francesco Solera,et al.  Socially Constrained Structural Learning for Groups Detection in Crowd , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[246]  Dinesh Manocha,et al.  Menge: A Modular Framework for Simulating Crowd Movement , 2016 .