Socially Aware Path Planning for a Flying Robot in Close Proximity of Humans

In this article, we present a preliminary motion planning framework for a cyber-physical system consisting of a human and a flying robot in vicinity. The motion planning of the flying robot takes into account the human’s safety perception. We aim to determine a parametric model for the human’s safety perception based on test data. We use virtual reality as a safe testing environment to collect safety perception data reflected on galvanic skin response (GSR) from the test subjects experiencing a flying robot in their vicinity. The GSR signal contains both meaningful information driven by the interaction with the robot and also disturbances from unknown factors. To address the issue, we use two parametric models to approximate the GSR data: (1) a function of the robot’s position and velocity and (2) a random distribution. Intuitively, we need to choose the more likely model given the data. When GSR is statistically independent of the flying robot, then the random distribution should be selected instead of the function of the robot’s position and velocity. We implement the intuitive idea under the framework of hidden Markov model (HMM) estimation. As a result, the proposed HMM-based model improves the likelihood compared to the Gaussian noise model, which does not make a distinction between relevant and irrelevant samples due to unknown factors. We also present a numerical optimal path planning method that considers the safety perception model while ensuring spatial separation from the obstacle despite the time discretization. Optimal paths generated using the proposed model result in a reasonably safe distance from the human. In contrast, the trajectories generated by the standard regression model with the Gaussian noise assumption, without consideration of unknown factors, have undesirable shapes.

[1]  James Everett Young,et al.  Communicating affect via flight path Exploring use of the Laban Effort System for designing affective locomotion paths , 2013, 2013 8th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[2]  Dimitrios Tzovaras,et al.  Robot's Workspace Enhancement with Dynamic Human Presence for Socially-Aware Navigation , 2017, ICVS.

[3]  Rachid Alami,et al.  Human-aware robot navigation: A survey , 2013, Robotics Auton. Syst..

[4]  Kai Oliver Arras,et al.  Inverse Reinforcement Learning algorithms and features for robot navigation in crowds: An experimental comparison , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[5]  Amy LaViers,et al.  A Design Methodology for Abstracting Character Archetypes onto Robotic Systems , 2018, MOCO.

[6]  I. Kaminer,et al.  Optimal Motion Planning for Differentially Flat Systems Using Bernstein Approximation , 2018, IEEE Control Systems Letters.

[7]  Naira Hovakimyan,et al.  Hidden Markov Model Estimation-Based Q-learning for Partially Observable Markov Decision Process , 2018, 2019 American Control Conference (ACC).

[8]  Michael C. Mozer,et al.  Sequential Dependencies in Human Behavior Offer Insights Into Cognitive Control , 2007, Integrated Models of Cognitive Systems.

[9]  Lorenz T. Biegler,et al.  On the implementation of an interior-point filter line-search algorithm for large-scale nonlinear programming , 2006, Math. Program..

[10]  Bilge Mutlu,et al.  Communication of Intent in Assistive Free Flyers , 2014, 2014 9th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[11]  Robin R. Murphy,et al.  Effects of Speed, Cyclicity, and Dimensionality on Distancing, Time, and Preference in Human-Aerial Vehicle Interactions , 2017, ACM Trans. Interact. Intell. Syst..

[12]  Mircea D. Farcas,et al.  About Bernstein polynomials , 2008 .

[13]  Kai Oliver Arras,et al.  Socially-aware robot navigation: A learning approach , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[14]  James A. Landay,et al.  Emotion encoding in Human-Drone Interaction , 2016, 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[15]  Luis J. Manso,et al.  Socially aware robot navigation system in human-populated and interactive environments based on an adaptive spatial density function and space affordances , 2019, Pattern Recognit. Lett..

[16]  James A. Landay,et al.  Drone & me: an exploration into natural human-drone interaction , 2015, UbiComp.

[17]  Bilge Mutlu,et al.  Communicating Directionality in Flying Robots , 2015, 2015 10th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[18]  Jur P. van den Berg,et al.  Kinodynamic RRT*: Asymptotically optimal motion planning for robots with linear dynamics , 2013, 2013 IEEE International Conference on Robotics and Automation.

[19]  Naira Hovakimyan,et al.  VR Environment for the Study of Collocated Interaction Between Small UAVs and Humans , 2017 .

[20]  L. Baum,et al.  A Maximization Technique Occurring in the Statistical Analysis of Probabilistic Functions of Markov Chains , 1970 .

[21]  Robin R. Murphy,et al.  Comfortable approach distance with small Unmanned Aerial Vehicles , 2013, 2013 IEEE RO-MAN.

[22]  M. Benedek,et al.  A continuous measure of phasic electrodermal activity , 2010, Journal of Neuroscience Methods.

[23]  E. Hall,et al.  The Hidden Dimension , 1970 .

[24]  Brittany A. Duncan,et al.  Investigation of human-robot comfort with a small Unmanned Aerial Vehicle compared to a ground robot , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[25]  Naira Hovakimyan,et al.  A trajectory-generation framework for time-critical cooperative missions , 2013 .

[26]  S. Sathiya Keerthi,et al.  A fast procedure for computing the distance between complex objects in three-dimensional space , 1988, IEEE J. Robotics Autom..

[27]  François Laviolette,et al.  Domain-Adversarial Training of Neural Networks , 2015, J. Mach. Learn. Res..

[28]  W. Zangwill Non-Linear Programming Via Penalty Functions , 1967 .

[29]  Rachid Alami,et al.  A Human Aware Mobile Robot Motion Planner , 2007, IEEE Transactions on Robotics.

[30]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[31]  Morgan Quigley,et al.  ROS: an open-source Robot Operating System , 2009, ICRA 2009.

[32]  M. Joosse,et al.  Cultural differences in how an engagement-seeking robot should approach a group of people , 2014, CABS '14.

[33]  Jonathan P. How,et al.  Socially aware motion planning with deep reinforcement learning , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[34]  M. Stone The Generalized Weierstrass Approximation Theorem , 1948 .

[35]  Björn W. Schuller,et al.  On-line continuous-time music mood regression with deep recurrent neural networks , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[36]  David Hsu,et al.  QMDP-Net: Deep Learning for Planning under Partial Observability , 2017, NIPS.

[37]  Antonios Gasteratos,et al.  Recent trends in social aware robot navigation: A survey , 2017, Robotics Auton. Syst..

[38]  Hugo Larochelle,et al.  Neural Autoregressive Distribution Estimation , 2016, J. Mach. Learn. Res..

[39]  John Travis Butler,et al.  Psychological Effects of Behavior Patterns of a Mobile Personal Robot , 2001, Auton. Robots.

[40]  Gerald E. Farin,et al.  The essentials of CAGD , 2000 .

[41]  David Hunter,et al.  On the error term of symmetric Gauss-Lobatto quadrature formulae for analytic functions , 2000, Math. Comput..

[42]  Hang Cui,et al.  VR study of human-multicopter interaction in a residential setting , 2016, VR.

[43]  Patrick Rives,et al.  Adaptive spacing in human-robot interactions , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[44]  R. Laban,et al.  The mastery of movement , 1950 .

[45]  Gamal N. Elnagar,et al.  The pseudospectral Legendre method for discretizing optimal control problems , 1995, IEEE Trans. Autom. Control..

[46]  Larry Wasserman,et al.  All of Statistics: A Concise Course in Statistical Inference , 2004 .

[47]  L. Ryan Lewis,et al.  Collision-Free Multi-UAV Optimal Path Planning and Cooperative Control for Tactical Applications , 2008 .