A Path Planning Framework for a Flying Robot in Close Proximity of Humans

We present a path planning framework that takes into account the human's safety perception in the presence of a flying robot. The framework addresses two objectives: (i) estimation of the uncertain parameters of the proposed safety perception model based on test data collected using Virtual Reality (VR) testbed, and (ii) offline optimal control computation using the estimated safety perception model. Due to the unknown factors in the human tests data, it is not suitable to use standard regression techniques that minimize the mean squared error (MSE). We propose to use a Hidden Markov model (HMM) approach where human's attention is considered as a hidden state to infer whether the data samples are relevant to learn the safety perception model. The HMM approach improved log-likelihood over the standard least squares solution. For path planning, we use Bernstein polynomials for discretization, as the resulting path remains within the convex hull of the control points, providing guarantees for deconfliction with obstacles at low computational cost. An example of optimal trajectory generation using the learned human model is presented. The optimal trajectory generated using the proposed model results in reasonable safety distance from the human. In contrast, the paths generated using the standard regression model have undesirable shapes due to overfitting. The example demonstrates that the HMM approach has robustness to the unknown factors compared to the standard MSE model.

[1]  Nasser M. Nasrabadi,et al.  Pattern Recognition and Machine Learning , 2006, Technometrics.

[2]  Naira Hovakimyan,et al.  VR Environment for the Study of Collocated Interaction Between Small UAVs and Humans , 2017 .

[3]  W. Zangwill Non-Linear Programming Via Penalty Functions , 1967 .

[4]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[5]  Hugo Larochelle,et al.  Neural Autoregressive Distribution Estimation , 2016, J. Mach. Learn. Res..

[6]  Sumio Watanabe,et al.  Stochastic complexities of hidden Markov models , 2003, 2003 IEEE XIII Workshop on Neural Networks for Signal Processing (IEEE Cat. No.03TH8718).

[7]  James A. Landay,et al.  Drone & me: an exploration into natural human-drone interaction , 2015, UbiComp.

[8]  Robin R. Murphy,et al.  Comfortable approach distance with small Unmanned Aerial Vehicles , 2013, 2013 IEEE RO-MAN.

[9]  Naira Hovakimyan,et al.  Trajectory generation using spatial Pythagorean hodograph Bézier curves , 2015 .

[10]  Larry Wasserman,et al.  All of Statistics: A Concise Course in Statistical Inference , 2004 .

[11]  M. Benedek,et al.  A continuous measure of phasic electrodermal activity , 2010, Journal of Neuroscience Methods.

[12]  James Everett Young,et al.  Communicating affect via flight path Exploring use of the Laban Effort System for designing affective locomotion paths , 2013, 2013 8th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[13]  Björn W. Schuller,et al.  On-line continuous-time music mood regression with deep recurrent neural networks , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[14]  Zoubin Ghahramani,et al.  An Introduction to Hidden Markov Models and Bayesian Networks , 2001, Int. J. Pattern Recognit. Artif. Intell..

[15]  R. Laban,et al.  The mastery of movement , 1950 .

[16]  Gamal N. Elnagar,et al.  The pseudospectral Legendre method for discretizing optimal control problems , 1995, IEEE Trans. Autom. Control..

[17]  Bilge Mutlu,et al.  Communication of Intent in Assistive Free Flyers , 2014, 2014 9th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[18]  Robin R. Murphy,et al.  Effects of Speed, Cyclicity, and Dimensionality on Distancing, Time, and Preference in Human-Aerial Vehicle Interactions , 2017, ACM Trans. Interact. Intell. Syst..

[19]  I. Kaminer,et al.  Optimal Motion Planning for Differentially Flat Systems Using Bernstein Approximation , 2018, IEEE Control Systems Letters.

[20]  Gerald E. Farin,et al.  The essentials of CAGD , 2000 .

[21]  James A. Landay,et al.  Emotion encoding in Human-Drone Interaction , 2016, 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[22]  Bilge Mutlu,et al.  Communicating Directionality in Flying Robots , 2015, 2015 10th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[23]  I. Michael Ross,et al.  A review of pseudospectral optimal control: From theory to flight , 2012, Annu. Rev. Control..

[24]  Hang Cui,et al.  VR study of human-multicopter interaction in a residential setting , 2016, VR.

[25]  Michael C. Mozer,et al.  Sequential Dependencies in Human Behavior Offer Insights Into Cognitive Control , 2007, Integrated Models of Cognitive Systems.