Teaching a Drone to Accompany a Person from Demonstrations using Non-Linear ASFM

In this paper, we present a new method based on the Aerial Social Force Model (ASFM) to allow human-drone side-by-side social navigation in real environments. To tackle this problem, the present work proposes a new nonlinear-based approach using Neural Networks. To learn and test the rightness of the new approach, we built a new dataset with simulated environments and we recorded motion controls provided by a human expert tele-operating the drone. The recorded data is then used to train a neural network which maps interaction forces to acceleration commands. The system is also reinforced with a human path prediction module to improve the drone’s navigation, as well as, a collision detection module to completely avoid possible impacts. Moreover, a performance metric is defined which allows us to numerically evaluate and compare the fulfillment of the different learned policies. The method was validated by a large set of simulations; we also conducted real-life experiments with an autonomous drone to verify the framework described for the navigation process. In addition, a user study has been realized to reveal the social acceptability of the method.

[1]  Jürgen Schmidhuber,et al.  A Machine Learning Approach to Visual Perception of Forest Trails for Mobile Robots , 2016, IEEE Robotics and Automation Letters.

[2]  Karl Tuyls,et al.  Multi-robot collision avoidance with localization uncertainty , 2012, AAMAS.

[3]  Gonzalo Ferrer,et al.  Robot social-aware navigation framework to accompany people walking side-by-side , 2016, Autonomous Robots.

[4]  Abhinav Gupta,et al.  Learning to fly by crashing , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[5]  Geoffrey A. Hollinger,et al.  Multi-UAV exploration with limited communication and battery , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[6]  Pascal Fua,et al.  AUTOMATIC MAPPING FROM ULTRA-LIGHT UAV IMAGERY , 2012 .

[7]  Alberto Sanfeliu,et al.  Aerial social force model: A new framework to accompany people using autonomous flying robots , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[8]  Gonzalo Ferrer Mínguez,et al.  SOCIAL ROBOT NAVIGATION , 2013 .

[9]  Rachid Alami,et al.  A Human Aware Mobile Robot Motion Planner , 2007, IEEE Transactions on Robotics.

[10]  T. Kanda,et al.  Social force model with explicit collision prediction , 2011 .

[11]  Jodi Forlizzi,et al.  Social Robot Navigation , 2010 .

[12]  Lukás Burget,et al.  Extensions of recurrent neural network language model , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[13]  E. Hall,et al.  The Hidden Dimension , 1970 .

[14]  Glen Bright,et al.  Development of an UAV for search & rescue applications , 2011, IEEE Africon '11.

[15]  Francesc Moreno-Noguer,et al.  Teaching Robot’s Proactive Behavior Using Human Assistance , 2017, Int. J. Soc. Robotics.