Aerial Informatics and Robotics Platform

Machine Learning technologies are increasingly becoming an important tool in building autonomous systems. Learning-based techniques have been useful but typically need a large amount of training data, which is an expensive and time consuming process. Often collecting such data is non-trivial and introduces safety concerns. Consequently, it is becoming increasingly important to be able to accurately simulate the physical environment that autonomous vehicles/robots would operate in. We present a new, easy-to-use simulator that aims to enable designers and developers of a robotic system to seamlessly generate lots of training data. The biggest advantage of this simulator is that it uses recent advances in computation and graphics to simulate the physics and perception such that the environment realistically reflects the actual world. Such realism can enable efficient training and testing of machine learned models by generating vast quantity of ground truth data. One of the key aspects of the fast physics engine is that it enables high frequency simulations with support for hardwarein-the-loop (HIL) as well as software-in-the-loop (SIL) with widely supported protocols (e.g. MavLink). Our cross-platform (Linux and Windows), open-source architecture focuses on being easily extensible to accommodate diverse new types of autonomous vehicles, hardware platforms and software protocols. We use quadrotors as our first autonomous vehicle showcase.

[1]  Shree K. Nayar,et al.  Shedding light on the weather , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[2]  Andrew Howard,et al.  Design and use paradigms for Gazebo, an open-source multi-robot simulator , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[3]  Sebastian Thrun,et al.  Stanley: The robot that won the DARPA Grand Challenge , 2006, J. Field Robotics.

[4]  William Whittaker,et al.  A robust approach to high‐speed navigation for unrehearsed desert terrain , 2007 .

[5]  Oliver J. Woodman,et al.  An introduction to inertial navigation , 2007 .

[6]  James J. Kuffner,et al.  OpenRAVE: A Planning Architecture for Autonomous Robotics , 2008 .

[7]  William Whittaker,et al.  Autonomous driving in urban environments: Boss and the Urban Challenge , 2008, J. Field Robotics.

[8]  Morgan Quigley,et al.  ROS: an open-source Robot Operating System , 2009, ICRA 2009.

[9]  Stephanie Rosenthal,et al.  An effective personal mobile robot agent through symbiotic human-robot interaction , 2010, AAMAS.

[10]  David M. Bradley,et al.  Learning for Autonomous Navigation , 2010, IEEE Robotics & Automation Magazine.

[11]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[12]  Marc Pollefeys,et al.  PIXHAWK: A system for autonomous flight using onboard computer vision , 2011, 2011 IEEE International Conference on Robotics and Automation.

[13]  Oskar von Stryk,et al.  Comprehensive Simulation of Quadrotor UAVs Using ROS and Gazebo , 2012, SIMPAR.

[14]  Meng Joo Er,et al.  A survey of inverse reinforcement learning techniques , 2012, Int. J. Intell. Comput. Cybern..

[15]  Jan Peters,et al.  Reinforcement learning in robotics: A survey , 2013, Int. J. Robotics Res..

[16]  Brian Karis,et al.  Real Shading in Unreal Engine 4 by , 2013 .

[17]  Angelo M. Sabatini,et al.  A Stochastic Approach to Noise Modeling for Barometric Altimeters , 2013, Sensors.

[18]  Alonzo Kelly,et al.  Construction and validation of a high fidelity simulator for a planar range sensor , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[19]  J A Bagnell,et al.  An Invitation to Imitation , 2015 .

[20]  A. Chulliat,et al.  The US/UK World Magnetic Model for 2015-2020 , 2015 .

[21]  Roland Siegwart,et al.  RotorS—A Modular Gazebo MAV Simulator Framework , 2016 .

[22]  Vladlen Koltun,et al.  Playing for Data: Ground Truth from Computer Games , 2016, ECCV.

[23]  R. Stull Practical Meteorology: An Algebra-based Survey of Atmospheric Science , 2016 .

[24]  Qiao Wang,et al.  VirtualWorlds as Proxy for Multi-object Tracking Analysis , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).