Computational investigation of environment learning in guidance and navigation

This paper presents a computational framework for learning autonomous guidance behavior in unknown or partially known environments. The learning framework uses a receding horizon trajectory optimization associated with a spatial value function. The function describes optimal (for example, minimum time) guidance behavior represented as cost and velocity at any point in geographical space to reach a specified goal state. For guidance in unknown environments, a local spatial value function based on the current vehicle state is updated online using environment data from onboard exteroceptive sensors. The proposed learning framework has the advantage, in that it learns information directly relevant to the optimal guidance and control behavior, enabling optimal trajectory planning in unknown or partially known environments. The learning framework is evaluated by measuring performance over successive runs in three-dimensional indoor flight simulations. The test vehicle in the simulations is a Blade-Cx2 coaxial m...

[1]  Jonathan P. How,et al.  Receding horizon control of autonomous aerial vehicles , 2002, Proceedings of the 2002 American Control Conference (IEEE Cat. No.CH37301).

[2]  Zhaodan Kong,et al.  Modeling Human Guidance Behavior Based on Patterns in Agent–Environment Interactions , 2013, IEEE Transactions on Human-Machine Systems.

[3]  Jacob Willem Langelaan,et al.  Local Terrain Mapping for Obstacle Avoidance Using Monocular Vision , 2011 .

[4]  N. Cowan Evolving conceptions of memory storage, selective attention, and their mutual constraints within the human information-processing system. , 1988, Psychological bulletin.

[5]  Bernard Mettler,et al.  Sensory Predictive Guidance in Partially Known Environment , 2011 .

[6]  Bernard Mettler,et al.  Agile autonomous guidance using spatial value functions , 2010 .

[7]  S. LaValle,et al.  Randomized Kinodynamic Planning , 2001 .

[8]  Jonathan P. How,et al.  Hybrid Model for Trajectory Planning of Agile Autonomous Vehicles , 2004, J. Aerosp. Comput. Inf. Commun..

[9]  Patrick Boyle,et al.  Combining Planning and Learning for Autonomous Vehicle Navigation , 2010 .

[10]  Sebastian Thrun,et al.  Learning Metric-Topological Maps for Indoor Mobile Robot Navigation , 1998, Artif. Intell..

[11]  Thomas W. Reps,et al.  An Incremental Algorithm for a Generalization of the Shortest-Path Problem , 1996, J. Algorithms.

[12]  David Q. Mayne,et al.  Constrained model predictive control: Stability and optimality , 2000, Autom..

[13]  Nils J. Nilsson,et al.  A Formal Basis for the Heuristic Determination of Minimum Cost Paths , 1968, IEEE Trans. Syst. Sci. Cybern..

[14]  Zhaodan Kong,et al.  A Survey of Motion Planning Algorithms from the Perspective of Autonomous UAV Guidance , 2010, J. Intell. Robotic Syst..

[15]  Edsger W. Dijkstra,et al.  A note on two problems in connexion with graphs , 1959, Numerische Mathematik.

[16]  Maja J. Mataric,et al.  Integration of representation into goal-driven behavior-based robots , 1992, IEEE Trans. Robotics Autom..

[17]  Roland Siegwart,et al.  Monocular‐SLAM–based navigation for autonomous micro helicopters in GPS‐denied environments , 2011, J. Field Robotics.

[18]  David Elkind,et al.  Learning: An Introduction , 1968 .

[19]  Wolfram Burgard,et al.  The dynamic window approach to collision avoidance , 1997, IEEE Robotics Autom. Mag..

[20]  Frank Dellaert,et al.  Online probabilistic topological mapping , 2011, Int. J. Robotics Res..

[21]  Mica R. Endsley,et al.  Toward a Theory of Situation Awareness in Dynamic Systems , 1995, Hum. Factors.

[22]  David Filliat,et al.  Map-based navigation in mobile robots: II. A review of map-learning and path-planning strategies , 2003, Cognitive Systems Research.

[23]  L. Dubins On Curves of Minimal Length with a Constraint on Average Curvature, and with Prescribed Initial and Terminal Positions and Tangents , 1957 .

[24]  Bérénice Mettler,et al.  System Identification Modeling and Flight Characteristics Analysis of Miniature Coaxial Helicopter , 2014 .

[25]  Bernard Mettler,et al.  Combining On- and Offline Optimization Techniques for Efficient Autonomous Vehicle's Trajectory Planning , 2005 .

[26]  Zhaodan Kong,et al.  Mapping and Analysis of Human Guidance Performance From Trajectory Ensembles , 2013, IEEE Transactions on Human-Machine Systems.

[27]  Emilio Frazzoli,et al.  Real-Time Motion Planning for Agile Autonomous Vehicles , 2000 .

[28]  J. A. Bryson Optimal control-1950 to 1985 , 1996 .

[29]  Bérénice Mettler,et al.  Scaling effects in guidance performance in confined environments , 2016 .

[30]  Bernard Mettler,et al.  Design and Flight Test Evaluation of Guidance System for Autonomous Rotorcraft , 2006 .

[31]  Alberto Bemporad,et al.  An MPC/hybrid system approach to traction control , 2006, IEEE Transactions on Control Systems Technology.