A new utility function for smooth transition between exploration and exploitation of a wind energy field

This paper presents a new data driven utility function for an unmanned aerial vehicle (UAV) mapping and exploiting a wind field. The proposed utility function provides a continuous scale between exploration and exploitation which is dependent on the difference between the current platform energy level and the uncertainty along a planned path. Tests were carried out in a VICON testbed using quadrotors programmed to emulate fixed-wing aircraft. Results show a 47.7% reduction in energy gain loitering time when compared to a pure information gain approach.

[1]  T. Lai.  Adaptive treatment allocation and the multi-armed bandit problem , 1987 .

[2]  Tristan C. Flanzer,et al.  Dynamic Environment Mapping for Autonomous Thermal Soaring , 2010 .

[3]  Sebastian Thrun,et al.  Efficient Exploration In Reinforcement Learning , 1992 .

[4]  Michael J. Allen.  Updraft Model for Development of Autonomous Soaring Uninhabited Air Vehicles , 2006 .

[5]  Tiauw Hiong Go,et al.  Waypoint Navigation of Small-Scale UAV incorporating Dynamic Soaring , 2010, Journal of Navigation.

[6]  Michael J. Allen,et al.  Autonomous Soaring for Improved Endurance of a Small Uninhabited Air Vehicle , 2005 .

[7]  Sebastian Thrun,et al.  Active Exploration in Dynamic Environments , 1991, NIPS.

[8]  Lehel Csató,et al.  Sparse On-Line Gaussian Processes , 2002, Neural Computation.

[9]  J. Dolan,et al.  Information-Theoretic Multi-Robot Adaptive Exploration and Mapping of Environmental Hotspot Fields , 2009 .

[10]  J. Langelaan.  Long Distance/Duration Trajectory Optimization for Small UAVs , 2007 .

[11]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[12]  Dan Cornford,et al.  Online Approximations for Wind-Field Models , 2001, ICANN.

[13]  Yiyuan Zhao,et al.  Optimal patterns of glider dynamic soaring , 2004 .

[14]  M. Opper,et al.  Online Learning of Wind-Field Models , 2001 .

[15]  Nicholas R. J. Lawrance,et al.  Autonomous Exploration of a Wind Field with a Gliding Aircraft , 2011 .

[16]  Oleg N. Granichin,et al.  Adaptive autonomous soaring of multiple UAVs using Simultaneous Perturbation Stochastic Approximation , 2010, 49th IEEE Conference on Decision and Control (CDC).