Online Optimal Control of Wave Energy Converters via Adaptive Dynamic Programming

The control objective of wave energy converters (WECs) is to maximize energy conversion from sea waves and guarantee their safe operation. This can be expressed as a constrained optimal control problem subject to a disturbance input (the incoming wave excitation) for energy maximization. A novel energy maximization control strategy is proposed based on the idea of approximate dynamic programming (ADP), where a critic neural network (NN) is used to approximate the time-dependant optimal cost value (due to the finite-horizon cost function), whose inputs are the current system states and the time-to-go. A recently proposed adaptation based on the parameter estimation error is used to online update the weight of critic NN, where the estimation error convergence can be proved. Hence, the network output, e.g. the costate, is used to compute the optimal feedback control. The proposed WEC control strategy does not need the non-causal information of wave prediction, which makes its implementation more economically viable without significantly reducing energy output. The efficacy of the proposed WEC control approach is demonstrated using numerical simulations.

[1]  Guang Li,et al.  Wave energy converter control by wave prediction and dynamic programming , 2012 .

[2]  Yu Guo,et al.  Online adaptive optimal control for continuous-time nonlinear systems with completely unknown dynamics , 2016, Int. J. Control.

[3]  Umesh A. Korde,et al.  Latching control of deep water wave energy devices using an active reference , 2002 .

[4]  Frank L. Lewis,et al.  A novel actor-critic-identifier architecture for approximate optimal control of uncertain nonlinear systems , 2013, Autom..

[5]  Paul J. Webros A menu of designs for reinforcement learning over time , 1990 .

[6]  Guido Herrmann,et al.  Robust adaptive finite‐time parameter estimation and control for robotic systems , 2015 .

[7]  Frank L. Lewis,et al.  REINFORCEMENT LEARNING AND OPTIMAL ADAPTIVE CONTROL , 2012 .

[8]  Johannes Falnes,et al.  Optimum operation of improved wave-power converter , 1977 .

[9]  Sy-Ruen Huang,et al.  Multivariable direct-drive linear generators for wave energy , 2012 .

[10]  M. N. Sahinkaya,et al.  A review of wave energy converter technology , 2009 .

[11]  Margaret E. Ochs,et al.  SAND 2013-7207 Unlimited Release Printed September 2013 Technological Cost-Reduction Pathways for Attenuator Wave Energy Converters in the Marine Hydrokinetic Environment , 2013 .

[12]  J. Falnes Ocean Waves and Oscillating Systems , 2002 .

[13]  Kenji Doya,et al.  Reinforcement Learning in Continuous Time and Space , 2000, Neural Computation.

[14]  J. Falnes,et al.  STATE-SPACE MODELLING OF A VERTICAL CYLINDER IN HEAVE , 1995 .

[15]  Hao Xu,et al.  Neural Network-Based Finite-Horizon Optimal Control of Uncertain Affine Nonlinear Discrete-Time Systems , 2015, IEEE Trans. Neural Networks Learn. Syst..

[16]  John V. Ringwood,et al.  Energy-Maximizing Control of Wave-Energy Converters: The Development of Control System Technology to Optimize Their Operation , 2014, IEEE Control Systems.

[17]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[18]  Daniel L. Laird,et al.  Technological Cost-Reduction Pathways for Point Absorber Wave Energy Converters in the Marine Hydrokinetic Environment. , 2013 .

[19]  J. Na,et al.  Online adaptive approximate optimal tracking control with simplified dual approximation structure for continuous-time unknown nonlinear systems , 2014, IEEE/CAA Journal of Automatica Sinica.

[20]  I. Glendenning,et al.  Ocean wave power , 1977 .

[21]  Guang Li,et al.  Nonlinear model predictive control of a wave energy converter based on differential flatness parameterisation , 2017, Int. J. Control.

[22]  Gordon Lightbody,et al.  Maximisation of Energy Capture by a Wave-Energy Point Absorber using Model Predictive Control , 2011 .

[23]  Frank L. Lewis,et al.  A Neural Network Solution for Fixed-Final Time Optimal Control of Nonlinear Systems , 2006, MED 2006.

[24]  T. Moan,et al.  Constrained Optimal Control of a Heaving Buoy Wave-Energy Converter , 2011 .

[25]  Frank L. Lewis,et al.  Nearly optimal control laws for nonlinear systems with saturating actuators using a neural network HJB approach , 2005, Autom..

[26]  A. Clément,et al.  Wave energy in Europe: current status and perspectives , 2002 .

[27]  Ali Heydari,et al.  Finite-Horizon Control-Constrained Nonlinear Optimal Control Using Single Network Adaptive Critics , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[28]  G. Weiss,et al.  Optimal control of wave energy converters using deterministic sea wave prediction , 2013 .

[29]  Guang Li,et al.  Model predictive control of sea wave energy converters – Part I: A convex approach for the case of a single device , 2014 .