Neural Network-Based Optimal Control of an Unmanned Helicopter

Unmanned helicopters are self-propelled and autonomously controlled rotorcraft that are capable of independent flight. Because of their versatility and maneuverability, these unmanned helicopters are indispensable for both civilian and military applications, where human intervention is restricted. For control of a helicopter [1], it is necessary to produce moments and forces on the aircraft with two goals: first, to position the helicopter in equilibrium such that the the desired trim state is achieved; and second, to control the helicopter’s velocity, position, and orientation such that it tracks a desired trajectory with minimal error. The dynamics of the unmanned helicopter are not only nonlinear but are also coupled with each other and underactuated, which makes control difficult. In other words, the helicopter has six degrees of freedom (DOF), which must be controlled with only four control inputs—thrust and three rotational torques. To solve the problem of controlling a rotary-wing unmanned aerial vehicle (UAV), several techniques have beenproposed [1–9]. The fullmodel of the helicopter is quite complex when the main rotor and tail rotor and effects of drag, actuator dynamics, and other disturbances are taken into consideration. Based onNewton– Euler equations, a dynamicmodel has been derived [1] considering the helicopter as a rigid body with input forces and torques applied to the center of mass. Also, it has been shown [1] that the multivariable nonlinear helicopter model cannot be converted into a controllable linear system via exact state-space linearization. In addition, for certain output functions, exact input-output linearization results in

[1]  Sarangapani Jagannathan,et al.  Output Feedback Control of a Quadrotor UAV Using Neural Networks , 2010, IEEE Transactions on Neural Networks.

[2]  T. Dierks,et al.  Optimal control of affine nonlinear discrete-time systems , 2009, 2009 17th Mediterranean Conference on Control and Automation.

[3]  S. Sastry,et al.  Output tracking control design of a helicopter model based on approximate linearization , 1998, Proceedings of the 37th IEEE Conference on Decision and Control (Cat. No.98CH36171).

[4]  S. Jagannathan,et al.  Optimal control of affine nonlinear continuous-time systems using an online Hamilton-Jacobi-Isaacs formulation , 2010, 49th IEEE Conference on Decision and Control (CDC).

[5]  Pieter Abbeel,et al.  An Application of Reinforcement Learning to Aerobatic Helicopter Flight , 2006, NIPS.

[6]  Emilio Frazzoli,et al.  Aggressive Maneuvering of Small Autonomous Helicopters: A Human-Centered Approach , 2001, Int. J. Robotics Res..

[7]  Eric N. Johnson,et al.  Adaptive Trajectory Control for Autonomous Helicopters , 2005 .

[8]  S. Lee,et al.  Adaptive nonlinear control system design for helicopter robust command augmentation , 2005 .

[9]  Ben Tse,et al.  Autonomous Inverted Helicopter Flight via Reinforcement Learning , 2004, ISER.

[10]  Frank L. Lewis,et al.  Neural Network Control Of Robot Manipulators And Non-Linear Systems , 1998 .

[11]  Jennie Si,et al.  Helicopter trimming and tracking control using direct neural dynamic programming , 2003, IEEE Trans. Neural Networks.

[12]  Anthony J. Calise,et al.  Adaptive Output Feedback for High-Bandwidth Control of an Unmanned Helicopter , 2001 .

[13]  Cornel Sultan,et al.  Nonlinear modeling and output feedback control design for a small-scale helicopter , 2009, 2009 17th Mediterranean Conference on Control and Automation.

[14]  R. Mahony,et al.  Robust trajectory tracking for a scale model autonomous helicopter , 2004 .

[15]  Matthew A. Garratt,et al.  Flight control of a rotary wing UAV using backstepping , 2010 .

[16]  Eric Feron,et al.  Human-Inspired Control Logic for Automated Maneuvering of Miniature Helicopter , 2004 .

[17]  Adam,et al.  Control System Development and Flight Test Experience with the MQ-8B Fire Scout Vertical Take-Off Unmanned Aerial Vehicle (VTUAV) , 2007 .

[18]  A. Isidori Nonlinear Control Systems , 1985 .