An Intelligent Autopilot System that learns piloting skills from human pilots by imitation

An Intelligent Autopilot System (IAS) that can learn piloting skills by observing and imitating expert human pilots is proposed. IAS is a potential solution to the current problem of Automatic Flight Control Systems of being unable to handle flight uncertainties, and the need to construct control models manually. A robust Learning by Imitation approach is proposed which uses human pilots to demonstrate the task to be learned in a flight simulator while training datasets are captured from these demonstrations. The datasets are then used by Artificial Neural Networks to generate control models automatically. The control models imitate the skills of the human pilot when performing piloting tasks including handling flight uncertainties such as severe weather conditions. Experiments show that IAS performs learned take-off, climb, and slow ascent tasks with high accuracy even after being presented with limited examples, as measured by Mean Absolute Error and Mean Absolute Deviation. The results demonstrate that the IAS is capable of imitating low-level sub-cognitive skills such as rapid and continuous stabilization attempts in stormy weather conditions, and high-level strategic skills such as the sequence of sub-tasks necessary to pilot an aircraft starting from the stationary position on the runway, and ending with a steady cruise.

[1]  W. Thomas Miller,et al.  Real-time application of neural networks for sensor-based control of robots with vision , 1989, IEEE Trans. Syst. Man Cybern..

[2]  Andrew Y. Ng,et al.  Pharmacokinetics of a novel formulation of ivermectin after administration to goats , 2000, ICML.

[3]  Pieter Abbeel,et al.  Apprenticeship learning via inverse reinforcement learning , 2004, ICML.

[4]  Csaba Szepesvári,et al.  Apprenticeship Learning using Inverse Reinforcement Learning and Gradient Methods , 2007, UAI.

[5]  Donald Michie,et al.  Cognitive models from subcognitive skills , 1990 .

[6]  Matthew J. Rutherford,et al.  Implementation and Testing of a Backstepping Controller Autopilot for Fixed-wing UAVs , 2014, J. Intell. Robotic Syst..

[7]  Robert C. Nelson,et al.  Flight Stability and Automatic Control , 1989 .

[8]  Elisa Capello,et al.  Design and Validation of a L1 Adaptive Controller for a mini-UAV Autopilot , 2012 .

[9]  Lance Sherry,et al.  Controlled Flight into Stall (CFIS): Functional complexity failures and automation surprises , 2014, 2014 Integrated Communications, Navigation and Surveillance Conference (ICNS) Conference Proceedings.

[10]  Maria M. Seron,et al.  Actuator Fault-Tolerant Control based on , 2008 .

[11]  Thiago T. Matsumoto,et al.  A method to implement and to evaluate a learning-based Piloting Autonomous System for UAS , 2014, 2014 International Conference on Unmanned Aircraft Systems (ICUAS).

[12]  Pieter Abbeel,et al.  Autonomous Helicopter Aerobatics through Apprenticeship Learning , 2010, Int. J. Robotics Res..

[13]  James L. McClelland,et al.  Explorations in parallel distributed processing: a handbook of models, programs, and exercises , 1988 .

[14]  Heaton T. Jeff,et al.  Introduction to Neural Networks with Java , 2005 .

[15]  Young-Keun Park,et al.  Applications of neural networks in high-speed communication networks , 1995 .

[16]  Claude Sammut,et al.  Automatically Constructing Control Systems by Observing Human Behaviour , 2003 .

[17]  Pritish Narayanan,et al.  Experimental Demonstration and Tolerancing of a Large-Scale Neural Network (165 000 Synapses) Using Phase-Change Memory as the Synaptic Weight Element , 2014, IEEE Transactions on Electron Devices.

[18]  Miroslav Jirgl,et al.  The identification possibilities of the measured parameters of an aircraft model and pilot behavior model on the flight simulator , 2015, International Conference on Military Technologies (ICMT) 2015.

[19]  George J. Vachtsevanos,et al.  Inventing a Biologically Inspired, Energy Efficient Micro Aerial Vehicle , 2012, J. Intell. Robotic Syst..

[20]  Elisa Capello,et al.  Design and Validation of an ${\mathcal{L}}_{1}$ Adaptive Controller for Mini-UAV Autopilot , 2013, J. Intell. Robotic Syst..

[21]  Fu-Shang Wei,et al.  The Full-Scale Helicopter Flight Simulator Design and Fabrication at CCSU , 2016 .

[22]  Johannes Baumbach,et al.  Losing the boxes: fragmentation as a source of system complexity , 2015 .

[23]  K. Senthil Kumar,et al.  Simulation of Flapping-wing Unmanned Aerial Vehicle using X-plane and Matlab/Simulink , 2014 .

[24]  Guy H. Walker,et al.  Pilot error versus sociotechnical systems failure: a distributed situation awareness analysis of Air France 447 , 2016 .

[25]  Mou Chen,et al.  Disturbance-Observer-Based Robust Flight Control for Hypersonic Vehicles Using Neural Networks , 2011 .

[26]  Peter Tiño,et al.  Financial volatility trading using recurrent neural networks , 2001, IEEE Trans. Neural Networks.