Vision-based control of a quadrotor utilizing artificial neural networks for tracking of moving targets

Abstract This paper investigates the application of an image based visual servoing (IBVS) mechanism for controlling the translational and rotational movements of a quadrotor helicopter; via this scheme, the helicopter can track a moving target by means of a camera installed underneath. The image features chosen for this purpose are the perspective image features. A direct adaptive neural controller was designed to control transitional motion. The controller makes use of neural network controller radial basis function (RBF) to deal with the image dynamic uncertainties. These uncertainties relate to the depth of visual information and the movement of the considered target. Moreover, a sliding mode controller designed by using the image features has been presented for controlling the rotational movement of the helicopter. Also, due to the lack of accurate image velocity and the Euler angles, appropriate observers have been designed and used. The designed scheme needs no geometric information from the object followed by the quadrotor; therefore, this method can be employed in unknown environments. The simulation results for ideal and non-ideal conditions indicate that, in spite of the problems such as the uncertainty of the image depth and the mobility of the target, both in the rotational and translational motions, the helicopter has been able to reach the desired altitude and to properly track the moving target.

[1]  Peter I. Corke,et al.  Robotics, Vision and Control - Fundamental Algorithms in MATLAB® , 2011, Springer Tracts in Advanced Robotics.

[2]  Tarek Hamel,et al.  Dynamic Image-Based Visual Servo Control For An Aerial Robot: Theory and Experiments , 2008 .

[3]  W. Wilson,et al.  Comparison of Basic Visual Servoing Methods , 2011, IEEE/ASME Transactions on Mechatronics.

[4]  Jinkun Liu,et al.  Radial Basis Function (RBF) Neural Network Control for Mechanical Systems , 2013 .

[5]  Ataollah Ebrahimzadeh,et al.  New Neural Network-based Approaches for GPS GDOP Classification based on Neuro-Fuzzy Inference System, Radial Basis Function, and Improved Bee Algorithm , 2014, Appl. Soft Comput..

[6]  Rita Cunha,et al.  A nonlinear quadrotor trajectory tracking controller with disturbance rejection , 2014 .

[7]  François Chaumette,et al.  Point-based and region-based image moments for visual servoing of planar objects , 2005, IEEE Transactions on Robotics.

[8]  Abdelkader Abdessameud,et al.  Global trajectory tracking control of VTOL-UAVs without linear velocity measurements , 2010, Autom..

[9]  Rita Cunha,et al.  A Globally Stabilizing Path Following Controller for Rotorcraft With Wind Disturbance Rejection , 2015, IEEE Transactions on Control Systems Technology.

[10]  Tarek Hamel,et al.  A Control Approach for Thrust-Propelled Underactuated Vehicles and its Application to VTOL Drones , 2009, IEEE Transactions on Automatic Control.

[11]  François Chaumette,et al.  Visual servo control. I. Basic approaches , 2006, IEEE Robotics & Automation Magazine.

[12]  Gaurav S. Sukhatme,et al.  Visual servoing of an autonomous helicopter in urban areas using feature tracking , 2006, J. Field Robotics.

[13]  Frank L. Lewis,et al.  Multilayer neural-net robot controller with guaranteed tracking performance , 1996, IEEE Trans. Neural Networks.

[14]  Robert E. Mahony,et al.  Visual servoing of an under-actuated dynamic rigid-body system: an image-based approach , 2002, IEEE Trans. Robotics Autom..

[15]  Hao Yu,et al.  An Incremental Design of Radial Basis Function Networks , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[16]  Robert E. Mahony,et al.  Landing a VTOL Unmanned Aerial Vehicle on a Moving Platform Using Optical Flow , 2012, IEEE Transactions on Robotics.

[17]  Hao Yu,et al.  Fast and Efficient Second-Order Method for Training Radial Basis Function Networks , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[18]  François Chaumette,et al.  Image moments: a general and useful set of features for visual servoing , 2004, IEEE Transactions on Robotics.

[19]  Robert E. Mahony,et al.  Image-Based Visual Servo Control of the Translation Kinematics of a Quadrotor Aerial Vehicle , 2009, IEEE Transactions on Robotics.

[20]  Tarek Hamel,et al.  Dynamic Image-Based Visual Servo Control Using Centroid and Optic Flow Features , 2008 .

[21]  Peter Xiaoping Liu,et al.  Robust Control of Four-Rotor Unmanned Aerial Vehicle With Disturbance Uncertainty , 2015, IEEE Transactions on Industrial Electronics.

[22]  Lei Chen,et al.  Enhanced random search based incremental extreme learning machine , 2008, Neurocomputing.

[23]  George Panoutsos,et al.  Interval Type-2 Radial Basis Function Neural Network: A Modeling Framework , 2015, IEEE Transactions on Fuzzy Systems.

[24]  Marios M. Polycarpou,et al.  Backstepping-Based Flight Control with Adaptive Function Approximation , 2005 .

[25]  Frank L. Lewis,et al.  Backstepping Approach for Controlling a Quadrotor Using Lagrange Form Dynamics , 2009, J. Intell. Robotic Syst..

[26]  François Chaumette,et al.  Dynamic visual servoing with image moments for an unmanned aerial vehicle using a virtual spring approach , 2013, Adv. Robotics.

[27]  Frank L. Lewis,et al.  Neural Networks in Feedback Control Systems , 2015 .

[28]  Christopher Edwards,et al.  Sliding Mode Control and Observation , 2013 .

[29]  Giuseppe Oriolo,et al.  Dynamic IBVS control of an underactuated UAV , 2012, 2012 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[30]  Lorenzo Marconi,et al.  Design and experimental validation of a nonlinear control law for a ducted-fan miniature aerial vehicle , 2010 .

[31]  Frank L. Lewis,et al.  Neuro-Fuzzy Control of Industrial Systems with Actuator Nonlinearities , 1987 .

[32]  Chao Liu,et al.  Generalized predictive control with dynamic compensation for quadrotor attitude stabilization , 2014, CCC 2014.

[33]  Michael V. Basin,et al.  Sliding Mode Controller Design for Stochastic Polynomial Systems With Unmeasured States , 2014, IEEE Transactions on Industrial Electronics.

[34]  François Chaumette,et al.  Visual servo control. II. Advanced approaches [Tutorial] , 2007, IEEE Robotics & Automation Magazine.

[35]  T. Hamel,et al.  A practical Visual Servo Control for a Unmanned Aerial Vehicle , 2008, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[36]  Pierluigi Siano,et al.  A Novel RBF Training Algorithm for Short-Term Electric Load Forecasting and Comparative Studies , 2015, IEEE Transactions on Industrial Electronics.

[37]  Chih-Chiang Chen,et al.  Study of Nonsingular Fast Terminal Sliding-Mode Fault-Tolerant Control , 2015, IEEE Transactions on Industrial Electronics.

[38]  Karim Faez,et al.  Efficacy of utilizing a hybrid algorithmic method in enhancing the functionality of multi-instance multi-label radial basis function neural networks , 2015, Appl. Soft Comput..

[39]  Andrew Roberts,et al.  A new position regulation strategy for VTOL UAVs using IMU and GPS measurements , 2013, Autom..

[40]  S. Shankar Sastry,et al.  Adaptive Control of Mechanical Manipulators , 1987 .

[41]  Tarek Hamel,et al.  Output feedback observation and control for visual servoing of VTOL UAVs , 2011 .

[42]  Farrokh Janabi-Sharifi,et al.  Image-based tracking control of VTOL unmanned aerial vehicles , 2015, Autom..

[43]  Minh-Duc Hua,et al.  Introduction to feedback control of underactuated VTOLvehicles: A review of basic control design ideas and principles , 2013, IEEE Control Systems.