Visual Servoing for an Autonomous Hexarotor Using a Neural Network Based PID Controller

In recent years, unmanned aerial vehicles (UAVs) have gained significant attention. However, we face two major drawbacks when working with UAVs: high nonlinearities and unknown position in 3D space since it is not provided with on-board sensors that can measure its position with respect to a global coordinate system. In this paper, we present a real-time implementation of a servo control, integrating vision sensors, with a neural proportional integral derivative (PID), in order to develop an hexarotor image based visual servo control (IBVS) that knows the position of the robot by using a velocity vector as a reference to control the hexarotor position. This integration requires a tight coordination between control algorithms, models of the system to be controlled, sensors, hardware and software platforms and well-defined interfaces, to allow the real-time implementation, as well as the design of different processing stages with their respective communication architecture. All of these issues and others provoke the idea that real-time implementations can be considered as a difficult task. For the purpose of showing the effectiveness of the sensor integration and control algorithm to address these issues on a high nonlinear system with noisy sensors as cameras, experiments were performed on the Asctec Firefly on-board computer, including both simulation and experimenta results.

[1]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[2]  Patrick Rives,et al.  Visual servo control for the hovering of all outdoor robotic airship , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[3]  Hicham Medromi,et al.  Dynamic Modeling and Control of a HexaRotor using Linear and Nonlinear Methods , 2015 .

[4]  Jose Rivera-Mejia,et al.  PID Based on a Single Artificial Neural Network Algorithm for Intelligent Sensors , 2012 .

[5]  Jiwon Seo,et al.  Multi-UAV-based stereo vision system without GPS for ground obstacle mapping to assist path planning of UGV , 2014 .

[6]  Gaurav S. Sukhatme,et al.  Visually guided landing of an unmanned aerial vehicle , 2003, IEEE Trans. Robotics Autom..

[7]  R. Lozano,et al.  Real-time stereo visual servoing control of an UAV having eight-rotors , 2009, 2009 6th International Conference on Electrical Engineering, Computing Science and Automatic Control (CCE).

[8]  Patrick Rives,et al.  Singularities in the determination of the situation of a robot effector from the perspective view of 3 points , 1993 .

[9]  Jian Wang,et al.  Markerless, vision-assisted flight control of a quadrocopter , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[10]  Martin Buss,et al.  Autonomous hovering of a vision/IMU guided quadrotor , 2009, 2009 International Conference on Mechatronics and Automation.

[11]  Luca Iocchi,et al.  Autonomous Indoor Hovering with a Quadrotor , 2008 .

[12]  Gaurav S. Sukhatme,et al.  Combined optic-flow and stereo-based navigation of urban canyons for a UAV , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[13]  Katsuhiko Ogata,et al.  Discrete-time control systems , 1987 .

[14]  Erdinç Altug,et al.  Vision-based servo control of a quadrotor air vehicle , 2009, 2009 IEEE International Symposium on Computational Intelligence in Robotics and Automation - (CIRA).

[15]  Nicolas H. Franceschini,et al.  A vision-based autopilot for a miniature air vehicle: joint speed control and lateral obstacle avoidance , 2008, Auton. Robots.

[16]  Sauro Longhi,et al.  Actuator fault detection and isolation system for an hexacopter , 2014, 2014 IEEE/ASME 10th International Conference on Mechatronic and Embedded Systems and Applications (MESA).

[17]  Andrea Alaimo,et al.  PID Controller Applied to Hexacopter Flight , 2014, J. Intell. Robotic Syst..

[18]  François Chaumette,et al.  Visual servoing of an airplane for auto-landing , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[19]  A. L. Abbott,et al.  UAV-Based Stereo Vision for Rapid Aerial Terrain Mapping , 2011 .

[20]  François Chaumette,et al.  Visual servo control. I. Basic approaches , 2006, IEEE Robotics & Automation Magazine.

[21]  X. Z. Gao,et al.  Design and implementation of an adaptive PID controller using single neuron learning algorithm , 2002, Proceedings of the 4th World Congress on Intelligent Control and Automation (Cat. No.02EX527).

[22]  Gaurav S. Sukhatme,et al.  Visual servoing of an autonomous helicopter in urban areas using feature tracking , 2006, J. Field Robotics.

[23]  Lin Feng,et al.  An Approach to Identify Behavior Parameter in Image-based Visual Servo Control , 2012 .

[24]  R. Lozano,et al.  Stabilization and location of a four rotor helicopter applying vision , 2006, 2006 American Control Conference.

[25]  Rs Roel Pieters,et al.  Visual Servo Control , 2012 .

[26]  Robert E. Mahony,et al.  Visual servoing of an under-actuated dynamic rigid-body system: an image-based approach , 2002, IEEE Trans. Robotics Autom..

[27]  Roland Siegwart,et al.  Design and control of an indoor micro quadrotor , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[28]  Martin Buss,et al.  Visual tracking and control of a quadcopter using a stereo camera system and inertial sensors , 2009, 2009 International Conference on Mechatronics and Automation.

[29]  Wenqi Liu,et al.  PID Controller Based on the Artificial Neural Network , 2004, ISNN.

[30]  Eric N. Johnson,et al.  Vision-Aided Inertial Navigation for Flight Control , 2005, J. Aerosp. Comput. Inf. Commun..

[31]  François Chaumette,et al.  Potential problems of stability and convergence in image-based and position-based visual servoing , 1997 .

[32]  Jin Zhang,et al.  Adaptive neural network control for a class of MIMO nonlinear systems with disturbances in discrete-time , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[33]  Robert E. Mahony,et al.  Control of a quadrotor helicopter using visual feedback , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[34]  Lee E. Weiss,et al.  Dynamic sensor-based control of robots with visual feedback , 1987, IEEE Journal on Robotics and Automation.

[35]  Roland Siegwart,et al.  Full control of a quadrotor , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.