Nonlinear dynamic image-based visual servoing of a quadrotor

This paper proposes a dynamic image-based visual servoing (IBVS) control law for a quadrotor unmanned aerial vehicle (UAV) equipped with a single fixed on-board camera facing downward. The motion control problem is to regulate the relative lateral position of the vehicle to a stationary target located on the ground. The control law is termed dynamic as it is based on the dynamics and kinematics of the vehicle. The proposed design uses a nonlinear input-dependent change of state coordinates and its error dynamics are proven to be locally exponentially stable with an estimate provided for the region of attraction. Experimental and simulation results demonstrate the method's ease of on-board implementation, performance, and robustness. The simulation and experimental results include a comparison with an established dynamic IBVS method. This comparison shows the proposed method can provide similar performance with the benefit of reduced complexity.

[1]  Martin Jägersand,et al.  Realtime Registration-Based Tracking via Approximate Nearest Neighbour Search , 2013, Robotics: Science and Systems.

[2]  Peter I. Corke,et al.  A tutorial on visual servo control , 1996, IEEE Trans. Robotics Autom..

[3]  Eric N. Johnson,et al.  Vision-Aided Inertial Navigation for Flight Control , 2005, J. Aerosp. Comput. Inf. Commun..

[4]  S. Shankar Sastry,et al.  An Invitation to 3-D Vision: From Images to Geometric Models , 2003 .

[5]  S. Shankar Sastry,et al.  LANDING AN UNMANNED AIR VEHICLE: VISION BASED MOTION ESTIMATION AND NONLINEAR CONTROL , 1999 .

[6]  Rogelio Lozano,et al.  Modelling and Control of Mini-Flying Machines , 2005 .

[7]  Farid Kendoul,et al.  Survey of advances in guidance, navigation, and control of unmanned rotorcraft systems , 2012, J. Field Robotics.

[8]  Javier Civera,et al.  Inverse Depth Parametrization for Monocular SLAM , 2008, IEEE Transactions on Robotics.

[9]  Bryan M. Godbolt,et al.  Experimental Nonlinear Control of a Helicopter Unmanned Aerial Vehicle (UAV) , 2013 .

[10]  François Chaumette,et al.  Visual servo control. II. Advanced approaches [Tutorial] , 2007, IEEE Robotics & Automation Magazine.

[11]  Vijay Kumar,et al.  The GRASP Multiple Micro-UAV Testbed , 2010, IEEE Robotics & Automation Magazine.

[12]  Rogelio Lozano,et al.  Asymptotic Stability of Hierarchical Inner-Outer Loop-Based Flight Controllers , 2008 .

[13]  Sergei Lupashin,et al.  The Flying Machine Arena as of 2010 , 2011, 2011 IEEE International Conference on Robotics and Automation.

[14]  T. Hamel,et al.  A practical Visual Servo Control for a Unmanned Aerial Vehicle , 2008, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[15]  Robert E. Mahony,et al.  Image-Based Visual Servo Control of the Translation Kinematics of a Quadrotor Aerial Vehicle , 2009, IEEE Transactions on Robotics.

[16]  Tarek Hamel,et al.  Nonlinear control of VTOL UAVs incorporating flapping dynamics , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[17]  Daewon Lee,et al.  Autonomous landing of a VTOL UAV on a moving platform using image-based visual servoing , 2012, 2012 IEEE International Conference on Robotics and Automation.

[18]  Camillo J. Taylor,et al.  Quadrotor control using dual camera visual feedback , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[19]  A. Isidori.  Nonlinear Control Systems , 1985 .

[20]  Tarek Hamel,et al.  Image based visual servo control for a class of aerial robotic systems , 2007, Autom..

[21]  Selim Benhimane,et al.  Homography-based 2D Visual Tracking and Servoing , 2007, Int. J. Robotics Res..

[22]  Timothy W. McLain,et al.  Small Unmanned Aircraft: Theory and Practice , 2012 .

[23]  Youdan Kim,et al.  Adaptive Image-Based Visual Servoing for an Underactuated Quadrotor System , 2012 .

[24]  François Chaumette,et al.  Dynamic visual servoing with image moments for an unmanned aerial vehicle using a virtual spring approach , 2013, Adv. Robotics.

[25]  T. Hamel,et al.  Visual Tracking Control of Aerial Robotic Systems with Adaptive Depth Estimation , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[26]  Claire J. Tomlin,et al.  Precision flight control for a multi-vehicle quadrotor helicopter testbed , 2011 .

[27]  Rogelio Lozano,et al.  Stabilization and Trajectory Tracking of a Quad-Rotor Using Vision , 2011, J. Intell. Robotic Syst..

[28]  Kenzo Nonami,et al.  Visual Servoing of Quadrotor Micro-Air Vehicle Using Color-Based Tracking Algorithm , 2010 .

[29]  P. Mouyon,et al.  Visual servoing for underactuated VTOL UAVs: A linear, Homography-Based Approach , 2011, 2011 IEEE International Conference on Robotics and Automation.

[30]  Giuseppe Oriolo,et al.  An Adaptive Scheme for Image-Based Visual servoing of an underactuated UAV , 2014, Int. J. Robotics Autom..

[31]  Yi Wu,et al.  Online Object Tracking: A Benchmark , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[32]  Marc Pollefeys,et al.  Vision-based autonomous mapping and exploration using a quadrotor MAV , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[33]  Tarek Hamel,et al.  Dynamic Image-Based Visual Servo Control Using Centroid and Optic Flow Features , 2008 .

[34]  Tarek Hamel,et al.  Visual servoing for underactuated VTOL UAVs: a linear, homography‐based framework , 2014 .

[35]  Riccardo Marino,et al.  Nonlinear control design: geometric, adaptive and robust , 1995 .

[36]  Sergei Lupashin,et al.  The flying machine arena: A platform for aerial robotics research and demonstrations , 2013 .

[37]  Samir Bouabdallah,et al.  Design and control of quadrotors with application to autonomous flying , 2007 .

[38]  Rs Roel Pieters,et al.  Visual Servo Control , 2012 .

[39]  Robert E. Mahony,et al.  Visual servoing of an under-actuated dynamic rigid-body system: an image-based approach , 2002, IEEE Trans. Robotics Autom..

[40]  Nassir Navab,et al.  A dataset and evaluation methodology for template-based tracking algorithms , 2009, 2009 8th IEEE International Symposium on Mixed and Augmented Reality.

[41]  Robert E. Mahony,et al.  Stability and performance of image based visual servo control using first order spherical image moments , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[42]  Tarek Hamel,et al.  Dynamic Image-Based Visual Servo Control For An Aerial Robot: Theory and Experiments , 2008 .

[43]  B. Bethke,et al.  Real-time indoor autonomous vehicle test environment , 2008, IEEE Control Systems.

[44]  Gaurav S. Sukhatme,et al.  Visual servoing of an autonomous helicopter in urban areas using feature tracking , 2006, J. Field Robotics.