A Novel Geometric Hierarchical Approach for Dynamic Visual Servoing of Quadrotors

This paper proposes a novel nonlinear geometric hierarchical dynamic visual servoing approach to drive a quadrotor to the desired pose defined by a previously captured image of a planar target. Different from existing works, the key novelty is to extend the position-based nonlinear hierarchical control to image-based nonlinear hierarchical control. More specifically, by seamlessly integrating the nonlinear hierarchical control with the geometric control, and taking full advantage of the cascade property of the system, the proposed visual servoing strategy does not require the thrust force or its derivative to be measurable when compared with the existing backstepping methods, which brings much convenience for practical applications. For the attitude loop, the axis-angle rotation representation is adopted to design a tracking control law on the vector space ${\mathfrak {so}{(3)}}$. In the outer loop, perspective image moments in the virtual image plane are employed as image feedback to construct the outer-loop image-based visual servoing controller with geometric control and backstepping techniques. Based on Lyapunov techniques and the theory of cascade systems, it is rigorously proven that the proposed image-based controller achieves asymptotic stability. Comparative experiments are conducted to show that the proposed approach has advantages of better transient performance, better steady-state performance, and stronger robustness.

[1]  Matthew J. Rutherford,et al.  Survey of Unmanned Helicopter Model-Based Navigation and Control Techniques , 2015, J. Intell. Robotic Syst..

[2]  Helene Piet-Lahanier,et al.  A hierarchical controller for miniature VTOL UAVs: Design and stability analysis using singular perturbation theory , 2011 .

[3]  Cheng Li,et al.  High performance full attitude control of a quadrotor on SO(3) , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[4]  Roland Siegwart,et al.  Vision-Controlled Micro Flying Robots: From System Design to Autonomous Navigation and Mapping in GPS-Denied Environments , 2014, IEEE Robotics & Automation Magazine.

[5]  François Chaumette,et al.  Point-based and region-based image moments for visual servoing of planar objects , 2005, IEEE Transactions on Robotics.

[6]  Rita Cunha,et al.  Landing of a Quadrotor on a Moving Target Using Dynamic Image-Based Visual Servo Control , 2016, IEEE Transactions on Robotics.

[7]  T. Hamel,et al.  A practical Visual Servo Control for a Unmanned Aerial Vehicle , 2008, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[8]  Youdan Kim,et al.  Adaptive Image-Based Visual Servoing for an Underactuated Quadrotor System , 2012 .

[9]  Farid Kendoul,et al.  Nonlinear Hierarchical Flight Controller for Unmanned Rotorcraft: Design, Stability, and Experiments , 2009 .

[10]  Robert E. Mahony,et al.  Image-Based Visual Servo Control of the Translation Kinematics of a Quadrotor Aerial Vehicle , 2009, IEEE Transactions on Robotics.

[11]  Robert E. Mahony,et al.  Visual servoing of an under-actuated dynamic rigid-body system: an image-based approach , 2002, IEEE Trans. Robotics Autom..

[12]  Farrokh Janabi-Sharifi,et al.  Image-based tracking control of VTOL unmanned aerial vehicles , 2015, Autom..

[13]  Daewon Lee,et al.  Geometric nonlinear PID control of a quadrotor UAV on SE(3) , 2013, 2013 European Control Conference (ECC).

[14]  Xuebo Zhang,et al.  Visual Servoing of Nonholonomic Mobile Robots With Uncalibrated Camera-to-Robot Parameters , 2017, IEEE Transactions on Industrial Electronics.

[15]  Xinwu Liang,et al.  Image-Based Visual Servoing of a Quadrotor Using Virtual Camera Approach , 2017, IEEE/ASME Transactions on Mechatronics.

[16]  Yong Wang,et al.  Planning and Tracking in Image Space for Image-Based Visual Servoing of a Quadrotor , 2018, IEEE Transactions on Industrial Electronics.

[17]  Xi Liu,et al.  Adaptive Active Visual Servoing of Nonholonomic Mobile Robots , 2012, IEEE Transactions on Industrial Electronics.

[18]  Edwin Olson,et al.  AprilTag 2: Efficient and robust fiducial detection , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[19]  R. Murray,et al.  Proportional Derivative (PD) Control on the Euclidean Group , 1995 .

[20]  Xuebo Zhang,et al.  Geometric adaptive dynamic visual servoing of a quadrotor UAV , 2016, 2016 IEEE International Conference on Advanced Intelligent Mechatronics (AIM).

[21]  Giuseppe Oriolo,et al.  An Adaptive Scheme for Image-Based Visual servoing of an underactuated UAV , 2014, Int. J. Robotics Autom..

[22]  Hui Xie,et al.  Input Saturated Visual Servoing for Unmanned Aerial Vehicles , 2017, IEEE/ASME Transactions on Mechatronics.

[23]  Kin Huat Low,et al.  Adaptive Visual Servoing of Unmanned Aerial Vehicles in GPS-Denied Environments , 2017, IEEE/ASME Transactions on Mechatronics.

[24]  François Chaumette,et al.  Dynamic visual servoing with image moments for an unmanned aerial vehicle using a virtual spring approach , 2013, Adv. Robotics.

[25]  Nabil Aouf,et al.  Vision Based Autonomous Landing of Multirotor UAV on Moving Platform , 2017, J. Intell. Robotic Syst..

[26]  Minh-Duc Hua,et al.  Introduction to feedback control of underactuated VTOLvehicles: A review of basic control design ideas and principles , 2013, IEEE Control Systems.

[27]  Hossein Bolandi,et al.  Robust vision-based control of an underactuated flying robot tracking a moving target , 2014 .

[28]  Farid Kendoul,et al.  Survey of advances in guidance, navigation, and control of unmanned rotorcraft systems , 2012, J. Field Robotics.

[29]  Hui Xie,et al.  Adaptive visual servoing of UAVs using a virtual camera , 2016, IEEE Transactions on Aerospace and Electronic Systems.

[30]  Hyeonbeom Lee,et al.  Trajectory tracking control of multirotors from modelling to experiments: A survey , 2017 .

[31]  Vijay Kumar,et al.  Opportunities and challenges with autonomous micro aerial vehicles , 2012, Int. J. Robotics Res..

[32]  Taeyoung Lee,et al.  Geometric tracking control of a quadrotor UAV on SE(3) , 2010, 49th IEEE Conference on Decision and Control (CDC).

[33]  Tarek Hamel,et al.  Visual servoing for underactuated VTOL UAVs: a linear, homography‐based framework , 2014 .

[34]  Peter I. Corke,et al.  Multirotor Aerial Vehicles: Modeling, Estimation, and Control of Quadrotor , 2012, IEEE Robotics & Automation Magazine.

[35]  Rafik Mebarki,et al.  Nonlinear Visual Control of Unmanned Aerial Vehicles in GPS-Denied Environments , 2015, IEEE Transactions on Robotics.

[36]  Zhiqiang Cao,et al.  Image Dynamics-Based Visual Servoing for Quadrotors Tracking a Target With a Nonlinear Trajectory Observer , 2020, IEEE Transactions on Systems, Man, and Cybernetics: Systems.