Uncalibrated Visual Servo for Unmanned Aerial Manipulation

This paper addresses the problem of autonomous servoing an unmanned redundant aerial manipulator using computer vision. The overactuation of the system is exploited by means of a hierarchical control law, which allows to prioritize several tasks during flight. We propose a safety-related primary task to avoid possible collisions. As a secondary task, we present an uncalibrated image-based visual servo strategy to drive the arm end-effector to a desired position and orientation by using a camera attached to it. In contrast to the previous visual servo approaches, a known value of camera focal length is not strictly required. To further improve flight behavior, we hierarchically add one task to reduce dynamic effects by vertically aligning the arm center of gravity to the multirotor gravitational vector, and another one that keeps the arm close to a desired configuration of high manipulability and avoiding arm joint limits. The performance of the hierarchical control law, with and without activation of each of the tasks, is shown in simulations and in real experiments confirming the viability of such prioritized control scheme for aerial manipulation.

[1]  W. Wilson,et al.  Comparison of Basic Visual Servoing Methods , 2011, IEEE/ASME Transactions on Mechatronics.

[2]  Minoru Asada,et al.  Versatile visual servoing without knowledge of true Jacobian , 1994, Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS'94).

[3]  Zhisheng Zhang,et al.  Uncalibrated Visual Servoing Using More Precise Model , 2008, 2008 IEEE Conference on Robotics, Automation and Mechatronics.

[4]  Juan Andrade-Cetto,et al.  Uncalibrated image-based visual servoing , 2013, 2013 IEEE International Conference on Robotics and Automation.

[5]  Vincenzo Lippiello,et al.  Exploiting redundancy in Cartesian impedance control of UAVs equipped with a robotic arm , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[6]  Rafael Fierro,et al.  Agile Load Transportation : Safe and Efficient Load Manipulation with Aerial Robots , 2012, IEEE Robotics & Automation Magazine.

[7]  Vincenzo Lippiello,et al.  Task priority control for aerial manipulation , 2014, 2014 IEEE International Symposium on Safety, Security, and Rescue Robotics (2014).

[8]  Francesc Moreno-Noguer,et al.  Exhaustive Linearization for Robust Camera Pose and Focal Length Estimation , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Matko Orsag,et al.  Stability control in aerial manipulation , 2013, 2013 American Control Conference.

[10]  Rajiv V. Dubey,et al.  A weighted least-norm solution based scheme for avoiding joint limits for redundant joint manipulators , 1993, IEEE Trans. Robotics Autom..

[11]  Gianluca Antonelli,et al.  Stability Analysis for Prioritized Closed-Loop Inverse Kinematic Algorithms for Redundant Robotic Systems , 2009, IEEE Trans. Robotics.

[12]  Darius Burschka,et al.  Toward a Fully Autonomous UAV: Research Platform for Indoor and Outdoor Urban Search and Rescue , 2012, IEEE Robotics & Automation Magazine.

[13]  Peter I. Corke,et al.  Multirotor Aerial Vehicles: Modeling, Estimation, and Control of Quadrotor , 2012, IEEE Robotics & Automation Magazine.

[14]  Paul Y. Oh,et al.  A parallel manipulator for mobile manipulating UAVs , 2015, 2015 IEEE International Conference on Technologies for Practical Robot Applications (TePRA).

[15]  Stefano Stramigioli,et al.  Interaction control of an UAV endowed with a manipulator , 2013, 2013 IEEE International Conference on Robotics and Automation.

[16]  Martin Jägersand,et al.  Global Visual-Motor Estimation for Uncalibrated Visual Servoing , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[17]  M. Bonkovic,et al.  Population-Based Uncalibrated Visual Servoing , 2008, IEEE/ASME Transactions on Mechatronics.

[18]  Patrick Rives,et al.  Robustness of image-based visual servoing with respect to depth distribution errors , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[19]  Rafik Mebarki,et al.  Visual coordinated landing of a UAV on a mobile robot manipulator , 2013, 2013 IEEE International Symposium on Safety, Security, and Rescue Robotics (SSRR).

[20]  Rafik Mebarki,et al.  Image-Based Control for Aerial Manipulation , 2014 .

[21]  E. Malis,et al.  2 1/2 D Visual Servoing , 1999 .

[22]  T. Yoshikawa,et al.  Task-Priority Based Redundancy Control of Robot Manipulators , 1987 .

[23]  Yoshihiko Nakamura,et al.  Advanced robotics - redundancy and optimization , 1990 .

[24]  Peter I. Corke,et al.  A tutorial on visual servo control , 1996, IEEE Trans. Robotics Autom..

[25]  H. Jin Kim,et al.  Vision-Guided Aerial Manipulation Using a Multirotor With a Robotic Arm , 2016, IEEE/ASME Transactions on Mechatronics.

[26]  J. Armstrong Piepmeier,et al.  A dynamic Jacobian estimation method for uncalibrated visual servoing , 1999, 1999 IEEE/ASME International Conference on Advanced Intelligent Mechatronics (Cat. No.99TH8399).

[27]  Ronan Boulic,et al.  Task-priority formulations for the kinematic control of highly redundant articulated structures , 1998, Proceedings. 1998 IEEE/RSJ International Conference on Intelligent Robots and Systems. Innovations in Theory, Practice and Applications (Cat. No.98CH36190).

[28]  François Chaumette,et al.  Visual servo control. I. Basic approaches , 2006, IEEE Robotics & Automation Magazine.

[29]  Martin Jägersand,et al.  Robust Jacobian Estimation for Uncalibrated Visual Servoing , 2010, 2010 IEEE International Conference on Robotics and Automation.

[30]  Vincenzo Lippiello,et al.  Hybrid Visual Servoing With Hierarchical Task Composition for Aerial Manipulation , 2016, IEEE Robotics and Automation Letters.

[31]  Stefano Chiaverini,et al.  Singularity-robust task-priority redundancy resolution for real-time kinematic control of robot manipulators , 1997, IEEE Trans. Robotics Autom..