Cooperative aerial tele-manipulation with haptic feedback

In this paper, we propose a bilateral tele-operation scheme for cooperative aerial manipulation in which a human operator drives a team of Vertical Take-Off and Landing (VTOL) aerial vehicles, that grasped an object beforehand, and receives a force feedback depending on the states of the system. For application scenarios in which dexterous manipulation by each robot is not necessary, we propose using a rigid tool attached to the vehicle through a passive spherical joint, equipped with a simple adhesive mechanism at the tool-tip that can stick to the grasped object. Having more than two robots, we use the extra degrees of freedom to find the optimal force allocation in term of minimum power and forces smoothness. The human operator commands a desired trajectory for the robot team through a haptic interface to a pose controller, and the output of the pose controller along with system constraints, e.g., VTOL limited forces and contact maintenance, defines the feasible set of forces. Then, an on-line optimization allocates forces by minimizing a cost function of forces and their variation. Finally, propeller thrusts are computed by a dedicated attitude and thrust controller in a decentralized fashion. Human/Hardware in the loop simulation study shows efficiency of the proposed scheme, and the importance of haptic feedback to achieve a better performance.

[1]  René van Paassen,et al.  Artificial Force Field for Haptic Feedback in UAV Teleoperation , 2009, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[2]  Antonio Franchi,et al.  A force-based bilateral teleoperation framework for aerial robots in contact with the environment , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[3]  Karl Iagnemma,et al.  A controllably adhesive climbing robot using magnetorheological fluid , 2012, 2012 IEEE International Conference on Technologies for Practical Robot Applications (TePRA).

[4]  Anuradha M. Annaswamy,et al.  Controlled Manipulation with Multiple Quadrotors , 2011 .

[5]  Antonio Franchi,et al.  Decentralized control of parallel rigid formations with direction constraints and bearing measurements , 2012, 2012 IEEE 51st IEEE Conference on Decision and Control (CDC).

[6]  Christoph Hürzeler,et al.  A perching mechanism for micro aerial vehicles , 2009 .

[7]  Domenico Prattichizzo,et al.  Stabilization of a Hierarchical Formation of Unicycle Robots with Velocity and Curvature Constraints , 2009, IEEE Transactions on Robotics.

[8]  Antonio Franchi,et al.  Bilateral Teleoperation of Groups of Mobile Robots With Time-Varying Topology , 2012, IEEE Transactions on Robotics.

[9]  Octavio Garcia,et al.  Toward Aerial Grasping and Manipulation with Multiple UAVs , 2013, J. Intell. Robotic Syst..

[10]  Hideyuki Tsukagoshi,et al.  Aerial manipulator with perching and door-opening capability , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[11]  Mark R. Cutkosky,et al.  Three-dimensional dynamic surface grasping with dry adhesion , 2016, Int. J. Robotics Res..

[12]  A. Ollero,et al.  Aerial manipulation robot composed of an autonomous helicopter and a 7 degrees of freedom industrial manipulator , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[13]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[14]  Antonio Franchi,et al.  Turning a near-hovering controlled quadrotor into a 3D force effector , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[15]  Taeyoung Lee,et al.  Geometric tracking control of a quadrotor UAV on SE(3) , 2010, 49th IEEE Conference on Decision and Control (CDC).

[16]  R. Brent Gillespie,et al.  Shared control between human and machine: haptic display of automation during manual control of vehicle heading , 2004, 12th International Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, 2004. HAPTICS '04. Proceedings..

[17]  Dongjun Lee,et al.  Hierarchical cooperative control framework of multiple quadrotor-manipulator systems , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[18]  Aaron M. Dollar,et al.  Stability of small-scale UAV helicopters and quadrotors with added payload mass under PID control , 2012, Autonomous Robots.

[19]  Dongjun Lee,et al.  Aerial tool operation system using quadrotors as Rotating Thrust Generators , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[20]  Giuseppe Oriolo,et al.  Simultaneous maximum-likelihood calibration of odometry and sensor parameters , 2008, 2008 IEEE International Conference on Robotics and Automation.

[21]  Vijay Kumar,et al.  The Inverse Kinematics of Cooperative Transport With Multiple Aerial Robots , 2013, IEEE Transactions on Robotics.

[22]  Vijay Kumar,et al.  Dynamics, Control and Planning for Cooperative Manipulation of Payloads Suspended by Cables from Multiple Quadrotor Robots , 2013, Robotics: Science and Systems.

[23]  Raffaello D'Andrea,et al.  Carrying a flexible payload with multiple flying vehicles , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[24]  Antonio Franchi,et al.  Decentralized parameter estimation and observation for cooperative mobile manipulation of an unknown load using noisy measurements , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[25]  Giuseppe Oriolo,et al.  Simultaneous Calibration of Odometry and Sensor Parameters for Mobile Robots , 2013, IEEE Transactions on Robotics.

[26]  Antonio Franchi,et al.  The flying hand: A formation of UAVs for cooperative aerial tele-manipulation , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[27]  P. J. Williams,et al.  OPT++: An object-oriented toolkit for nonlinear optimization , 2007, TOMS.

[28]  Antonio Franchi,et al.  Shared Control : Balancing Autonomy and Human Assistance with a Group of Quadrotor UAVs , 2012, IEEE Robotics & Automation Magazine.