Whole-Body Bilateral Teleoperation of a Redundant Aerial Manipulator

Attaching a robotic manipulator to a flying base allows for significant improvements in the reachability and versatility of manipulation tasks. In order to explore such systems while taking advantage of human capabilities in terms of perception and cognition, bilateral teleoperation arises as a reasonable solution. However, since most telemanipulation tasks require visual feedback in addition to the haptic one, real-time (task-dependent) positioning of a video camera, which is usually attached to the flying base, becomes an additional objective to be fulfilled. Since the flying base is part of the kinematic structure of the robot, if proper care is not taken, moving the video camera could undesirably disturb the end-effector motion. For that reason, the necessity of controlling the base position in the null space of the manipulation task arises. In order to provide the operator with meaningful information about the limits of the allowed motions in the null space, this paper presents a novel haptic concept called Null-Space Wall. In addition, a framework to allow stable bilateral teleoperation of both tasks is presented. Numerical simulation data confirm that the proposed framework is able to keep the system passive while allowing the operator to perform time-delayed telemanipulation and command the base to a task-dependent optimal pose.

[1]  Konstantin Kondak,et al.  Smoother Position-Drift Compensation for Time Domain Passivity Approach Based Teleoperation , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[2]  Frans C. T. van der Helm,et al.  A Task-Specific Analysis of the Benefit of Haptic Shared Control During Telemanipulation , 2013, IEEE Transactions on Haptics.

[3]  Ernest D. Fasse,et al.  Spatial Compliance Modeling Using a Quaternion-Based Potential Function Method , 2000 .

[4]  Antonio Franchi,et al.  The flying hand: A formation of UAVs for cooperative aerial tele-manipulation , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[5]  Blake Hannaford,et al.  Time domain passivity control of haptic interfaces , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[6]  Antonio Franchi,et al.  Shared planning and control for mobile robots with integral haptic feedback , 2018, Int. J. Robotics Res..

[7]  Konstantin Kondak,et al.  Optimal Oscillation Damping Control of cable-Suspended Aerial Manipulator with a Single IMU Sensor , 2020, 2020 IEEE International Conference on Robotics and Automation (ICRA).

[8]  Gerd Hirzinger,et al.  Posture and balance control for biped robots based on contact force optimization , 2011, 2011 11th IEEE-RAS International Conference on Humanoid Robots.

[9]  Alexander Dietrich,et al.  Prioritized multi-task compliance control of redundant manipulators , 2015, Autom..

[10]  Richard M. Murray,et al.  A Mathematical Introduction to Robotic Manipulation , 1994 .

[11]  R. Stephenson A and V , 1962, The British journal of ophthalmology.

[12]  Konstantin Kondak,et al.  Multi-DoF Time Domain Passivity Approach Based Drift Compensation for Telemanipulation , 2019, 2019 19th International Conference on Advanced Robotics (ICAR).

[13]  Anibal Ollero,et al.  Contact-Based Bridge Inspection Multirotors: Design, Modeling, and Control Considering the Ceiling Effect , 2019, IEEE Robotics and Automation Letters.

[14]  R. Murray,et al.  Proportional Derivative (PD) Control on the Euclidean Group , 1995 .

[15]  A. Ollero,et al.  Aerial manipulation robot composed of an autonomous helicopter and a 7 degrees of freedom industrial manipulator , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[16]  Gerd Hirzinger,et al.  Network representation and passivity of delayed teleoperation systems , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[17]  Alin Albu-Schäffer,et al.  KONTUR-2: Force-feedback teleoperation from the international space station , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[18]  Aníbal Ollero,et al.  Aerial Manipulation: A Literature Review , 2018, IEEE Robotics and Automation Letters.

[19]  Abdulmotaleb El Saddik,et al.  Artificial and Virtual Impedance Interaction Force Reflection-Based Bilateral Shared Control for Miniature Unmanned Aerial Vehicle , 2019, IEEE Transactions on Industrial Electronics.

[20]  Christian Ott,et al.  Subspace-oriented energy distribution for the Time Domain Passivity Approach , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[21]  Dale A. Lawrence Stability and transparency in bilateral teleoperation , 1993, IEEE Trans. Robotics Autom..

[22]  Grasp Lab AVIAN-INSPIRED GRASPING FOR QUADROTOR MICRO UAVS , 2013 .

[23]  Konstantin Kondak,et al.  The AEROARMS Project: Aerial Robots with Advanced Manipulation Capabilities for Inspection and Maintenance , 2018, IEEE Robotics & Automation Magazine.

[24]  Antonio Franchi,et al.  Cooperative aerial tele-manipulation with haptic feedback , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[25]  Konstantin Kondak,et al.  Development of SAM: cable-Suspended Aerial Manipulator* , 2019, 2019 International Conference on Robotics and Automation (ICRA).

[26]  Mamoru Mitsuishi,et al.  Dynamic Active Constraints for Surgical Robots Using Vector-Field Inequalities , 2019, IEEE Transactions on Robotics.

[27]  Konstantin Kondak,et al.  Visual-Inertial Telepresence for Aerial Manipulation , 2020, 2020 IEEE International Conference on Robotics and Automation (ICRA).

[28]  Jordi Artigas,et al.  A passive bilateral control scheme for a teleoperator with time-varying communication delay , 2010 .