SwarmTouch: Guiding a Swarm of Micro-Quadrotors With Impedance Control Using a Wearable Tactile Interface

To achieve a smooth and safe guiding of a drone formation by a human operator, we propose a novel interaction strategy for a human–swarm communication, which combines impedance control and vibrotactile feedback. The presented approach takes into account the human hand velocity and changes the formation shape and dynamics accordingly using impedance interlinks simulated between quadrotors, which helps to achieve a natural swarm behavior. Several tactile patterns representing static and dynamic parameters of the swarm are proposed. The user feels the state of the swarm at the fingertips and receives valuable information to improve the controllability of the complex formation. A user study revealed the patterns with high recognition rates. A flight experiment demonstrated the possibility to accurately navigate the formation in a cluttered environment using only tactile feedback. Subjects stated that tactile sensation allows guiding the drone formation through obstacles and makes the human–swarm communication more interactive. The proposed technology can potentially have a strong impact on the human–swarm interaction, providing a higher level of awareness during the swarm navigation.

[1]  Domenico Prattichizzo,et al.  Human-Robot Formation Control via Visual and Vibrotactile Haptic Feedback , 2014, IEEE Transactions on Haptics.

[2]  H. Kajimoto,et al.  Optical torque sensors for implementation of local impedance control of the arm of humanoid robot , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[3]  Baris Fidan,et al.  Coordination and Control of Multi-agent Dynamic Systems: Models and Approaches , 2006, Swarm Robotics.

[4]  Antonio Franchi,et al.  The flying hand: A formation of UAVs for cooperative aerial tele-manipulation , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[5]  Vijay Kumar,et al.  Construction of Cubic Structures with Quadrotor Teams , 2011, Robotics: Science and Systems.

[6]  Claudio Pacchierotti,et al.  Design and Evaluation of a Wearable Haptic Device for Skin Stretch, Pressure, and Vibrotactile Stimuli , 2018, IEEE Robotics and Automation Letters.

[7]  Antonio Franchi,et al.  An evaluation of haptic cues on the tele-operator's perceptual awareness of multiple UAVs' environments , 2011, 2011 IEEE World Haptics Conference.

[8]  Mark T. Bolas,et al.  Mixed reality for robotics , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[9]  N. Mimmo,et al.  A control architecture for multiple drones operated via multimodal interaction in search & rescue mission , 2016, 2016 IEEE International Symposium on Safety, Security, and Rescue Robotics (SSRR).

[10]  Atulya K. Nagar,et al.  Wearable Vibrotactile Haptic Device for Stiffness Discrimination during Virtual Interactions , 2017, Front. Robot. AI.

[11]  Dzmitry Tsetserukou,et al.  SwarmTouch: Tactile Interaction of Human with Impedance Controlled Swarm of Nano-Quadrotors , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[12]  Lynette A. Jones,et al.  Tactile Displays: Guidance for Their Design and Application , 2008, Hum. Factors.

[13]  O. Khatib,et al.  Real-Time Obstacle Avoidance for Manipulators and Mobile Robots , 1985, Proceedings. 1985 IEEE International Conference on Robotics and Automation.

[14]  Martin Saska,et al.  MAV-swarms: Unmanned aerial vehicles stabilized along a given path using onboard relative localization , 2015, 2015 International Conference on Unmanned Aircraft Systems (ICUAS).

[15]  Matthias Harders,et al.  Comparison of Tactile Signals for Collision Avoidance on Unmanned Aerial Vehicles , 2016, AsiaHaptics.

[16]  José Pascual Molina,et al.  Identifying Virtual 3D Geometric Shapes with a Vibrotactile Glove , 2016, IEEE Computer Graphics and Applications.

[17]  Peter I. Corke,et al.  A novel approach to haptic tele-operation of aerial robot vehicles , 2010, 2010 IEEE International Conference on Robotics and Automation.

[18]  Neville Hogan,et al.  Impedance Control: An Approach to Manipulation , 1984, 1984 American Control Conference.

[19]  Dario Floreano,et al.  FlyJacket: An Upper Body Soft Exoskeleton for Immersive Drone Control , 2018, IEEE Robotics and Automation Letters.

[20]  Kazuhiko Terashima,et al.  LinkTouch: A wearable haptic device with five-bar linkage mechanism for presentation of two-DOF force feedback at the fingerpad , 2014, HAPTICS.

[21]  Katia P. Sycara,et al.  Human Interaction With Robot Swarms: A Survey , 2016, IEEE Transactions on Human-Machine Systems.