SwarmTouch: Tactile Interaction of Human with Impedance Controlled Swarm of Nano-Quadrotors

We propose a novel interaction strategy for a human-swarm communication when a human operator guides a formation of quadrotors with impedance control and receives vibrotactile feedback. The presented approach takes into account the human hand velocity and changes the formation shape and dynamics accordingly using impedance interlinks simulated between quadrotors, which helps to achieve a life-like swarm behavior. Experimental results with Crazyflie 2.0 quadrotor platform validate the proposed control algorithm. The tactile patterns representing dynamics of the swarm (extension or contraction) are proposed. The user feels the state of the swarm at his fingertips and receives valuable information to improve the controllability of the complex life-like formation. The user study revealed the patterns with high recognition rates. Subjects stated that tactile sensation improves the ability to guide the drone formation and makes the human-swarm communication much more interactive. The proposed technology can potentially have a strong impact on the human-swarm interaction, providing a new level of intuitiveness and immersion into the swarm navigation.

[1]  Mark T. Bolas,et al.  Mixed reality for robotics , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[2]  Atulya K. Nagar,et al.  Wearable Vibrotactile Haptic Device for Stiffness Discrimination during Virtual Interactions , 2017, Front. Robot. AI.

[3]  Domenico Prattichizzo,et al.  Human-Robot Formation Control via Visual and Vibrotactile Haptic Feedback , 2014, IEEE Transactions on Haptics.

[4]  Antonio Franchi,et al.  Shared Control : Balancing Autonomy and Human Assistance with a Group of Quadrotor UAVs , 2012, IEEE Robotics & Automation Magazine.

[5]  Matthias Harders,et al.  Comparison of Tactile Signals for Collision Avoidance on Unmanned Aerial Vehicles , 2016, AsiaHaptics.

[6]  José Pascual Molina,et al.  Identifying Virtual 3D Geometric Shapes with a Vibrotactile Glove , 2016, IEEE Computer Graphics and Applications.

[7]  Gaurav S. Sukhatme,et al.  Crazyswarm: A large nano-quadcopter swarm , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[8]  Baris Fidan,et al.  Coordination and Control of Multi-agent Dynamic Systems: Models and Approaches , 2006, Swarm Robotics.

[9]  Kazuhiko Terashima,et al.  LinkTouch: A wearable haptic device with five-bar linkage mechanism for presentation of two-DOF force feedback at the fingerpad , 2014, HAPTICS.

[10]  Katia P. Sycara,et al.  Human Interaction With Robot Swarms: A Survey , 2016, IEEE Transactions on Human-Machine Systems.

[11]  H. Kajimoto,et al.  Optical torque sensors for implementation of local impedance control of the arm of humanoid robot , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[12]  Antonio Franchi,et al.  An evaluation of haptic cues on the tele-operator's perceptual awareness of multiple UAVs' environments , 2011, 2011 IEEE World Haptics Conference.

[13]  Neville Hogan,et al.  Impedance Control: An Approach to Manipulation , 1984, 1984 American Control Conference.

[14]  Lynette A. Jones,et al.  Tactile Displays: Guidance for Their Design and Application , 2008, Hum. Factors.

[15]  Peter I. Corke,et al.  A novel approach to haptic tele-operation of aerial robot vehicles , 2010, 2010 IEEE International Conference on Robotics and Automation.

[16]  Antonio Franchi,et al.  Measuring an operator's maneuverability performance in the haptic teleoperation of multiple robots , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[17]  Vijay Kumar,et al.  Construction of Cubic Structures with Quadrotor Teams , 2011, Robotics: Science and Systems.