Embodied Flight with a Drone

Most human-robot interfaces, such as joysticks and keyboards, require training and constant cognitive effort and provide a limited degree of awareness of the robots state and its environment. Embodied interactions, instead of interfaces, could bridge the gap between humans and robots, allowing humans to naturally perceive and act through a distal robotic body. Establishing an embodied interaction and mapping human movements and a non-anthropomorphic robot is particularly challenging. In this paper, we describe a natural and immersive embodied interaction that allows users to control and experience drone flight with their own bodies. The setup uses a commercial flight simulator that tracks hand movements and provides haptic and visual feedback. The paper discusses how to integrate the simulator with a real drone, how to map body movement with drone motion, and how the resulting embodied interaction provides a more natural and immersive flight experience to unskilled users with respect to a conventional RC remote controller.

[1]  Koichi Hori,et al.  Above your hand: direct and natural interaction with aerial robot , 2014, SIGGRAPH '14.

[2]  Dario Floreano,et al.  FlyJacket: An Upper Body Soft Exoskeleton for Immersive Drone Control , 2018, IEEE Robotics and Automation Letters.

[3]  Joseph J. LaViola,et al.  Exploring head tracked head mounted displays for first person robot teleoperation , 2014, IUI.

[4]  Amaya Becvar Weddle,et al.  UX Impacts of Haptic Latency in Automotive Interfaces Literature Review and User Study , 2013 .

[5]  Joseph J. LaViola,et al.  Exploring 3d gesture metaphors for interaction with unmanned aerial vehicles , 2013, IUI '13.

[6]  Kouta Minamizawa,et al.  Telexistence drone: design of a flight telexistence system for immersive aerial sports experience , 2015, AH.

[7]  Tatsuo Nakajima,et al.  Human Interaction Issues in a Digital-Physical Hybrid World , 2014, 2014 IEEE International Conference on Cyber-Physical Systems, Networks, and Applications.

[8]  Yu Wang,et al.  Human-Robot Interaction Based on Gaze Gestures for the Drone Teleoperation , 2014 .

[9]  K. Lafleur,et al.  Quadcopter control in three-dimensional space using a noninvasive motor imagery-based brain–computer interface , 2013, Journal of neural engineering.

[10]  Jeff Miller,et al.  Short Report: Reaction Time Analysis with Outlier Exclusion: Bias Varies with Sample Size , 1991, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[11]  A. Akce,et al.  A Brain–Machine Interface to Navigate a Mobile Robot in a Planar Workspace: Enabling Humans to Fly Simulated Aircraft With EEG , 2013, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[12]  Keita Higuchi,et al.  Flying head: A head-synchronization mechanism for flying telepresence , 2013, 2013 23rd International Conference on Artificial Reality and Telexistence (ICAT).

[13]  Michael J. Singer,et al.  Measuring Presence in Virtual Environments: A Presence Questionnaire , 1998, Presence.

[14]  Minho Kim,et al.  Quadcopter flight control using a low-cost hybrid interface with EEG-based classification and eye tracking , 2014, Comput. Biol. Medicine.

[15]  Greg Mori,et al.  HRI in the sky: Creating and commanding teams of UAVs with a vision-mediated gestural interface , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[16]  Federico Manuri,et al.  A Kinect-based natural interface for quadrotor control , 2011, Entertain. Comput..

[17]  E. Goffman Where The Action Is , 1969 .

[18]  T. Metzinger,et al.  Video Ergo Sum: Manipulating Bodily Self-Consciousness , 2007, Science.

[19]  Adrian Stoica,et al.  Remote Control of Quadrotor Teams, Using Hand Gestures , 2014, 2014 9th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[20]  S. M. Hansen Where the action is. , 1985, Journal (National Association for Hospital Development (U.S.)).

[21]  Dario Floreano,et al.  Haptic Guidance with a Soft Exoskeleton Reduces Error in Drone Teleoperation , 2018, EuroHaptics.

[22]  Wyatt Ubellacker,et al.  The HERMES humanoid system: A platform for full-body teleoperation with balance feedback , 2015, 2015 IEEE-RAS 15th International Conference on Humanoid Robots (Humanoids).

[23]  Silvestro Micera,et al.  Data-driven body–machine interface for the accurate control of drones , 2018, Proceedings of the National Academy of Sciences.

[24]  O. Blanke,et al.  Body ownership and embodiment: Vestibular and multisensory mechanisms , 2008, Neurophysiologie Clinique/Clinical Neurophysiology.