An Exploration Of Unmanned Aerial Vehicle Direct Manipulation Through 3d Spatial Interaction

We present an exploration that surveys the strengths and weaknesses of various 3D spatial interaction techniques, in the context of directly manipulating an Unmanned Aerial Vehicle (UAV). Particularly, a study of touchand devicefree interfaces in this domain is provided. 3D spatial interaction can be achieved using hand-held motion control devices such as the Nintendo Wiimote, but computer vision systems offer a different and perhaps more natural method. In general, 3D user interfaces (3DUI) enable a user to interact with a system on a more robust and potentially more meaningful scale. We discuss the design and development of various 3D interaction techniques using commercially available computer vision systems, and provide an exploration of the effects that these techniques have on an overall user experience in the UAV domain. Specific qualities of the user experience are targeted, including the perceived intuition, ease of use, comfort, and others. We present a complete user study for upper-body gestures, and preliminary reactions towards 3DUI using hand-and-finger gestures are also discussed. The results provide evidence that supports the use of 3DUI in this domain, as well as the use of certain styles of techniques over others.

[1]  Ehud Sharlin,et al.  Collocated interaction with flying robots , 2011, 2011 RO-MAN.

[2]  Frédéric Lerasle,et al.  Two-handed gesture recognition and fusion with speech to command a robot , 2011, Autonomous Robots.

[3]  F. Zuher,et al.  Recognition of Human Motions for Imitation and Control of a Humanoid Robot , 2012, 2012 Brazilian Robotics Symposium and Latin American Robotics Symposium.

[4]  Ivan Poupyrev,et al.  3D User Interfaces: Theory and Practice , 2004 .

[5]  Keita Higuchi,et al.  Flying head: head-synchronized unmanned aerial vehicle control for flying telepresence , 2012, SIGGRAPH 2012.

[6]  Mary L. Cummings,et al.  Boredom and Distraction in Multiple Unmanned Vehicle Supervisory Control , 2013, Interact. Comput..

[7]  Patrick Olivier,et al.  Digits: freehand 3D interactions anywhere using a wrist-worn gloveless sensor , 2012, UIST.

[8]  Jörg Krüger,et al.  Markerless gesture-based motion control and programming of industrial robots , 2011, ETFA2011.

[9]  John Q. Gan,et al.  Asynchronous BCI Control of a Robot Simulator with Supervised Online Training , 2007, IDEAL.

[10]  Ivan Poupyrev,et al.  The go-go interaction technique: non-linear mapping for direct manipulation in VR , 1996, UIST '96.

[11]  Riccardo Poli,et al.  Towards cooperative brain-computer interfaces for space navigation , 2013, IUI '13.

[12]  Samir Otmane,et al.  FOLLOW-ME: a new 3D interaction technique based on virtual guides and granularity of interaction , 2006, VRCIA '06.

[13]  Grasp Lab.  AVIAN-INSPIRED GRASPING FOR QUADROTOR MICRO UAVS , 2013 .

[14]  Gerard Jounghyun Kim,et al.  Interaction techniques in large display environments using hand-held devices , 2006, VRST '06.

[15]  Keng Peng Tee,et al.  Intuitive interaction for robotic grasping , 2012, WASA '12.

[16]  I. Scott MacKenzie,et al.  Demo of gaze controlled flying , 2012, NordiCHI.

[17]  M. Urban,et al.  Fusion of voice, gesture, and human-computer interface controls for remotely operated robot , 2005, 2005 7th International Conference on Information Fusion.

[18]  Tracy Anne Hammond,et al.  RedDog: a smart sketch interface for autonomous aerial systems , 2012, SBIM '12.

[19]  Yale Song,et al.  Continuous body and hand gesture recognition for natural human-computer interaction , 2012, TIIS.

[20]  Eric D. Ragan,et al.  Questioning naturalism in 3D user interfaces , 2012, CACM.

[21]  Tim Roberts,et al.  Multi-Kinect Tracking for Dismounted Soldier Training , 2012 .

[22]  Bernhard Rinner,et al.  Collaborative microdrones: applications and research challenges , 2008, Autonomics.

[23]  Maud Marchal,et al.  Joyman: A human-scale joystick for navigating in virtual worlds , 2011, 2011 IEEE Symposium on 3D User Interfaces (3DUI).

[24]  Ivan Poupyrev,et al.  Manipulating Objects in Virtual Worlds: Categorization and Empirical Evaluation of Interaction Techniques , 1999, J. Vis. Lang. Comput..

[25]  Henrik I. Christensen,et al.  Wiimote robot control using human motion models , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[26]  Of references. , 1966, JAMA.

[27]  S. Holm.  A Simple Sequentially Rejective Multiple Test Procedure , 1979 .

[28]  Martin Frassl,et al.  A prototyping environment for interaction between a human and a robotic multi-agent system , 2012, 2012 7th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[29]  Joseph J. LaViola,et al.  Exploring 3d gesture metaphors for interaction with unmanned aerial vehicles , 2013, IUI '13.

[30]  Peng Song,et al.  A handle bar metaphor for virtual object manipulation with mid-air interaction , 2012, CHI.