A human-machine interface with unmanned aerial vehicles

Many UAV applications rely on a ground-based computer for accomplishing all processing tasks and the power consumed by such systems are a major roadblock when it comes to portability. In this paper we present an efficient and practical human-machine interface with an unmanned aerial vehicle (UAV). One of the main goals of the proposed interface is to be ubiquitous, so we moved all computational load to a mobile device running Android. Through this interface, the UAV responds to both movement and body gestures of the user; moreover, all processing tasks are done efficiently in the mobile device. We describe how we tracked the user throughout the video stream, which techniques we used and how we implemented them in our mobile platform for achieving a good level of performance.

[1]  Ehud Sharlin,et al.  Collocated interaction with flying robots , 2011, 2011 RO-MAN.

[2]  Patrick Pérez,et al.  Color-Based Probabilistic Tracking , 2002, ECCV.

[3]  Keita Higuchi,et al.  Flying sports assistant: external visual imagery representation for sports training , 2011, AH '11.

[4]  Wolfram Burgard,et al.  Probabilistic Robotics (Intelligent Robotics and Autonomous Agents) , 2005 .

[5]  Kerstin Dautenhahn,et al.  A personalized robot companion? - The role of individual differences on spatial preferences in HRI scenarios , 2007, RO-MAN 2007 - The 16th IEEE International Symposium on Robot and Human Interactive Communication.

[6]  Robin R. Murphy,et al.  A Midsummer Night's Dream: Social proof in HRI , 2010, 2010 5th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[7]  Simon Parsons,et al.  Principles of Robot Motion: Theory, Algorithms and Implementations by Howie Choset, Kevin M. Lynch, Seth Hutchinson, George Kantor, Wolfram Burgard, Lydia E. Kavraki and Sebastian Thrun, 603 pp., $60.00, ISBN 0-262-033275 , 2007, The Knowledge Engineering Review.

[8]  Luca Maria Gambardella,et al.  Human-swarm interaction using spatial gestures , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[9]  Howie Choset,et al.  Principles of Robot Motion: Theory, Algorithms, and Implementation ERRATA!!!! 1 , 2007 .

[10]  Shumin Fei,et al.  An Improved Particle Filter for Tracking Color Object , 2008, 2008 International Conference on Intelligent Computation Technology and Automation (ICICTA).

[11]  Takayuki Okatani,et al.  A color-based tracking by Kalman particle filter , 2004, ICPR 2004.

[12]  F. Hara Artificial emotion of face robot through learning in communicative interactions with human , 2004, RO-MAN 2004. 13th IEEE International Workshop on Robot and Human Interactive Communication (IEEE Catalog No.04TH8759).

[13]  Greg Mori,et al.  HRI in the sky: Creating and commanding teams of UAVs with a vision-mediated gestural interface , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[14]  Luciano da Fontoura Costa,et al.  2D Euclidean distance transform algorithms: A comparative survey , 2008, CSUR.

[15]  Juan Alejandro Pena Palacio,et al.  Remote control flying RC helicopter through natural user interface , 2014, CISTI 2014.

[16]  Yuan Chen,et al.  An Improved Color-Based Particle Filter for Object Tracking , 2008, 2008 Second International Conference on Genetic and Evolutionary Computing.