Human-Computer Interaction. Advanced Interaction Modalities and Techniques

While myoeletric signals (MES) have long been employed for actuating hand prostheses, their potential as novel input for the interaction with computer systems has received little attention up until now. In this contribution, we present RemoteHand, a system that fosters remote device control through the transmission of myoelectric data over WLAN. This allows to manipulate objects through the user’s muscle activity regardless of their physical location. In our setup, a mechanical hand is controlled through electromyographic (EMG) sensors placed over the user’s forearm muscles. This approach is compared to a conventional remote device control exercised by a tablet touchpad. The results of our user study show that wireless interaction through myoelectric signals is a valid approach. Study participants achieved interaction speeds equal to those of a standard input method. Users especially value myoelectric input with regard to novelty and stimulation.

[1]  Junsong Yuan,et al.  Robust hand gesture recognition with kinect sensor , 2011, ACM Multimedia.

[2]  Yale Song,et al.  Tracking body and hands for gesture recognition: NATOPS aircraft handling signals database , 2011, Face and Gesture 2011.

[3]  Stefan Kopp,et al.  Gesture-based Object Recognition using Histograms of Guiding Strokes , 2012, BMVC.

[4]  Jörg Müller,et al.  StrikeAPose: revealing mid-air gestures on public displays , 2013, CHI.

[5]  Mario Costa Sousa,et al.  Fast stroke matching by angle quantization , 2007, IMMERSCOM.

[6]  Patrick Baudisch,et al.  Imaginary interfaces: spatial interaction with empty hands and without visual feedback , 2010, UIST.

[7]  Dean Rubine,et al.  Specifying gestures by example , 1991, SIGGRAPH.

[8]  Thomas Burger,et al.  A Low-Cost Natural User Interaction Based on a Camera Hand-Gestures Recognizer , 2011, HCI.

[9]  Michel Beaudouin-Lafon,et al.  Charade: remote control of objects using free-hand gestures , 1993, CACM.

[10]  Emo Welzl,et al.  Smallest enclosing disks (balls and ellipsoids) , 1991, New Results and New Trends in Computer Science.

[11]  Andreas Butz,et al.  Interactions in the air: adding further depth to interactive tabletops , 2009, UIST '09.

[12]  Yang Li,et al.  Protractor: a fast and accurate gesture recognizer , 2010, CHI.

[13]  Elena Mugellini,et al.  Gesture recognition corpora and tools: A scripted ground truthing method , 2015, Comput. Vis. Image Underst..

[14]  Otmar Hilliges,et al.  Bringing physics to the surface , 2008, UIST '08.

[15]  Isabelle Guyon,et al.  ChaLearn gesture challenge: Design and first results , 2012, 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[16]  Biing-Hwang Juang,et al.  A new 6D motion gesture database and the benchmark results of feature-based statistical recognition , 2012, 2012 IEEE International Conference on Emerging Signal Processing Applications.

[17]  Tae-Kyun Kim,et al.  Tensor Canonical Correlation Analysis for Action Classification , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[18]  Antonis A. Argyros,et al.  Markerless and Efficient 26-DOF Hand Pose Recovery , 2010, ACCV.

[19]  Saul Greenberg,et al.  The Continuous Interaction Space: Interaction Techniques Unifying Touch and Gesture on and above a Digital Surface , 2011, INTERACT.

[20]  Dimitar Valkov Interscopic multi-touch environments , 2010, ITS '10.

[21]  Ralf Dörner,et al.  Recognition of Dynamic Hand Gestures with Time-of-Flight Cameras , 2010 .

[22]  Ling Shao,et al.  Learning Discriminative Representations from RGB-D Video Data , 2013, IJCAI.

[23]  Tanushyam Chattopadhyay,et al.  Human localization at home using kinect , 2013, UbiComp.

[24]  Michael Rohs,et al.  A $3 gesture recognizer: simple gesture recognition for devices equipped with 3D acceleration sensors , 2010, IUI '10.

[25]  Z. Liu,et al.  A real time system for dynamic hand gesture recognition with a depth sensor , 2012, 2012 Proceedings of the 20th European Signal Processing Conference (EUSIPCO).

[26]  James D. Hollan,et al.  SLAP widgets: bridging the gap between virtual and physical controls on tabletops , 2009, CHI.

[27]  Jeremy R. Cooperstock,et al.  Did "Minority Report" Get It Wrong? Superiority of the Mouse over 3D Input Devices in a 3D Placement Task , 2009, INTERACT.

[28]  Patrick Lambert,et al.  Dynamic Hand Gesture Recognition Using the Skeleton of the Hand , 2005, EURASIP J. Adv. Signal Process..

[29]  Stan Sclaroff,et al.  The American Sign Language Lexicon Video Dataset , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.