uWave: Accelerometer-based personalized gesture recognition and its applications

The proliferation of accelerometers on consumer electronics has brought an opportunity for interaction based on gestures or physical manipulation of the devices. We present uWave, an efficient recognition algorithm for such interaction using a single three-axis accelerometer. Unlike statistical methods, uWave requires a single training sample for each gesture pattern and allows users to employ personalized gestures and physical manipulations. We evaluate uWave using a large gesture library with over 4000 samples collected from eight users over an elongated period of time for a gesture vocabulary with eight gesture patterns identified by a Nokia research. It shows that uWave achieves 98.6% accuracy, competitive with statistical methods that require significantly more training samples. Our evaluation data set is the largest and most extensive in published studies, to the best of our knowledge. We also present applications of uWave in gesture-based user authentication and interaction with three-dimensional mobile user interfaces using user created gestures.

[1]  Jani Mäntyjärvi,et al.  Enabling fast and effortless customisation in accelerometer based gesture interaction , 2004, MUM '04.

[2]  Andrew D. Wilson,et al.  Gesture recognition using the XWand , 2004 .

[3]  E. Sheader,et al.  The Nintendo Wii , 2010 .

[4]  Yang Li,et al.  Gestures without libraries, toolkits or training: a $1 recognizer for user interface prototypes , 2007, UIST.

[5]  John Laver,et al.  Experiments with template adaptation in an isolated word recognition system , 1989, ECST.

[6]  Jonna Häkkilä,et al.  Tap input as an embedded interaction method for mobile devices , 2007, TEI.

[7]  Fritz Class,et al.  A learning procedure for speaker-dependent word recognition systems based on sequential processing of input tokens , 1983, ICASSP.

[8]  Michel Beaudouin-Lafon,et al.  Charade: remote control of objects using free-hand gestures , 1993, CACM.

[9]  I. J. Jang,et al.  Signal processing of the accelerometer for gesture awareness on handheld devices , 2003, The 12th IEEE International Workshop on Robot and Human Interactive Communication, 2003. Proceedings. ROMAN 2003..

[10]  Kristofer S. J. Pister,et al.  Acceleration sensing glove (ASG) , 1999, Digest of Papers. Third International Symposium on Wearable Computers.

[11]  Shigeyuki Sakazawa,et al.  Arm Swing Identification Method with Template Update for Long Term Stability , 2007, ICB.

[12]  Luca Benini,et al.  Gesture Signature for Ambient Intelligence Applications: A Feasibility Study , 2006, Pervasive.

[13]  Ying Wu,et al.  Vision-Based Gesture Recognition: A Review , 1999, Gesture Workshop.

[14]  Lin Zhong,et al.  uWave: Accelerometer-based Personalized Gesture Rec- ognition , 2008 .

[15]  Xiang Cao,et al.  VisionWand: interaction techniques for large displays using a passive wand tracked in 3D , 2003, UIST '03.

[16]  L. R. Rabiner,et al.  A comparative study of several dynamic time-warping algorithms for connected-word recognition , 1981, The Bell System Technical Journal.

[17]  Heni Ben Amor,et al.  Grasp Recognition with Uncalibrated Data Gloves - A Comparison of Classification Methods , 2007, 2007 IEEE Virtual Reality Conference.

[18]  Michael R. Chernick,et al.  Bootstrap Methods: A Practitioner's Guide , 1999 .

[19]  Paul Anderson,et al.  Gesture-recognition with Non-referenced Tracking , 2006, 3D User Interfaces (3DUI'06).

[20]  Joe Tullio,et al.  Usability analysis of 3D rotation techniques , 1997, UIST '97.

[21]  F. Okumura,et al.  A Study on Biometric Authentication based on Arm Sweep Action with Acceleration Sensor , 2006, 2006 International Symposium on Intelligent Signal Processing and Communications.

[22]  Jani Mäntyjärvi,et al.  Accelerometer-based gesture control for a design environment , 2006, Personal and Ubiquitous Computing.