Gesture-recognition with Non-referenced Tracking

This paper presents 3motion, a novel 3D gesture interaction system consisting of a low-cost, lightweight hardware component and a general-purpose software development kit. The system provides gesture-based 3D interaction for situations where traditional tracking systems are too expensive or impractical due to the calibration and reference source requirements. The hardware component is built around a 3-axis linear accelerometer chip and transmits a continuous data stream to a host device via a wireless Bluetooth link. The software component receives this data and matches it against a library of 3D gestures to trigger actions. The system has been validated extensively with various example applications, including a “Battle of the Wizards” game, a character manipulation demonstrator, and a golf game implemented on a mobile phone.

[1]  Ian Oakley,et al.  Dynamic Primitives for Gestural Interaction , 2004, Mobile HCI.

[2]  Narendra Ahuja,et al.  Extraction of 2D Motion Trajectories and Its Application to Hand Gesture Recognition , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Jani Mäntyjärvi,et al.  Enabling fast and effortless customisation in accelerometer based gesture interaction , 2004, MUM '04.

[4]  Cyrus Shahabi,et al.  Device independence and extensibility in gesture recognition , 2003, IEEE Virtual Reality, 2003. Proceedings..

[5]  Songde Ma,et al.  Schwarz representation for matching and similarity analysis , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[6]  Ipke Wachsmuth,et al.  Gesture and Sign Language in Human-Computer Interaction , 1998, Lecture Notes in Computer Science.

[7]  Jianyi Liu,et al.  Hotspot Components for Gesture-Based Interaction , 2005, INTERACT.

[8]  Berthold K. P. Horn,et al.  Closed-form solution of absolute orientation using unit quaternions , 1987 .

[9]  Ipke Wachsmuth,et al.  Gesture and Sign Languages in Human-Computer Interaction, International Gesture Workshop, GW 2001, London, UK, April 18-20, 2001, Revised Papers , 2002, Gesture Workshop.

[10]  Daniel Thalmann,et al.  Body expression in virtual environments , 1999, 8th IEEE International Workshop on Robot and Human Interaction. RO-MAN '99 (Cat. No.99TH8483).

[11]  Stan Z. Li,et al.  Invariant representation, matching and pose estimation of 3D space curves under similarity transformations , 1997, Pattern Recognit..

[12]  Keechul Jung,et al.  Recognition-based gesture spotting in video games , 2004, Pattern Recognit. Lett..

[13]  Albrecht Schmidt,et al.  Using an autonomous cube for basic navigation and input , 2003, ICMI '03.

[14]  Richard Furuta,et al.  A logical hand device in virtual environments , 1994 .

[15]  Joseph A. Paradiso,et al.  An Inertial Measurement Framework for Gesture Recognition and Applications , 2001, Gesture Workshop.

[16]  Stephen A. Brewster,et al.  A paradigm shift: alternative interaction techniques for use with mobile & wearable devices , 2003, CASCON.

[17]  K. Tsukada,et al.  Ubi-Finger : Gesture Input Device for Mobile Use , 2002 .

[18]  Robert W. Lindeman,et al.  A multi-class pattern recognition system for practical finger spelling translation , 2002, Proceedings. Fourth IEEE International Conference on Multimodal Interfaces.

[19]  Manuel Odendahl,et al.  The BlueWand as interface for ubiquitous and wearable computing environments , 2003 .

[20]  Vladimir Pavlovic,et al.  Visual Interpretation of Hand Gestures for Human-Computer Interaction: A Review , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  Günter Hommel,et al.  Analyzing Human Gestural Motions using Acceleration Sensors , 1996, Gesture Workshop.