Demo: e-gesture - a collaborative architecture for energy-efficient gesture recognition with hand-worn sensor and mobile devices

We demonstrate E-Gesture, a collaborative architecture for energy-efficient gesture recognition on a hand-worn sensor device and an off-the-shelf smartphone that greatly reduces energy consumption while achieving high accuracy recognition under dynamic mobile situations. E-gesture employs a novel gesture segmentation and classification architecture carefully crafted by studying sporadic occurrence patterns of gestures in continuous sensor data streams and analyzing energy consumption characteristics in both sensor and smartphone.

[1]  Jani Mäntyjärvi,et al.  Accelerometer-based gesture control for a design environment , 2006, Personal and Ubiquitous Computing.

[2]  Tarek F. Abdelzaher,et al.  SATIRE: a software architecture for smart AtTIRE , 2006, MobiSys '06.

[3]  Youngki Lee,et al.  SeeMon: scalable and energy-efficient context monitoring framework for sensor-rich mobile environments , 2008, MobiSys '08.

[4]  Youngki Lee,et al.  Orchestrator: An active resource orchestration framework for mobile context monitoring in sensor-rich mobile environments , 2010, 2010 IEEE International Conference on Pervasive Computing and Communications (PerCom).

[5]  Kent Lyons,et al.  GART: The Gesture and Activity Recognition Toolkit , 2007, HCI.

[6]  Ling Bao,et al.  Activity Recognition from User-Annotated Acceleration Data , 2004, Pervasive.

[7]  Daniel P. Siewiorek,et al.  Performance Analysis of an HMM-Based Gesture Recognition Using a Wristwatch Device , 2009, 2009 International Conference on Computational Science and Engineering.

[8]  Tolga K. Çapin,et al.  Mobile Camera-Based User Interaction , 2005, ICCV-HCI.

[9]  Niels Henze,et al.  Gesture recognition with a Wii controller , 2008, TEI.

[10]  Kent Lyons,et al.  The Gesture Watch: A Wireless Contact-free Gesture based Wrist Interface , 2007, 2007 11th IEEE International Symposium on Wearable Computers.

[11]  Lama Nachman,et al.  Don't slow me down: Bringing energy efficiency to continuous gesture recognition , 2010, International Symposium on Wearable Computers (ISWC) 2010.

[12]  Jinwon Lee,et al.  MobiCon: Mobile Context Monitoring Platform for Sensor-Rich Dynamic Environments , 2010 .

[13]  Joseph A. Paradiso,et al.  An Inertial Measurement Framework for Gesture Recognition and Applications , 2001, Gesture Workshop.

[14]  Gerhard Tröster,et al.  Gestures are strings: efficient online gesture spotting and classification using string matching , 2007, BODYNETS.

[15]  Kyoung-Ho Kang,et al.  Self-contained spatial input device for wearable computers , 2003, Seventh IEEE International Symposium on Wearable Computers, 2003. Proceedings..

[16]  Ying Wu,et al.  Vision-Based Gesture Recognition: A Review , 1999, Gesture Workshop.

[17]  Roy Want,et al.  Gesture connect: facilitating tangible interaction with a flick of the wrist , 2007, TEI.

[18]  Shyamal Patel,et al.  Mercury: a wearable sensor network platform for high-fidelity motion analysis , 2009, SenSys '09.

[19]  Paul Lukowicz,et al.  Gesture spotting with body-worn inertial sensors to detect user activities , 2008, Pattern Recognit..

[20]  Pei Zhang,et al.  The PSI Board: Realizing a Phone-Centric Body Sensor Network , 2007, BSN.

[21]  Zhen Wang,et al.  uWave: Accelerometer-based Personalized Gesture Recognition and Its Applications , 2009, PerCom.

[22]  Jin-Hyung Kim,et al.  An HMM-Based Threshold Model Approach for Gesture Recognition , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  Steven A. Shafer,et al.  XWand: UI for intelligent spaces , 2003, CHI '03.

[24]  Yi Wang,et al.  A framework of energy efficient mobile sensing for automatic user state recognition , 2009, MobiSys '09.