Gesture-Controlled User Input to Complete Questionnaires on Wrist-Worn Watches

The aim of this work was to investigate arm gestures as an alternative input modality for wrist-worn watches. In particular we implemented a gesture recognition system and questionnaire interface into a watch prototype. We analyzed the wearer's effort and learning performance to use the gesture interface and compared their performance to a classical button-based solution. Moreover we evaluated the system performance to spot wearer gestures and the system responsiveness. Our wearer study showed that the watch achieved a recognition accuracy of more than 90%. Completion times showed a clear decrease from 3 min in the first repetition to 1 min, 49 sec in the last one. Similarly, variance of completion times between wearers decreased during repetitions. Completion time using the button interface was 36 sec. Ratings of physical and concentration effort decreased during the study. Our results confirm that wearer training state is rather reflected in completion time than recognition performance.

[1]  Paul Lukowicz,et al.  Gesture spotting with body-worn inertial sensors to detect user activities , 2008, Pattern Recognit..

[2]  H. Goldstein.  A dog named spot [smart personal objects technology watch] , 2004 .

[3]  Jin-Hyung Kim,et al.  Gesture spotting from continuous hand motion , 1998, Pattern Recognit. Lett..

[4]  Aaron F. Bobick,et al.  Recognition of Visual Activities and Interactions by Stochastic Parsing , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Paul Lukowicz,et al.  Waving Real Hand Gestures Recorded by Wearable Motion Sensors to a Virtual Car and Driver in a Mixed-Reality Parking Game , 2007, 2007 IEEE Symposium on Computational Intelligence and Games.

[6]  Sethuraman Panchanathan,et al.  Documenting motion sequences with a personalized annotation system , 2006, IEEE Multimedia.

[7]  Sven Kratz.  Gesture Recognition Using Motion Estimation on Mobile Phones , 2007 .

[8]  Jani Mäntyjärvi,et al.  User Independent Gesture Interaction for Small Handheld Devices , 2006, Int. J. Pattern Recognit. Artif. Intell..

[9]  Anthony Rowe,et al.  eWatch: a wearable sensor and notification platform , 2006, International Workshop on Wearable and Implantable Body Sensor Networks (BSN'06).

[10]  Niels Henze,et al.  Gesture recognition with a Wii controller , 2008, TEI.

[11]  Jiangwen Deng,et al.  An HMM-based approach for gesture segmentation and recognition , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.