Gesture-Based User Interfaces for Handheld Devices Using Accelerometer

This paper is about how to treat the signals of accelerometers to recognize user gestures from detected signals from accelerometers after applying small accelerometers to handheld devices, and about how to precisely recognize gestures to detect user gestures. To use handheld devices in recognizing gestures, overheads arising from the process of recognizing gestures should be little and gestures should be effectively recognized in real operational environments. Therefore, signals detected from accelerometers were treated after classifying them “static acceleration” and “dynamic acceleration”, and signal patterns of accelerometers about simple gestures were analyzed. In addition, a device control module was created and evaluated the usability of gestures recognition. The result was that because gesture-based control is easy to use and can reduce preparation process to control for rapid system reaction, it is a proper user interface for handheld devices primarily used in mobile environments.

[1]  Kristofer S. J. Pister,et al.  Acceleration Sensing Glove , 1999 .

[2]  J. F. Bartlett,et al.  Rock 'n' Scroll Is Here to Stay , 2000 .

[3]  B. Milner Handwriting recognition using acceleration-based motion detection , 1999 .

[4]  Eric Horvitz,et al.  Sensing techniques for mobile interaction , 2000, UIST '00.

[5]  Matthieu Bray,et al.  Recognition of gestures in the context of speech , 2002, Object recognition supported by user interaction for service robots.

[6]  Rüdiger Dillmann,et al.  Dynamic gestures as an input device for directing a mobile platform , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[7]  Tapio Seppänen,et al.  Hand gesture recognition of a mobile device user , 2000, 2000 IEEE International Conference on Multimedia and Expo. ICME2000. Proceedings. Latest Advances in the Fast Changing World of Multimedia (Cat. No.00TH8532).

[8]  Kristofer S. J. Pister,et al.  Acceleration sensing glove (ASG) , 1999, Digest of Papers. Third International Symposium on Wearable Computers.