Gesture based Input Device: An All Inertial Approach

In this paper, we develop a gesture-based input device equipped with accelerometers and gyroscopes. The sensors measure the inertial measurements, i.e., accelerations and angular velocities produced by the movement of the system when a user is inputting gestures on a plane surface or in a 3D space. The gyroscope measurements are integrated to give orientation of the device and consequently used to compensate the accelerations. The compensated accelerations are doubly integrated to yield the position of the device. With this approach, a user's gesture input trajectories can be recovered without any external sensors. Three versions of motion tracking algorithms are provided to cope with wide spectrum of applications. Then, a Bayesian network based recognition system processes the recovered trajectories to identify the gesture class. Experimental results convincingly show the feasibility and effectiveness of the proposed gesture input device. In order to show practical use of the proposed input method, we implemented a prototype system, which is a gesture-based remote controller (Magic Wand).

[1]  Kosuke Sato,et al.  Human motion capture by integrating gyroscopes and accelerometers , 1996, 1996 IEEE/SICE/RSJ International Conference on Multisensor Fusion and Integration for Intelligent Systems (Cat. No.96TH8242).

[2]  Hideki Hashimoto,et al.  Human Centered Robot for Mutual Interaction in Intelligent Space , 2005, Int. J. Fuzzy Log. Intell. Syst..

[3]  Jin Hyung Kim,et al.  Bayesian network modeling of Hangul characters for online handwriting recognition , 2003, Seventh International Conference on Document Analysis and Recognition, 2003. Proceedings..

[4]  Sung-Jung Cho,et al.  Bayesian network modeling of strokes and their relationships for on-line handwriting recognition , 2004, Pattern Recognit..

[5]  E. Groten,et al.  Integrated INS/GPS system for high precision navigation applications , 1994, Proceedings of 1994 IEEE Position, Location and Navigation Symposium - PLANS'94.

[6]  Martin P. Mintchev,et al.  Accuracy limitations of FOG-based continuous measurement-while-drilling surveying instruments for horizontal wells , 2002, IEEE Trans. Instrum. Meas..

[7]  D. B. Reid,et al.  INS reset removal for enhanced post-flight performance analysis , 1990, IEEE Symposium on Position Location and Navigation. A Decade of Excellence in the Navigation Sciences.

[8]  Kristofer S. J. Pister,et al.  Acceleration sensing glove (ASG) , 1999, Digest of Papers. Third International Symposium on Wearable Computers.

[9]  Peter E. Jones.  Three-dimensional input device with six degrees of freedom , 1999 .

[10]  J. R. Huddle.  Trends in inertial systems technology for high accuracy AUV navigation , 1998, Proceedings of the 1998 Workshop on Autonomous Underwater Vehicles (Cat. No.98CH36290).