A Real-time Personalized Gesture Interaction System Using Wii Remote and Kinect for Tiled-Display Environment

Gesture interaction is more convenient than traditional input methods in tiled-display environments. As the advance of somatosensory technologies, more and more somatosensory devices such as Wii Remote and Kinect that can be used in gesture interaction are commercially available. We present a real-time personalized gesture interaction system targeting for two-handed gestures for tiled-display environment in this paper. By applying the dynamic time warping (DTW) algorithm, the system does not require a special training stage and is easy to use. Experiment shows that the combination of acceleration data from Wii Remote and skeleton point data from Kinect leads to higher recognition accuracy with lower recognition error rate, and the system can also recognize an ongoing gesture before it ends while the recognition accuracy is kept high enough. Our usage of this system in a real tiled-display environment shows that the system is practical.