Video-based gesture interface to interactive movies

totally counter-intuitive when used in 3D spatial interA video-based gesture gesture recognition system can action. Speech will have to be reserved for communibe used as a user interface to an interactive movie or cation with synthetic actors and human participants. play. Such an rnterface can be vemJ intuitive, and unExperimental multidimensional devices such as sensing constrainang. This paper shows how the output of a gesgloves, body suites, magnetic sensors or reflective pads ture recognition system can be mapped to controls of an attached to the user are too cumbersome and constrainznteractive movie to achaeve a natural user interaction. ing to become widely accepted. The proposed anterface will allow the user to control the A technology that promises a natural and unconvaew of the scene, actor’s locomotion, head movements strained spatial interface is a direct gesture input, where and motions or gestures of actor’s hands, relying on no gestures and control values are extracted from hand imother input than the user’s naked hand. ages acquired by video cameras ([l, 2, 41. Such optical