Gesture Recognition in Flow in the Context of Virtual Theater

Our aim is to put on a short play featuring a real actor and a virtual actor, who will communicate through movements and choreography with mutual synchronization. Although the theatrical context is a good ground for multimodal communication between human and virtual actors, this paper will mainly deal with the ability to perceive the gestures of a real actor. During the performance, our goal is to match real-time observation with recorded examples. The recognition event will be sent to a virtual actor which reply with its own movements. We follow an approach similar to that proposed by [1] or [2]. They made the assumption that the first phase is to summarize the variation of the movement into a symbolic description. Then, the recognition phase is performed when a new trajectory is consistent with this description. The main section will describe our method of creating a signature from gestural data and the recognition system in real-time flow. To conclude, we shall present some results.

[1]  Aaron F. Bobick,et al.  A state-based technique for the summarization and recognition of gesture , 1995, Proceedings of IEEE International Conference on Computer Vision.

[2]  Eugene Fiume,et al.  An efficient search algorithm for motion data using weighted PCA , 2005, SCA '05.

[3]  M. Alex O. Vasilescu Human motion signatures: analysis, synthesis, recognition , 2002, Object recognition supported by user interaction for service robots.

[4]  Aaron F. Bobick,et al.  Recognition of human body motion using phase space constraints , 1995, Proceedings of IEEE International Conference on Computer Vision.

[5]  Daijin Kim,et al.  Simultaneous Gesture Segmentation and Recognition based on Forward Spotting Accumulative HMMs , 2006, 18th International Conference on Pattern Recognition (ICPR'06).