Real-Time Avatar Animation Steered by Live Body Motion

The future customer service provided by call centres will be changed due to new web-based interactive multimedia technologies. Technical support will be offered in a completely new way by using advanced image processing technologies and natural representation of virtual humans. We present a prototype system of an animated avatar, which is steered by live body motion of the operator in a call centre. The hand and head motion is transferred directly to the avatar at the customer side in order to support a more natural representation of the virtual human. The system tracks the operators hands and the head motion quite robust in real-time without specific initialization based on a monocular camera.

[1]  Oliver Schreer,et al.  Vision-based skin-colour segmentation of moving hands for real-time applications , 2004 .

[2]  E. Granum,et al.  Skin colour detection under changing lighting conditions , 1999 .

[3]  Peter Eisert,et al.  Analyzing Facial Expressions for Virtual Conferencing , 1998, IEEE Computer Graphics and Applications.

[4]  Zhiwei Zhu,et al.  3D face pose tracking from an uncalibrated monocular camera , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[5]  Luc Van Gool,et al.  Model-based sparse 3D reconstruction for online body tracking , 2005 .

[6]  Agnès Just,et al.  Recognition of isolated complex mono- and bi-manual 3D hand gestures , 2004, Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings..

[7]  Vladimir Pavlovic,et al.  Visual Interpretation of Hand Gestures for Human-Computer Interaction: A Review , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Thomas B. Moeslund,et al.  A Survey of Computer Vision-Based Human Motion Capture , 2001, Comput. Vis. Image Underst..

[9]  Larry S. Davis,et al.  Computing 3-D head orientation from a monocular image sequence , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[10]  J. A. Parrish,et al.  Optical radiation transfer in the human skin and applications in in vivo remittance spectroscopy , 1981 .

[11]  Agnès Just,et al.  HMM and IOHMM for the Recognition of Mono- and Bi-Manual 3D Hand Gestures , 2004, BMVC.