Advanced authoring tools for game-based training

We present a complete system of authoring technologies for creating scenario-driven 3D games for training. The proposed system includes advanced tools for authoring and debugging non-linear training scenarios, creating and real-time rendering of immersive 3D environments, and automatic generation of character facial animations using recorded speech. The scenario authoring tools make it possible to easily construct and debug complex training logic flows. The 3D real-time rendering tools enable content developers with a what-you-see-is-what-you-get working environment and hence greatly reduce the production time for 3D scene and character development. The speech-driven face animation tools provide for automatic generation of lip and emotion animation.

[1]  Lance Williams,et al.  Casting curved shadows on curved surfaces , 1978, SIGGRAPH.

[2]  Jan J. Koenderink,et al.  The secret of velvety skin , 2003, Machine Vision and Applications.

[3]  A. Tanju Erdem,et al.  A new method for generating 3-D face models for personalized user interaction , 2005, 2005 13th European Signal Processing Conference.

[4]  Erik Reinhard,et al.  Photographic tone reproduction for digital images , 2002, ACM Trans. Graph..

[5]  Oudeyer Pierre-Yves,et al.  The production and recognition of emotions in speech: features and algorithms , 2003 .

[6]  A. Murat Tekalp,et al.  Multimodal speaker identification using an adaptive classifier cascade based on modality reliability , 2005, IEEE Transactions on Multimedia.

[7]  Mark Steedman,et al.  Animated conversation: rule-based generation of facial expression, gesture & spoken intonation for multiple conversational agents , 1994, SIGGRAPH.

[8]  E. Erzin,et al.  Comparison of Phoneme and Viseme Based Acoustic Units for Speech Driven Realistic lip Animation , 2007, 2007 3DTV Conference.

[9]  Matthew Brand,et al.  Voice puppetry , 1999, SIGGRAPH.

[10]  Herbert H. Bell,et al.  The Use of Constructive Modeling and Virtual Simulation in Large-Scale Team Training: A Military Case Study. , 1999 .

[11]  Pierre-Yves Oudeyer,et al.  The production and recognition of emotions in speech: features and algorithms , 2003, Int. J. Hum. Comput. Stud..

[12]  Astrid Paeschke,et al.  A database of German emotional speech , 2005, INTERSPEECH.

[13]  Michelle F. Wright,et al.  Computer Gaming and Interactive Simulations for Learning: A Meta-Analysis , 2006 .

[14]  Shrikanth S. Narayanan,et al.  Toward detecting emotions in spoken dialogs , 2005, IEEE Transactions on Speech and Audio Processing.

[15]  Katrina E. Ricci,et al.  Do Computer-Based Games Facilitate Knowledge Acquisition and Retention? , 1996 .

[16]  Justine Cassell,et al.  Requirements for an Architecture for Embodied Conversational Characters , 1999, Computer Animation and Simulation.

[17]  Stephanie Seneff,et al.  Transcription and Alignment of the TIMIT Database , 1996 .

[18]  Fan Zhang,et al.  Parallel-split shadow maps for large-scale virtual environments , 2006, VRCIA '06.

[19]  Shree K. Nayar,et al.  Photorealistic rendering of rain streaks , 2006, SIGGRAPH '06.