Realtime Generation of Customized 3D Animated Explanations for Knowledge-Based Learning Environments

Rich 3D animated explanations can have a powerful impact on students interacting with immersive knowledge-based learning environments. By generating 3D animated explanations in realtime, a learning environment can create engaging explanations that are tailored to individual students. This paper presents the immersive explanation planning framework for generating pedagogically-customized 3D animated explanations in realtime. In this framework, an explanation system selects 3D models and their relevant behaviors, creates camera shots that most clearly depict complex phenomena, constructs a tern poral organization that synchronizes narrative utterances with visual elements, plans the movement of the virtual camera that "films" the explanation, and incorporates specialized visual effects to focus students' attention on the most salient concepts. The framework has been implemented in RAPID, an explanation system that plans and renders customized 3D animated explanations of dynamic phenomena in realtime. Results of a focus group evaluation of RAPID are encouraging.

[1]  Norman I. Badler,et al.  Automatic viewing control for 3D direct manipulation , 1992, I3D '92.

[2]  Thomas Rist,et al.  Coping with Temporal Constraints in Multimedia Presentation Planning , 1996, AAAI/IAAI, Vol. 1.

[3]  Beverly Park Woolf,et al.  A Simulation-Based Tutor that Reasons about Multiple Agents , 1996, AAAI/IAAI, Vol. 1.

[4]  Daniel T. Ling,et al.  Planning-based control of interface animation , 1995, CHI '95.

[5]  Andreas Butz,et al.  Anymation with CATHI , 1997, AAAI 1997.

[6]  James C. Lester,et al.  Dynamically Sequencing an Animated Pedagogical Agent , 1997, AAAI/IAAI, Vol. 1.

[7]  Steven K. Feiner,et al.  Supporting interactivity in automated 3D illustrations , 1993, IUI '93.

[8]  James D. Hollan,et al.  STEAMER: An Interactive Inspectable Simulation-Based Training System , 1984, AI Mag..

[9]  Mark Windschitl.  Instructional animations: The in-house production of biology software , 1996, J. Comput. High. Educ..

[10]  Steven K. Feiner,et al.  Automated presentation planning of animation using task decomposition with heuristic reasoning , 1993 .

[11]  Steven K. Feiner,et al.  Generating Cross-References for Multimedia Explanation , 1992, AAAI.

[12]  Gerald Millerson,et al.  Video camera techniques , 1983 .

[13]  James C. Lester,et al.  Increasing believability in animated pedagogical agents , 1997, AGENTS '97.

[14]  Johanna D. Moore,et al.  Generating Explanatory Captions for Information Graphics , 1995, IJCAI.

[15]  Lloyd P. Rieber,et al.  Animation in computer-based instruction , 1990 .

[16]  W. Lewis Johnson,et al.  Integrating pedagogical capabilities in a virtual environment agent , 1997, AGENTS '97.

[17]  David Salesin,et al.  Declarative Camera Control for Automatic Cinematography , 1996, AAAI/IAAI, Vol. 1.

[18]  Ira P. Goldstein,et al.  Overlays: A Theory of Modelling for Computer Aided Instruction, , 1977 .

[19]  Beverly Park Woolf,et al.  Teaching a Complex Industrial Process , 1986, AAAI.

[20]  John Lasseter,et al.  Principles of traditional animation applied to 3D computer animation , 1987, SIGGRAPH.

[21]  Wolfgang Wahlster,et al.  WIP: The Automatic Synthesis of Multimodal Presentations , 1991, AAAI Workshop on Intelligent Multimedia Interfaces.

[22]  Joseph V. Maschelli,et al.  The Five C's of Cinematography , 1965 .