A Gesture-Based Interface and Active Cinema

Visual design affects the viewer with various meanings depending upon how it is presented. Our research optimizes visual design in a short animated movie format whose plot is a fixed linear narrative. Designed and functioning in a simulation environment we manipulate the visual design of this short movie according to feedback detected from the viewer. Our goal is to explore the film-maker's ability to refine and optimize a movie experience in a real-time environment working toward a system that dynamically optimizes the visual and auditory impact of a narrative. In this paper, we describe a prototype system that explores and demonstrates these ideas.