Agent-typed multimodal interface using speech, pointing gestures and CG

This paper proposes a sophisticated agent-typed user interface using speech, pointing gestures and CG technologies. An “Agent-typed Interior Design System” has been implemented as a prototype for evaluating the proposed agent-typed interface, which has speech and pointing gestures as input modalities, and in which the agent is realized by 3 dimensional CG (3-D CG) and speech guidance. In this paper, the details of system implementation and evaluation results, which clarified the effectiveness of the agent-typed interface, are described.