Gesture and Speech-based Public Display for Cultural Event Exploration

We introduce a novel, experiential event guide application for serendipitous exploration of event information on public displays. The application is targeted for complex events, such as cultural festivals, which include a large amount of individual events in numerous geographical locations. The application consists of two interfaces, both used in a multimodal manner with hand gestures and spoken interaction: a three dimensional word cloud is used to select events, which can then be explored using event visualization utilizing “metro map” metaphor. A one-week field study of the application in a public location showed strong bias towards the use of gestures against speech.