As a basic research project, in Vitra we are concerned with the connection between language and visual perception. Aiming at knowledge-based systems that provide a natural language access for visual data, we especially deal with the automatic generation of route descriptions. In order to produce route descriptions taylored to user and application speci c needs we use the following presentation modes: natural language descriptions, 2-dimensional maps and 3dimensional graphics. In this paper we discuss these presentation modes and show how they can be combined for a multimodal route description. Dans : Colloque Interdisciplinaire du Comit e National \Images et Langages: Multimodalit e et Mod elisation Cognitive", Paris, 1993. Ce travail est sponsoris e par le Sonderforschungsbereich 314 der Deutschen Forschungsgemeinschaft, \K unstliche Intelligenz und wissensbasierte Systeme", projet N2: VITRA.
[1]
Wolfgang Wahlster,et al.
Incremental Natural Language Description of Dynamic Imagery
,
1989,
Wissensbasierte Systeme.
[2]
George Lakoff,et al.
Hedges: A study in meaning criteria and the logic of fuzzy concepts
,
1973,
J. Philos. Log..
[3]
Thomas Rist,et al.
Coping with the Intrinsic and Deictic Uses of Spatial Prepositions
,
1986,
AIMSA.
[4]
Som Bandyopadhyay.
Towards an understanding of coherence in multimodal discourse
,
1990
.
[5]
Wolfgang Klein,et al.
Deixis and Spatial Orientation in Route Directions
,
1983
.