A semantic and language-based representation of an environmental scene

The modeling of a landscape environment is a cognitive activity that requires appropriate spatial representations. The research presented in this paper introduces a structural and semantic categorization of a landscape view based on panoramic photographs that act as a substitute of a given natural environment. Verbal descriptions of a landscape scene provide the modeling input of our approach. This structure-based model identifies the spatial, relational, and semantic constructs that emerge from these descriptions. Concepts in the environment are qualified according to a semantic classification, their proximity and direction to the observer, and the spatial relations that qualify them. The resulting model is represented in a way that constitutes a modeling support for the study of environmental scenes, and a contribution for further research oriented to the mapping of a verbal description onto a geographical information system-based representation.

[1]  David M. Mark,et al.  Geographical categories: an ontological investigation , 2001, Int. J. Geogr. Inf. Sci..

[2]  Andrew U. Frank,et al.  Spatial Information Theory A Theoretical Basis for GIS , 1993, Lecture Notes in Computer Science.

[3]  Willem J. M. Levelt,et al.  Linearization in Describing Spatial Networks , 1982 .

[4]  Annette Herskovits.  Language and Spatial Cognition: An Interdisciplinary Study of the Prepositions in English , 2009 .

[5]  Stephen E. Levinson,et al.  On temporal alignment of sentences of natural and synthetic speech , 1983 .

[6]  C. Freksa,et al.  Spatial Cognition, An Interdisciplinary Approach to Representing and Processing Spatial Knowledge , 1998 .

[7]  Barry Smith,et al.  Do Mountains Exist? Towards an Ontology of Landforms , 2003 .

[8]  Paul A. Longley,et al.  Geographical information systems : principles, techniques, management, and applications , 2005 .

[9]  Donald C. Williams.  The Elements of Being , 1953 .

[10]  Christophe Claramunt,et al.  A Semantic and Language-Based Model of Landscape Scenes , 2008, ER Workshops.

[11]  Carola Eschenbach,et al.  Formal Ontology in Information Systems , 2008 .

[12]  Gérard Ligozat,et al.  From language to pictorial representations , 2007 .

[13]  S. Levinson.  Frames of reference and Molyneux's question: Cross-linguistic evidence , 1996 .

[14]  Stephen Kaplan,et al.  Perception and landscape: Conceptions and misconceptions. , 1979 .

[15]  Kevin Lynch,et al.  The Image of the City , 1960 .

[16]  Christian Freksa,et al.  Using Orientation Information for Qualitative Spatial Reasoning , 1992, Spatio-Temporal Reasoning.

[17]  N. Guarino,et al.  Formal Ontology in Information Systems: Proceedings of the 1st International Conference June 6-8, 1998, Trento, Italy , 1998 .

[18]  E. Tolman.  Cognitive maps in rats and men. , 1948, Psychological review.

[19]  Thomas R. Gruber,et al.  A translation approach to portable ontology specifications , 1993, Knowl. Acquis..

[20]  Christophe Claramunt,et al.  A landform-based approach for the representation of terrain silhouettes , 2005, GIS '05.

[21]  Frédéric Landragin,et al.  Visual perception, language and gesture: A model for their understanding in multimodal dialogue systems , 2006, Signal Process..

[22]  Barry Smith,et al.  Fiat and Bona Fide Boundaries: Towards on Ontology of Spatially Extended Objects , 1997, COSIT.

[23]  Stephen C. Hirtle,et al.  The Nature of Landmarks for Real and Electronic Spaces , 1999, COSIT.

[24]  Wilfried Brauer,et al.  Spatial Cognition III , 2003, Lecture Notes in Computer Science.

[25]  Philippe Muller.  Elements d'une theorie du mouvement pour la formalisation du raisonnement spatio-temporel de sens commun , 1998 .

[26]  Mary W. Downton,et al.  Judgments of photographs vs. field observations in studies of perception and judgment of the visual environment , 1984 .

[27]  Daniel R. Montello,et al.  Scale and Multiple Psychologies of Space , 1993, COSIT.

[28]  Paul U. Lee,et al.  How Space Structures Language , 1998, Spatial Cognition.

[29]  Andrew U. Frank,et al.  Ontology for Spatio-temporal Databases , 2003, Spatio-Temporal Databases: The CHOROCHRONOS Approach.

[30]  Annette Herskovits,et al.  Language and spatial cognition , 1986 .

[31]  David M. Mark,et al.  Naive Geography , 1995, COSIT.

[32]  Amatzia Bar-Yosef.  Musical Time Organization and Space Concept: A Model of Cross-Cultural Analogy , 2001 .

[33]  J. Jonides,et al.  Evidence of hierarchies in cognitive maps , 1985, Memory & cognition.

[34]  Frédéric Landragin.  La saillance comme point de départ pour l'interprétation et la génération , 2003 .

[35]  M. Meitner.  Scenic beauty of river views in the Grand Canyon : relating perceptual judgments to locations , 2004 .

[36]  Barbara Tversky,et al.  Cognitive Maps, Cognitive Collages, and Spatial Mental Models , 1993, COSIT.

[37]  Elwood L. Shafer,et al.  A comparison of viewer reactions to outdoor scenes and photographs of those scenes , 1974 .

[38]  Helen Couclelis,et al.  Worlds of Information: The Geographic Metaphor in the Visualization of Complex Information , 1998 .

[39]  B. Kuipers.  The "Map in the Head" Metaphor , 1982 .

[40]  Benjamin Kuipers,et al.  Modeling Spatial Knowledge , 1978, IJCAI.

[41]  B. Tversky,et al.  Perspective in Spatial Descriptions , 1996 .

[42]  Stanley Peters,et al.  Processes, Beliefs, and Questions , 1982 .

[43]  Laura A. Carlson,et al.  On the "Whats" and "Hows" of "Where": The Role of Salience in Spatial Descriptions , 2008, Spatial Cognition.

[44]  Donna Peuquet,et al.  An algorithm to determine the directional relationship between arbitrarily-shaped polygons in the plane , 1987, Pattern Recognit..

[45]  Rochelle Lieber,et al.  Handbook of Word-Formation , 2006 .

[46]  Barbara Tversky,et al.  Descriptions of Simple Spatial Scenes in English and Japanese , 2003, Spatial Cogn. Comput..

[47]  Daniel R. Montello,et al.  The Geometry of Environmental Knowledge , 1992, Spatio-Temporal Reasoning.